Before it launched, there was concern that Apple’s Vision Pro headset could struggle to find a strong ‘killer app.’ Well, Apple might have found one, as a fresh patent from the company explains that future versions of the device could let you see the invisible energy that floats around you.
No, we’re not talking about some kind of New Age mysticism. Instead, Apple is apparently working on letting the Vision Pro visualize things like electrical currents, radio signals, Wi-Fi output, and more. This ability could help engineers diagnose problems in your home, for example — or let you fix them yourself.
Aside from repair work, Apple’s patent details how headset wearers could get extra experiences with their device thanks to its ability to detect invisible signals. For example, Apple says that “billboards, posters, or other print or screen media in the physical environment may emit non-visible light such as [infrared] light that can be detected and visualized.” Think 3D movies (or commercials), only with a Vision Pro.
So, how will it work? According to the patent, the Vision Pro could rely on a wide range of different sensors, from those that can detect touch or sound to those adept at picking up heart rates or radio waves.
Once a sensor has picked up an invisible signal, the device then obtains a depth map of the environment around you and looks for contextual objects near where the signal was detected. That might mean it looks for a Wi-Fi router if internet signals are picked up, for instance. The headset would then display a visualization of the signal in the appropriate place, overlaid in augmented reality.
Interestingly, Apple explains that these sensors don’t necessarily need to be on the headset itself, but could be found on a connected device, such as an Apple Watch or an iPhone. That would presumably offload some of the processing from the headset to another device, helping to keep the processing power and temperature at reasonable levels.
Detecting hidden objects
This technology might not be limited to invisible signals, but could also include physical objects that are simply unseen by the headset wearer. Apple says this could include “hidden objects such as objects with known locations that are obscured from view by other physical objects.” That could be useful for navigation systems — for example in Apple’s long-rumored self-driving car.
Since this is just a patent, there’s no way of knowing if Apple will ever put this idea into practice — but if it does, it could be a great new use case for the Vision Pro. We’ll have to see if it becomes a reality when Apple launches the Vision Pro 2 in the future.
