Skip to main content

Apple’s Vision Pro could get this incredible gaming upgrade

Apple has touted its Vision Pro headset as a premier gaming device that works with many different controllers. But with extensive gesture control seemingly used everywhere on the product except for gaming, it feels like a missed opportunity.

Well, that could change in the future, as a newly published Apple patent (number 11709554) shows how future editions of the Vision Pro could transform your hands into gaming controllers, complete with fingertip controls and haptic feedback.

A person plays a game on the Apple Vision Pro.
Apple

That would be enabled through what Apple somewhat blandly labels “finger devices.” These would consist of a small housing that wraps around each finger, with various sensors packed inside to detect your digit movements.

The sensors could work out when your fingers are tapping together, for example. Apple says its finger devices might also be able to determine how hard you’re pressing or moving your fingers thanks to embedded force sensors.

That’s interesting, you might be thinking, but doesn’t the Vision Pro already detect your finger movements thanks to its outward-facing cameras? Why would you need these little finger devices in the first place?

Well, the really interesting part of the patent concerns haptic feedback. According to Apple, its finger devices could be outfitted with a system that can tap or otherwise interact with your fingers in order to give the sensation of touching a real object in virtual reality.

Haptic output, the patent explains, may be used “to provide the fingers of a user with a desired texture sensation as a user is touching a real object or as a user is touching a virtual object.” In other words, future Vision Pro headsets might be able to convince you that you’re holding or feeling something that isn’t really there.

More immersive gaming

A man plays NBA 2K23 with a DualSense controller.
Apple

The implications of this kind of haptic gaming could be incredible. Not only would you get a deeply immersive visual experience, but also a convincing tactile experience too. That could potentially take your engagement with a game to a new level.

Right now, gaming on the Vision Pro usually involves a controller. That doesn’t put you in the game in the same way a set of haptic hand controllers would — instead of pressing a button to swing a sword, for example, you could actually perform the gesture yourself and have the finger devices map out the weighty feeling of the sword haft in your hand.

All that said, this is just a patent, so it’s possible Apple will never put it into action. But if you’re a fan of virtual reality gaming and want to see what could come next for the Reality Pro, there may be exciting times ahead.

Editors' Recommendations

Alex Blake
In ancient times, people like Alex would have been shunned for their nerdy ways and strange opinions on cheese. Today, he…
Apple’s Vision Pro may help your eyesight in this genius way
A person tries on an Apple Vision Pro mixed reality headset in an Apple Store, with an Apple employee alongside them.

There are still a ton of mysteries surrounding Apple’s Vision Pro headset, and one of them is how the device will work with prescription lenses. A new patent might have shed some light on that, and it reveals a pretty remarkable idea from Apple.

According to the recently published patent (number 20230258944), the Vision Pro could use lenses made out of liquid instead of glass. This would apparently allow them to be highly customizable, allowing you to fine-tune them to perfectly match your prescription and your vision needs. After we learned that the next Vision Pro could send you on a mood-altering trip, it’s another instance of Apple envisioning a wacky idea to elevate its headset.

Read more
Apple could soon kill off the Mac Pro, new report claims
Apple's new Mac Pro sits on display in the showroom during Apple's Worldwide Developer Conference (WWDC).

It’s likely we are now only a few weeks away from seeing Apple’s first Macs loaded with M3 chips, but the entire lineup has apparently just been leaked for all to see. And there are a few big surprises among the rumored Macs.

We’ve gained these revelations thanks to journalist Mark Gurman, whose reports are usually impressively accurate when it comes to upcoming Apple products. Gurman’s latest report is allegedly based on chip configurations Apple is testing internally, so things could change in the future.

Read more
The next Vision Pro could let you see invisible energy
A man wears Apple Vision Pro.

Before it launched, there was concern that Apple’s Vision Pro headset could struggle to find a strong ‘killer app.’ Well, Apple might have found one, as a fresh patent from the company explains that future versions of the device could let you see the invisible energy that floats around you.

No, we’re not talking about some kind of New Age mysticism. Instead, Apple is apparently working on letting the Vision Pro visualize things like electrical currents, radio signals, Wi-Fi output, and more. This ability could help engineers diagnose problems in your home, for example -- or let you fix them yourself.

Read more