Skip to main content

Apple’s Vision Pro could get this incredible gaming upgrade

Apple has touted its Vision Pro headset as a premier gaming device that works with many different controllers. But with extensive gesture control seemingly used everywhere on the product except for gaming, it feels like a missed opportunity.

Well, that could change in the future, as a newly published Apple patent (number 11709554) shows how future editions of the Vision Pro could transform your hands into gaming controllers, complete with fingertip controls and haptic feedback.

A person plays a game on the Apple Vision Pro.
Apple

That would be enabled through what Apple somewhat blandly labels “finger devices.” These would consist of a small housing that wraps around each finger, with various sensors packed inside to detect your digit movements.

The sensors could work out when your fingers are tapping together, for example. Apple says its finger devices might also be able to determine how hard you’re pressing or moving your fingers thanks to embedded force sensors.

That’s interesting, you might be thinking, but doesn’t the Vision Pro already detect your finger movements thanks to its outward-facing cameras? Why would you need these little finger devices in the first place?

Well, the really interesting part of the patent concerns haptic feedback. According to Apple, its finger devices could be outfitted with a system that can tap or otherwise interact with your fingers in order to give the sensation of touching a real object in virtual reality.

Haptic output, the patent explains, may be used “to provide the fingers of a user with a desired texture sensation as a user is touching a real object or as a user is touching a virtual object.” In other words, future Vision Pro headsets might be able to convince you that you’re holding or feeling something that isn’t really there.

More immersive gaming

A man plays NBA 2K23 with a DualSense controller.
Apple

The implications of this kind of haptic gaming could be incredible. Not only would you get a deeply immersive visual experience, but also a convincing tactile experience too. That could potentially take your engagement with a game to a new level.

Right now, gaming on the Vision Pro usually involves a controller. That doesn’t put you in the game in the same way a set of haptic hand controllers would — instead of pressing a button to swing a sword, for example, you could actually perform the gesture yourself and have the finger devices map out the weighty feeling of the sword haft in your hand.

All that said, this is just a patent, so it’s possible Apple will never put it into action. But if you’re a fan of virtual reality gaming and want to see what could come next for the Reality Pro, there may be exciting times ahead.

Alex Blake
In ancient times, people like Alex would have been shunned for their nerdy ways and strange opinions on cheese. Today, he…
The Vision Pro is already in trouble. Here’s how Apple can turn the tide
A man wears an Apple Vision Pro headset.

Apple’s Vision Pro headset lit the world on fire when it was announced at the Worldwide Developers Conference (WWDC) in June 2023, and again when it launched in February of this year. But in the months since, it’s apparently been losing steam, with sales down and people staying away from in-store demonstrations. That doesn’t bode well for Apple’s “next big thing.”

The key question, though, is whether this an actual problem for Apple. And if so, what can the company do about it?
In free fall?
If you read Bloomberg journalist Mark Gurman’s latest Power On newsletter, you’ll see some concerning reporting, at least from Apple’s perspective. Citing staff at Apple’s retail stores, Gurman claims that “Demand for [Vision Pro] demos is way down. People who do book appointments often don’t show up.”

Read more
This new VR headset beats the Vision Pro in one key way and is half the price
Pimax Crystal Super and Light VR headsets appear on a dark background.

While the Apple Vision Pro offers ultra-high-resolution displays with 23 million pixels, the staggering $3,500 price might inspire you to look for Vision Pro alternatives.

Good news: Pimax just announced two new VR headsets, including a budget model that costs as low as $799 and a more advanced version starting at $1,799. Both are based on the design of one of the best VR headsets currently available -- the Pimax Crystal that launched in May 2023 for $1,599 -- but come with a serious upgrade in terms of resolution.
Pimax Crystal Super

Read more
How to try out the Vision Pro headset yourself
Someone using Vision Pro at a demo in an Apple Store.

The Apple Vision Pro has made a huge splash, introducing a wave of new customers to the world of mixed-reality. The headset -- also known as a “spatial computer” -- has been on sale since February this year, and it's grabbed headlines and attention.

The experience of using a Vision Pro has been met with a wide range of responses, from Mark Zuckerberg's infamous (and clearly partisan) observations to enthusiasm from tech lovers. But there have been some persistent issues even among the generally positive reviews, particular in terms of discomfort while wearing the device and problems with motion sickness. There were even reports of people returning their Vision Pros, though it's not clear if this was a really widespread issue or just the kinds of teething problems that might be expected with any new piece of tech.

Read more