Skip to main content

Apple’s Vision Pro could get this incredible gaming upgrade

Apple has touted its Vision Pro headset as a premier gaming device that works with many different controllers. But with extensive gesture control seemingly used everywhere on the product except for gaming, it feels like a missed opportunity.

Well, that could change in the future, as a newly published Apple patent (number 11709554) shows how future editions of the Vision Pro could transform your hands into gaming controllers, complete with fingertip controls and haptic feedback.

A person plays a game on the Apple Vision Pro.
Apple

That would be enabled through what Apple somewhat blandly labels “finger devices.” These would consist of a small housing that wraps around each finger, with various sensors packed inside to detect your digit movements.

Recommended Videos

The sensors could work out when your fingers are tapping together, for example. Apple says its finger devices might also be able to determine how hard you’re pressing or moving your fingers thanks to embedded force sensors.

That’s interesting, you might be thinking, but doesn’t the Vision Pro already detect your finger movements thanks to its outward-facing cameras? Why would you need these little finger devices in the first place?

Well, the really interesting part of the patent concerns haptic feedback. According to Apple, its finger devices could be outfitted with a system that can tap or otherwise interact with your fingers in order to give the sensation of touching a real object in virtual reality.

Haptic output, the patent explains, may be used “to provide the fingers of a user with a desired texture sensation as a user is touching a real object or as a user is touching a virtual object.” In other words, future Vision Pro headsets might be able to convince you that you’re holding or feeling something that isn’t really there.

More immersive gaming

A man plays NBA 2K23 with a DualSense controller.
Apple

The implications of this kind of haptic gaming could be incredible. Not only would you get a deeply immersive visual experience, but also a convincing tactile experience too. That could potentially take your engagement with a game to a new level.

Right now, gaming on the Vision Pro usually involves a controller. That doesn’t put you in the game in the same way a set of haptic hand controllers would — instead of pressing a button to swing a sword, for example, you could actually perform the gesture yourself and have the finger devices map out the weighty feeling of the sword haft in your hand.

All that said, this is just a patent, so it’s possible Apple will never put it into action. But if you’re a fan of virtual reality gaming and want to see what could come next for the Reality Pro, there may be exciting times ahead.

Alex Blake
Alex Blake has been working with Digital Trends since 2019, where he spends most of his time writing about Mac computers…
Apple’s iPhone 16e is here, and it’s making me frustrated about the MacBook
A group of iPhone 16e phones arranged in a pattern.

The new iPhone 16e is here, and it’s the biggest revamp in the history of Apple’s affordable iPhone line. With Face ID security, an A18 chip and USB-C connectivity, it’s an overhaul that touches almost every part of the device.

Perhaps the most momentous change, though, is the introduction of a large, 6.1-inch OLED display. This is the first time the now-renamed iPhone SE has had an all-screen front face, and it’s also the first time it’s been infused with OLED technology.

Read more
Apple’s upcoming Studio Display could mean worrying news for pro users
A person uses an Apple Mac Pro alongside three monitors and an editing console in a darkened room.

Just a few days ago, we found out that Apple is working on a new Studio Display with a mini-LED screen. Now, that idea seems to be confirmed, with highly accurate Bloomberg reporter Mark Gurman stating that this monitor should launch “by 2026.”

The Studio Display first saw the light of day in 2022, meaning there’s been a lengthy wait for updates. But that delay just highlights the problems with an even older Apple monitor: 2019’s Pro Display XDR.

Read more
Apple eyes AI push on the Vision Pro. What it needs is a health pivot
A man wears an Apple Vision Pro headset.

Apple’s ambitions in the immersive world of augmented and virtual reality (AR and VR) are off to a rough start. The $3,500 Vision Pro failed to kick off a market storm. Then came reports of Apple cancelling its AR smart glasses project.

The company, however, is not done yet. As per Bloomberg, Apple is bringing its suite of AI tools called Apple Intelligence to the visionOS platform. That means AI tricks such as Writing Tools, Genmoji, and Image Playground are coming to the headset.

Read more