Skip to main content

Leak reveals how Apple VR headset’s hand tracking may work

Apple’s secret mixed-reality headset — dubbed Reality Pro — is due to launch imminently, but the way you’ll use the device is something of a mystery. Sure, rumors have pointed to some form of gesture control, but that’s a pretty vague description. Fortunately, we might now have a better idea of how it will work.

That’s because Apple has just been granted a patent outlining how you might be able to use a special ring to control objects while using the Reality Pro headset. The idea is that, with this ring on your finger, you’ll be able to perform various gestures that will let you open apps, scroll webpages, and more.

The patent explains that Apple is working on gestures specifically involving skin-to-skin contact. That might mean tapping the fingers of one hand onto the palm of another. Or it could mean pinching the fingers of one hand together. That could let the headset detect a wide range of movements and gestures.

Apple’s idea of using a ring to enable this gesture control system is interesting because we haven’t seen this sort of thing before. Other patents have covered things like using an Apple Pencil to draw in augmented reality, or popping thimble-like devices onto your fingertips to enable hand-tracking.

A small handful of leakers and analysts have hinted that the Reality Pro will use some form of gesture system, with journalist Mark Gurman suggesting you’ll be able to look at app icons on-screen and then pinch your fingers to open the app, for example. But few have suggested the ring device outlined in Apple’s patent.

Other secret ideas

A rendering of an Apple mixed-reality headset (Reality Pro) in a gold color seen from the front.
Apple headset render. Ahmed Chenni, Freelancer.com

This isn’t the first hand-tracking idea Apple has been toying with for its headset. We’ve previously seen an Apple patent that outlined how the headset could use two Apple Watches to enable its gesture controls (and this latest patent also explores that idea). But that seems a pretty clunky — not to mention expensive — way of going about things.

Using a ring would be a much more streamlined way of granting you the ability to use gesture controls, and wouldn’t require you to fork out hundreds of dollars for two expensive watches. As well as that, it would probably be less likely to get damaged in the process of using gesture controls than two bulky Apple Watches, so that’s another plus.

Since this is just a patent, it’s best to treat it with a degree of skepticism. In the end, Apple might just be exploring ideas and could use a totally different method for gesture control — if it includes it with the Reality Pro at all.

Ultimately, we only have a few weeks to find out how the Reality Pro’s gesture control system will work, as Apple is widely expected to launch the headset at its Worldwide Developers Conference (WWDC) on June 5. Until then, we’re left to read the patent tea leaves for clues.

Editors' Recommendations

Alex Blake
In ancient times, people like Alex would have been shunned for their nerdy ways and strange opinions on cheese. Today, he…
Apple’s Vision Pro could get this incredible gaming upgrade
A person plays a game on the Apple Vision Pro.

Apple has touted its Vision Pro headset as a premier gaming device that works with many different controllers. But with extensive gesture control seemingly used everywhere on the product except for gaming, it feels like a missed opportunity.

Well, that could change in the future, as a newly published Apple patent (number 11709554) shows how future editions of the Vision Pro could transform your hands into gaming controllers, complete with fingertip controls and haptic feedback.

Read more
Apple’s next Vision Pro may send you on a mood-altering trip
The Apple Vision Pro reveals the wearer's eyes on a front-facing display.

It sounds like something out of a sci-fi novel, but Apple could be working on a way to let you alter your mood just by telling its Vision Pro headset how you want to feel. That’s according to a recently granted patent (number 11703944) that outlines the whole futuristic idea.

It’s a strange concept and one that sounds woven right out of a Philip K. Dick story. In fact, in the author’s Do Androids Dream of Electric Sheep? there is a machine that puts users into whatever mood they desire. It sounds as though Apple’s inventors have been reading a little sci-fi in their spare time.

Read more
Apple’s secret AR glasses may have this genius feature for glasses users
Apple iGlasses

Apple’s Vision Pro headset has got the entire tech world talking, but it’s still unclear exactly how it will work with the prescription lenses used by glasses wearers around the world. Get it right and it could be a beautifully seamless experience -- get it wrong and Apple risks alienating potentially millions of users. It’s a crucial obstacle to overcome.

Apple has said it will let you add special prescription lenses to the Vision Pro, but pricing is uncertain, and they could cost as much as $600 a pop according to journalist Mark Gurman. Now, though, a fresh patent for Apple’s upcoming augmented reality (AR) glasses shows that there could be a much better -- and cheaper -- way to do it.

Read more