Skip to main content

Apple’s new AR headset may use Face ID technology to track hand gestures

Apple has an augmented reality (AR) headset in the works, and a well-known analyst now predicts that it will use Face ID to track hand movements.

The upcoming headset is said to be equipped with more 3D sensing modules than iPhones and, according to the report, may one day replace iPhones altogether.

Apple VR Headset Concept by Antonio De Rosa.
Antonio De Rosa

The information comes from a note for investors prepared by Ming-Chi Kuo, a respected analyst, which was then shared by MacRumors. In his report, he elaborates on the kind of performance and features we can expect from the upcoming Apple AR/MR (augmented reality/mixed reality) headset.

According to Kuo, the new headsets will feature four sets of 3D sensors as opposed to the one to two sets currently offered by the latest iPhones. The use of extra sensors opens up the headset to a whole lot of new capabilities, extending the realism of the user experience.

The sensors used in the new Apple headset rely on structured light to detect motion and actions. Kuo predicts that this will make it possible for the headset to track not just the position of the user, but also the hands of the user and other people, objects in front of the user, and lastly, detailed changes in hand movements.

Kuo compared the headset’s ability to track small hand movements to the way Apple’s Face ID is capable of tracking changes in facial expressions. Being able to detect small hand and finger movements allows for a more intuitive user interface that doesn’t take away from the realism of using an AR/MR headset.

Apple VR Headset Concept by Antonio De Rosa.
Apple VR Headset Concept Antonio De Rosa

Both the iPhone and the yet unnamed Apple headset rely on structured light, but the headset needs to be more powerful than the iPhone in order to offer proper hand movement detection. Kuo notes that this means that the structured light power consumption of the AR/MR headset is higher.

“We predict that the detection distance of Apple’s AR/MR headset with structured light is 100% to 200% farther than the detection distance of the iPhone Face ID. To increase the field of view for gesture detection, we predict that the Apple AR/MR headset will be equipped with three sets of ToFs (time of flight) to detect hand movement trajectories with low latency requirements,” said Ming-Chi Kuo in his investor note.

Kuo believes that Apple may one day wish to replace the iPhone with the AR headset, although that won’t happen anytime soon. He predicts that in the next 10 years, headsets may very well replace existing electronics with displays.

With the added hand gesture tracking, the new Apple headset may offer an immersive user experience. As rumors suggest that Apple may be looking to join Meta and other companies in expanding toward the metaverse, it’s possible that this headset might be the first step toward just that.

Editors' Recommendations

Monica J. White
Monica is a UK-based freelance writer and self-proclaimed geek. A firm believer in the "PC building is just like expensive…
9 new Apple products that could launch in 2023
The back of the iPhone 14 Pro Max.

As it currently stands, 2023 has already been a busy year for Apple. The company launched a new yellow iPhone 14, brought back the HomePod, and refreshed its Mac lineup with an M2 Mac mini and M2 MacBook Pro. But what else is on the docket? As it turns out, a lot more. From new iPhones, an upgraded Apple Watch, and possibly an AR headset, here are nine products we still expect from Apple in 2023.
iPhone 15 and iPhone 15 Pro

If there is any Apple product with an upgrade cycle that’s literally like clockwork, it’s the iPhone, which is always out in the fall. This year, we can expect the iPhone 15 lineup to include an iPhone 15, iPhone 15 Plus, iPhone 15 Pro, and iPhone 15 Pro Max. However, it is rumored that the iPhone 15 will have a bigger 6.2-inch display this year, but the rest of the lineup will have the same sizes as before.

Read more
Leak reveals how Apple VR headset’s hand tracking may work
A rendering of an Apple mixed-reality headset (Reality Pro) in a gold color seen from the front.

Apple’s secret mixed-reality headset -- dubbed Reality Pro -- is due to launch imminently, but the way you’ll use the device is something of a mystery. Sure, rumors have pointed to some form of gesture control, but that’s a pretty vague description. Fortunately, we might now have a better idea of how it will work.

That’s because Apple has just been granted a patent outlining how you might be able to use a special ring to control objects while using the Reality Pro headset. The idea is that, with this ring on your finger, you’ll be able to perform various gestures that will let you open apps, scroll webpages, and more.

Read more
Apple’s Reality Pro headset is the VR industry’s ‘last hope’
A rendering of an Apple mixed-reality headset (Reality Pro) in a gray color seen from the front.

Apple’s upcoming mixed reality headset hasn’t even launched, yet it’s already being touted as the “last hope” for the virtual reality (VR) headset industry. It shows what a dire situation the market is in, at least according to some estimates.

The grim appraisal comes from respected industry analyst Ming-Chi Kuo. In a post on Medium, Kuo explained that other headset makers have cut their production plans and are shipping far fewer units than previously expected. The malaise affects augmented reality (AR) and mixed reality (MR) headsets as well as their VR counterparts, says Kuo.

Read more