Skip to main content

Apple’s new AR headset may use Face ID technology to track hand gestures

Apple has an augmented reality (AR) headset in the works, and a well-known analyst now predicts that it will use Face ID to track hand movements.

The upcoming headset is said to be equipped with more 3D sensing modules than iPhones and, according to the report, may one day replace iPhones altogether.

Apple VR Headset Concept by Antonio De Rosa.
Antonio De Rosa

The information comes from a note for investors prepared by Ming-Chi Kuo, a respected analyst, which was then shared by MacRumors. In his report, he elaborates on the kind of performance and features we can expect from the upcoming Apple AR/MR (augmented reality/mixed reality) headset.

Recommended Videos

According to Kuo, the new headsets will feature four sets of 3D sensors as opposed to the one to two sets currently offered by the latest iPhones. The use of extra sensors opens up the headset to a whole lot of new capabilities, extending the realism of the user experience.

The sensors used in the new Apple headset rely on structured light to detect motion and actions. Kuo predicts that this will make it possible for the headset to track not just the position of the user, but also the hands of the user and other people, objects in front of the user, and lastly, detailed changes in hand movements.

Kuo compared the headset’s ability to track small hand movements to the way Apple’s Face ID is capable of tracking changes in facial expressions. Being able to detect small hand and finger movements allows for a more intuitive user interface that doesn’t take away from the realism of using an AR/MR headset.

Apple VR Headset Concept by Antonio De Rosa.
Apple VR Headset Concept Antonio De Rosa

Both the iPhone and the yet unnamed Apple headset rely on structured light, but the headset needs to be more powerful than the iPhone in order to offer proper hand movement detection. Kuo notes that this means that the structured light power consumption of the AR/MR headset is higher.

“We predict that the detection distance of Apple’s AR/MR headset with structured light is 100% to 200% farther than the detection distance of the iPhone Face ID. To increase the field of view for gesture detection, we predict that the Apple AR/MR headset will be equipped with three sets of ToFs (time of flight) to detect hand movement trajectories with low latency requirements,” said Ming-Chi Kuo in his investor note.

Kuo believes that Apple may one day wish to replace the iPhone with the AR headset, although that won’t happen anytime soon. He predicts that in the next 10 years, headsets may very well replace existing electronics with displays.

With the added hand gesture tracking, the new Apple headset may offer an immersive user experience. As rumors suggest that Apple may be looking to join Meta and other companies in expanding toward the metaverse, it’s possible that this headset might be the first step toward just that.

Monica J. White
Monica is a computing writer at Digital Trends, focusing on PC hardware. Since joining the team in 2021, Monica has written…
Sony’s flip-up XR headset costs even more than an Apple Vision Pro
Sony's SRH-S1 held in a hand at CES 2025.

Sony is one of the biggest names in VR gaming with the popular PlayStation VR2. Now it’s launching a high-end XR headset with specifications that rival the Apple Vision Pro. To be clear, this isn’t the Sony XYN headset powered by Google's new Android XR, and it won’t connect to a PlayStation 5. It’s aimed at enterprise customers that design products, and it costs even more than the ultra-premium Vision Pro.

Priced at $4,750, the Sony SRH-S1 is a powerful system with integrated hardware and software, a flip-up visor, and unique controllers optimized for manipulating virtual 3D objects. Being able to lift the visor for face-to-face conversations is convenient. The halo strap design also removes all facial pressure. A ring on one finger lets you grasp items, and a 3D stylus that looks like something from a sci-fi movie allows precise adjustments.

Read more
Meta may have canceled its high-end Apple Vision Pro competitor
The Meta Quest 3 and Quest Pro appear side-by-side.

According to a report from The Information citing two Meta employees, Meta has canceled its plans for a premium mixed-reality headset. It seems the company told Reality Lab employees to halt work on the product this week after executives, including CEO Mark Zuckerberg, reviewed the project.

It's uncertain whether the device was destined to be a sequel to the Meta Quest Pro or a completely new product, but it's clear that developing a competitor for the Apple Vision Pro was the purpose of the project.

Read more
The Vision Pro still has a chance at success
A person pinches while wearing an Apple Vision Pro.

There's no doubt that the Vision Pro hasn't exactly been a bestseller. A new report from market analysts indicates that fewer than 500,000 Vision Pro headsets will be sold by the end of the year.

However, the report also offers some good news for the future of the platform. According to Bloomberg, citing data from market analyst IDC, Apple is planning a cheaper version of the Vision Pro in 2025, and that could be the company's ticket to a much more popular device, predicting that it could double the sales of the Vision Pro next year.

Read more