Skip to main content

HTC Vive Pro cameras can be used to track hands, controllers

Beyond the uprated screen resolution over its predecessor, the HTC Vive Pro’s most obvious change is in the form of a secondary external camera on the front. Although speculation suggested that the stereoscopic array could enable augmented reality, it turns out that the cameras are used for depth sensing, which can improve the safety-orientated chaperone feature and enable basic controller and hand tracking.

One of the major difficulties faced by virtual reality companies in headset and controller development is occlusion. If something gets in the way of the sensors, suddenly the system powering the headset doesn’t know where it is and that could get uncomfortable for the wearer. The HTC Vive’s Valve-developed Lighthouse trackers had less trouble with that than the Oculus Rift’s cameras, but it still wasn’t perfect.

Recommended Videos

HTC/Valve’s Lighthouse 2.0 tracking solution, due to release later in 2018, will improve this with support for four tracking stations, but the Vive Pro’s cameras could provide a secondary layer of anti-occlusion technology too. In an interview with HTC Vice President of VR technology Raymond Pao, Engadget learned that the stereoscopic cameras can track hands independently of controllers or Vive trackers.

That wasn’t its original intention, however. HTC’s initial plan was to use them to augment its chaperone feature which provides a digital wall to prevent VR users from hurting themselves and damaging hardware. The cameras would be able to provide a more nuanced chaperone tracking system, thereby showing objects which could be knocked over, or potentially pets or children getting in the way.

That is because the cameras are only capable of “low VGA” resolution (640 x 480), so wouldn’t be fun to look through for augmented reality purposes. However, because of their depth-sensing capabilities, early developers playing around with the Vive Pro found that they could provide basic hand-tracking. Although simple, it was enough to provide precise tracking for fingers, making it possible to play VR games without motion controllers.

That form of “inside-out” tracking does have its limitations — putting your hands outside of the view of the camera would break tracking — but it shows interesting potential. Even then it could be used as a backup tracking solution for controllers should the wearer’s body or another object block the line of sight to the mounted Lighthouse sensors.

Jon Martindale
Jon Martindale is a freelance evergreen writer and occasional section coordinator, covering how to guides, best-of lists, and…
This new VR headset beats the Vision Pro in one key way and is half the price
Pimax Crystal Super and Light VR headsets appear on a dark background.

While the Apple Vision Pro offers ultra-high-resolution displays with 23 million pixels, the staggering $3,500 price might inspire you to look for Vision Pro alternatives.

Good news: Pimax just announced two new VR headsets, including a budget model that costs as low as $799 and a more advanced version starting at $1,799. Both are based on the design of one of the best VR headsets currently available -- the Pimax Crystal that launched in May 2023 for $1,599 -- but come with a serious upgrade in terms of resolution.
Pimax Crystal Super

Read more
Apple Vision Pro 2: everything we know so far
The Apple Vision Pro reveals the wearer's eyes on a front-facing display.

Apple’s Vision Pro headset has been the talk of the tech world since it was unveiled, but Apple is already planning to follow it up with two new models that could take the headset to new heights -- and put it into the hands of more people. That includes a second-generation Apple Vision Pro, as well as a pared-back headset with a lower price.

What exactly should we expect from these devices? What kind of features will they offer, and when will they launch? If you’re seeking the answers to all those questions and more, you’re in the right place, as our rumor roundup will guide you through everything you need to know. Let’s get started.
Vision Pro 2: price and release date

Read more
Apple’s Vision Pro could be coming to these countries next
The front visor of the Vision Pro on display at an Apple Store.

Code found within visionOS appears to reveal the countries in which Apple’s Vision Pro headset will launch next.

Spotted by MacRumors on Wednesday, the code found within the Vision Pro's operating system points to keyboard support for other languages, specifically:

Read more