Skip to main content

Qualcomm’s stand-alone VR headset design uses Tobii eye-tracking

Image used with permission by copyright holder

Tobii, the company behind the popular eye-tracking hardware for PC gaming, said on Thursday, March 15, that it teamed up with Qualcomm to bring eye-tracking capabilities to mobile headsets supporting virtual reality and augmented reality. The technology will be part of Qualcomm’s next-generation reference design and development kit based on its new Snapdragon 845 processor, which was first used in the Samsung Galaxy S9 phone launched in February. 

Qualcomm’s head-mounted display (HMD) reference design will include Tobii’s proprietary EyeCore eye-tracking algorithms and hardware design. In turn, Tobii said it would work closely with HMD manufacturers to provide the best optical solution for their design. The company also plans to license its eye-tracking technologies and system to these manufacturers as well. 

On a PC, Tobii’s eye-tracking hardware does just that — it tracks where the gamer is looking at all times to enhance the experience. For example, Assassin’s Creed Syndicate will automatically pan the worldview according to the gamer’s focus versus the player moving the mouse to pan the camera. Likewise, the system will automatically select a target in-game when the player views an enemy, or scanning places to attach a grappling hook. 

On a Windows 10 PC, Tobii’s system can make navigation a bit easier. On a laptop, you can simply look at a specific point on the screen, and the cursor will jump to that point when placing a finger on the touchpad. Other capabilities in Windows 10 when using Tobii’s hardware includes managing apps using task view, the application switcher, snap assist, and more. 

Image used with permission by copyright holder

But with virtual and augmented reality scenarios, eye tracking can relieve a large chunk of the rendering overhead needed to create the experience. Right now, headsets render the entire environment crystal clear no matter your focal point. But with eye tracking, the overall performance increases by not fully rendering the scene outside your field of view. Eye tracking can enable this method, called “foveated rendering.” 

Yet, that is not all. According to Tobii, eye tracking can enable HMDs to orient images based on your pupils. That indicates you will no longer need to manually adjust the lenses given Tobii’s hardware will adjust the scene for each individual, increasing visual quality. Another benefit is hand-eye-coordination: You won’t need to fully move your head like a robot to interact with virtual objects controlled by your hands. 

“Devices can accurately track your gaze in real time, enabling content creators to express one of the most fundamental dimensions of human interaction — eye contact,” the company says. “VR technologies hold the promise of enabling a new and immersive medium for social interaction. The addition of true eye contact to virtual reality helps deliver that promise.” 

Qualcomm’s Snapdragon 845-based reference design will be its second stand-alone HMD kit to date. The first kit, introduced in 2017, relies on the older Snapdragon 835 chip along with a single AMOLED screen with a 2,560 x 1,440 resolution. The recent stand-alone Google Daydream headsets are mostly based on this design along with HTC’s Vive Focus headset sold in China. 

Editors' Recommendations

Kevin Parrish
Former Digital Trends Contributor
Kevin started taking PCs apart in the 90s when Quake was on the way and his PC lacked the required components. Since then…
Cost of Oculus Go stand-alone VR headset permanently slashed by $50
walmart oculus go vr headset 30 gift card

The price tag of the 32GB Oculus Go has been permanently slashed by $50, bringing the cost of the stand-alone virtual reality headset to an even more affordable $149.

Facebook, which owns Oculus, confirmed the price cut to UploadVR, saying that the discount will be applicable across all countries where the VR headset is sold. The 64GB version of the device received the same $50 price cut, bringing its price tag down to $199 from $249.

Read more
The Qualcomm XR2 augmented reality chipset will power next-gen headsets with 5G
qualcomm snapdragon xr2 augmented reality news

There's a new AR in town: Qualcomm unveiled the Snapdragon XR2 chipset for a new generation of augmented reality devices at its annual Snapdragon Summit -- promising to marry the power of AR with the promise of 5G. The  XR2 is a follow-up to Qualcomm's Snapdragon XR1 and brings a range of new features to next-gen AR headsets. The announcement came alongside news of the new Snapdragon 865 platform, which is set to power the majority of flagship Android phones in 2020.

Perhaps the most notable new feature on offer by the XR2 platform is the fact that it’s the first AR chipset to support 5G connectivity. That means it will be perfect for things like streaming video or accessing large amounts of data on the go.

Read more
Smartglasses use eye-tracking to make sure whatever you look at is in focus
stanford smart glasses reading monitor with


When you hear the term “smartglasses,” you might picture something like Google Glass. But researchers at Stanford University have taken a very different tack with their latest project. They’ve developed a pair of experimental smartglasses which could be used to treat a variety of vision defects using depth-sensing cameras and eye-tracking technology.

Read more