Skip to main content

Veeso face-tracking headset hopes to become virtual reality’s missing link

veeso face tracking headset product shot
Image used with permission by copyright holder
Virtual reality is about to get much more real. No longer will you be just an invisible observer of a virtual world; people there will be able to look back at you, as well. At least, this is if Veeso, a VR headset with built in face-tracking technology, catches on.

Veeso is powered by a consumer-friendly version of the digital performance capture technology used in movies like Avatar and Planet of the Apes. It uses computer vision to track points on a user’s face and plot them to a mesh, similar to how Snapchat Lenses work.

From the outside, the hardware looks like your standard VR headset. But on the inside, an infrared camera positioned between the lenses tracks eye movement. A tiny boom extends below the goggles, with another camera angled at the wearer’s mouth for reading facial expressions.

While the technology is still in prototype, the goal is to be able to capture subtle details of a user’s expressions, beyond just a big smile or dramatic frown. The infrared camera will track eyebrow movement, how open or closed a user’s eyes are, and even the position of the pupils. Veeso’s international team of engineers and designers envision a shared virtual world where even fatigue and tiredness can be visually communicated.

Veeso’s onboard ARM processor handles the task of building the three-dimensional mesh, then wirelessly communicates that information to a user’s phone (iOS or Android) where the actual rendering occurs.

As the hardware is all but useless without compatible software, there’s also a dev kit intended for game studios and tinkerers. The kit includes access to the Veeso SDK, docs, samples, and developer forums.

With a few kinks still needing to be worked out, the creators of Veeso are looking to Kickstarter to raise money in order to continue development and enter production. They’ve set a lofty goal of $80,000, but with 24 days left, there’s still plenty of time. Early-bird backers can get in on the action for just $70, or $80 for the headset and dev kit.

Editors' Recommendations

Daven Mathies
Former Digital Trends Contributor
Daven is a contributing writer to the photography section. He has been with Digital Trends since 2016 and has been writing…
Apple’s mixed-reality headset could be delayed yet again
A man using a virtual reality headset with controllers.

Apple’s rumored mixed-reality (MR) headset has seen some interesting developments in recent days, from details about its powerful chip setup to the likelihood it will use three immersive displays. But today, there’s some bad news: We might have quite a wait to actually buy one.

According to Bloomberg reporter Mark Gurman, Apple is considering pushing back the headset’s launch by a few months due to numerous ongoing issues. That could delay its announcement until late 2022 or beyond, with the headset potentially not actually launching until 2023. It’s just the latest in a litany of problems and holdups to have afflicted the device.

Read more
Apple’s mixed reality headset could be as powerful as the MacBook Pro
A woman reaching out while wearing a VR headset.

Just yesterday we learned that the metaverse is supposedly “off-limits” for Apple’s planned mixed reality headset. Now, a fresh report has claimed the device will use the same 96W power adapter as the latest MacBook Pro and will come loaded with a dual-chip setup, suggesting the headset will have some serious firepower under the hood.

The device is expected to blend augmented reality (AR) and virtual reality (VR), the result being a mixed reality (MR) headset that offers the flexibility to switch between AR and VR as you see fit. Previous rumors have suggested it will be bristling with around a dozen cameras, use high-resolution displays, and could also incorporate advanced gesture-recognition tech.

Read more
Apple’s new AR headset may use Face ID technology to track hand gestures
Apple VR Headset Concept by Antonio De Rosa

Apple has an augmented reality (AR) headset in the works, and a well-known analyst now predicts that it will use Face ID to track hand movements.

The upcoming headset is said to be equipped with more 3D sensing modules than iPhones and, according to the report, may one day replace iPhones altogether.

Read more