Mindmaze's VR facial-tracking system may make an appearance during the holidays

mindmaze mask facial tracking vr holidays
While Bebop Sensors is serving up gloves to virtual and augmented reality headset makers that track hands and fingers, Mindmaze is working on technology to correctly track facial expressions. Simply called Mask, it sits between the user’s face and the virtual reality headset and will be compatible with the HTC Vive, the Oculus Rift, and Samsung’s Gear VR headsets when it possibly launches at the end of 2017.

Mask is comprised of eight, low-cost electrodes mounted within the foam padding of a VR headset. These electrodes detect the electrical impulses of the face, analyzes them via advanced machine learning, and replicates the facial movements on a virtual avatar. This tech supposedly detects expressions 20 to 30 milliseconds before they even physically appear on your face.

However, Mindmaze will not sell Mask directly to users. Instead, it will be sold to headset makers to implement into their own retail kits. Because Mask is a very low-cost solution, the cost of VR headset kits will not see a dramatic price increase.  The big cost on Mindmaze’s part was creating software that could understand the data generated by those eight electrodes.

According to Mindmaze CEO Tej Tadi, a computer receiving the eight streams of data registers the rise and fall of each signal like an EKG. Thus, MindMaze had to utilize its neurotech expertise to create an algorithm — a set of rules for calculating a problem or situation — to read the data and pull information to form a set of facial expressions.

“When I strapped on the headset to try Mask for myself, even without any calibration, a range of canned expressions that I made were quickly reflected on the face of an avatar that represented me in the virtual world,” reports Ben Lang from Road to VR. “When I smiled, it smiled. When I frowned, it frowned. It was easily the best calibration-free tech that I’ve seen of this sort.”

That is good news coming from a hands-on experience with a prototype. Lang said this model only supported 10 different facial expressions. On top of that, facial movements were sterile, meaning Mask did not render all the small little facial details that make your expressions unique. Eventually, the team will add more facial expressions along with low-key eye tracking to express basic eye movements.

That said, Mask is still in the prototype stage. The model Lang tested tended to render facial expressions incorrectly and had trouble picking up normal blinking. But that is where machine learning comes in: The algorithm will get smarter over time, making for a more “robust” experience as it understands the facial movements of each user.

While all of this sounds like a lot of computing power, Tadi said that the workload is low enough for the system to run on smartphone-based VR headsets. That is due to the electrode/algorithm combo, which is a stark contrast to the camera-based facial tracking approach on PC.

So when will Mask be ready? There is a good chance it will be integrated into VR headsets by the 2017 holiday season or shortly thereafter.

Emerging Tech

Awesome Tech You Can’t Buy Yet: Robo sidekicks, AC for your bed, and more

Check out our roundup of the best new crowdfunding projects and product announcements that hit the Web this week. You can't buy this stuff yet, but it sure is fun to gawk!
Movies & TV

Stay inside this summer with the best shows on Hulu, including 'Castle Rock'

It's often overwhelming to navigate Hulu's robust library of TV shows. To help, we've put together a list of the best shows on Hulu, whether you're into frenetic cartoons, intelligent dramas, or anything in between.
Movies & TV

'Prime'-time TV: Here are the best shows on Amazon Prime right now

Amazon Prime brings more perks than just free two-day shipping. Subscribers get access to a huge library of TV shows to stream at no extra cost. Here are our favorite TV shows currently available on Amazon Prime.
Movies & TV

The best shows on Netflix in August, from ‘Arrested Development’ to ‘Dark Tourist’

Looking for a new show to binge? Lucky for you, we've curated a list of the best shows on Netflix, whether you're a fan of outlandish anime, dramatic period pieces, or shows that leave you questioning what lies beyond.
Deals

For work or for play, these are the 5 best laptop deals for college students

Whether you're getting ready for a new school year, shopping for a special student, or just need a new computer, we've got you covered: These are the five best laptop deals going right now, from discounted MacBooks to an on-the-go gaming…
Computing

The browser-based Monero miner Coinhive generates around $250,000 each month

Despite a fall in cryptocurrency mining, the Coinhive Monero miner is still highly active, generating around $250,000 each month. Coinhive also contributes 1.18 percent of the total mining power behind the Monero blockchain.
Computing

Steam survey shows PC gamers are still mostly playing in 1080p and lower

Valve Software’s latest hardware and software survey for July 2reveals that 63.72 percent of Steam’s registered members still play games with a 1080p resolution. Even more, only 1.14 percent are playing at a 4K resolution.
Computing

The Andromeda botnet still lingers as nations struggle to clean infected PCs

A report by Fortinet suggests that although the FBI and Europe ended the Andromeda botnet’s reign in late 2017, there are still infected PCs. Cleaning up these PCs isn’t progressing at the same pace across various regions.
Photography

8 easy ways for you to transfer photos from an Android phone to a PC

If you haven't already, you should back up your photos to a computer. Here's how to transfer photos from an Android phone to a PC using third-party services and a wealth of storage devices.
Computing

Windows 10 can split and resize windows with ease. Here's how to do it

Windows 10 is a great desktop operating system, and its many window management features are part of the reason why. Here's how to divvy up windows using Snap Assist and other native tools.
Computing

Apple AR glasses will launch in 2020, says respected industry analyst

Apple AR glasses may be closer to reality than we thought. Here is everything we know so far about the augmented reality system, including the rumored specifications of Apple's Project Mirrorshades.
Social Media

How to use Adobe Spark Post to spice up your social media images

Images are proven to get more likes than plain text -- but only if those images are good. Adobe Spark post is an AI-powered design program for non-designers. Here's how to use it to take your social media feeds to the next level.
Mobile

Google One subscriptions offer more cloud storage for low prices, other perks

Can't get enough storage on Google Drive, Photos, or Gmail? Google One is the new way to boost your cloud storage. But it's not just about more space -- Google One comes with a loads of benefits.
Photography

A turn for the better: Loupedeck+ adds custom dials, more to Lightroom console

The Loupedeck+ improves on the original Lightroom console by adding welcome customization options and introducing support for Skylum Aurora HDR. What's even better is that it does this all at an even lower price.