Mindmaze's VR facial-tracking system may make an appearance during the holidays

mindmaze mask facial tracking vr holidays
While Bebop Sensors is serving up gloves to virtual and augmented reality headset makers that track hands and fingers, Mindmaze is working on technology to correctly track facial expressions. Simply called Mask, it sits between the user’s face and the virtual reality headset and will be compatible with the HTC Vive, the Oculus Rift, and Samsung’s Gear VR headsets when it possibly launches at the end of 2017.

Mask is comprised of eight, low-cost electrodes mounted within the foam padding of a VR headset. These electrodes detect the electrical impulses of the face, analyzes them via advanced machine learning, and replicates the facial movements on a virtual avatar. This tech supposedly detects expressions 20 to 30 milliseconds before they even physically appear on your face.

However, Mindmaze will not sell Mask directly to users. Instead, it will be sold to headset makers to implement into their own retail kits. Because Mask is a very low-cost solution, the cost of VR headset kits will not see a dramatic price increase.  The big cost on Mindmaze’s part was creating software that could understand the data generated by those eight electrodes.

According to Mindmaze CEO Tej Tadi, a computer receiving the eight streams of data registers the rise and fall of each signal like an EKG. Thus, MindMaze had to utilize its neurotech expertise to create an algorithm — a set of rules for calculating a problem or situation — to read the data and pull information to form a set of facial expressions.

“When I strapped on the headset to try Mask for myself, even without any calibration, a range of canned expressions that I made were quickly reflected on the face of an avatar that represented me in the virtual world,” reports Ben Lang from Road to VR. “When I smiled, it smiled. When I frowned, it frowned. It was easily the best calibration-free tech that I’ve seen of this sort.”

That is good news coming from a hands-on experience with a prototype. Lang said this model only supported 10 different facial expressions. On top of that, facial movements were sterile, meaning Mask did not render all the small little facial details that make your expressions unique. Eventually, the team will add more facial expressions along with low-key eye tracking to express basic eye movements.

That said, Mask is still in the prototype stage. The model Lang tested tended to render facial expressions incorrectly and had trouble picking up normal blinking. But that is where machine learning comes in: The algorithm will get smarter over time, making for a more “robust” experience as it understands the facial movements of each user.

While all of this sounds like a lot of computing power, Tadi said that the workload is low enough for the system to run on smartphone-based VR headsets. That is due to the electrode/algorithm combo, which is a stark contrast to the camera-based facial tracking approach on PC.

So when will Mask be ready? There is a good chance it will be integrated into VR headsets by the 2017 holiday season or shortly thereafter.

Movies & TV

How Avengers: Infinity War’s Oscar-nominated VFX team made Thanos a movie star

The purple-skinned Thanos proved to be a breakout character in Avengers: Infinity War, thanks to the work of actor Josh Brolin and visual effects studios Digital Domain and Weta. Here's how they brought him to life and earned the film an…
Movies & TV

'Prime'-time TV: Here are the best shows on Amazon Prime right now

There's more to Amazon Prime than free two-day shipping, including access to a number of phenomenal shows at no extra cost. To make the sifting easier, here are our favorite shows currently streaming on Amazon Prime.
Movies & TV

The best shows on Netflix, from 'Haunting of Hill House’ to ‘Norsemen’

Looking for a new show to binge? Lucky for you, we've curated a list of the best shows on Netflix, whether you're a fan of outlandish anime, dramatic period pieces, or shows that leave you questioning what lies beyond.
Virtual Reality

Getting into VR is spendy. Which headset is truly worth your hard-earned cash?

Virtual reality has finally gone mainstream, but how do you find the best VR headset for you? Check out a few of our favorites, whether you want the best of the best or a budget alternative for your mobile device.
Computing

RTX might be expensive, but the 16 series could have the best Nvidia Turing GPUs

Set to debut at a step below the RTX 2060 on the price and performance spectrums, the GTX 1660 Ti and its other 16-series brethren could be Nvidia's killer mid-range cards of 2019 — especially with Tensor Core-powered DLSS.
Computing

Ryzen 3000 chips will be powerful, and they might be launched as early as July

AMD's upcoming Ryzen 3000 generation of CPUs could be the most powerful processors we've ever seen, with higher core counts, greater clock speeds, and competitive pricing. Here's what we know so far, based on both leaks and the recent…
Product Review

Razer just made our favorite gaming laptop even more powerful than before

The Razer Blade, our favorite gaming laptop, is now more powerful than ever before. That’s thanks to the new Nvidia RTX graphics cards inside. Do they help Razer retain its edge over the competition?
Computing

With no plans for merging operating systems, Apple opts to combine apps instead

Apple is working on combining all of the the apps it offers to iPhone, iPad, and Mac users by 2021. App developers will soon be able to build and submit one version of their apps to be used by Apple product users.
Gaming

These are the coolest games you can play on your Google Chrome browser right now

Not only is Google Chrome a fantastic web browser, it's also a versatile gaming platform that you can access from just about anywhere. Here are a few of our favorite titles for the platform.
Computing

Amazon takes $200 off Apple’s latest 13-inch MacBook Air with retina display

Amazon is taking $200 off Apple's latest MacBook Air. This MacBook Air has 13-inch retina display, a built-in FaceTime HD camera, and that classic lightweight wedge shape the Air is loved and known for.
Deals

Samsung drops a solid $100 discount on the Chromebook Pro

If you're in the market for a new laptop, but can't afford to drop $1,000 on one of the best models out there, Chromebooks are an excellent option. Right now, Samsung is offering $100 off the Samsung Chromebook Pro.
Computing

Lost your router? Here's how to find its IP address to help track it down

Changing the login information for your router isn't always easy, that's why so many have that little card on the back. But in order to use it, you need to know where to go. Here's how to find the IP address of your router.
Computing

Between Intel and AMD, these are the best gaming CPUs at every price

What are the best processors for gaming you can buy? You don't need to spend a fortune to get an amazing gaming CPU and now that AMD is competitive again, there are more choices than ever.
Computing

Our favorite Chrome themes add some much-needed pizzazz to your boring browser

Sometimes you just want Chrome to show a little personality and ditch the grayscale for something a little more lively. Lucky for you, we've sorted through the Chrome Web Store to find best Chrome themes available.