Google wants to show off your face a bit better in VR and mixed reality

google research daydream labs creating realistic facial representation in vr and mixed reality
Being around someone using a virtual reality system can be an eerie experience. The typical VR headset fully hides the user’s eyes, making it hard to follow along with the action and interact with anyone using a system. When you’re inside a VR experience with another user, today’s systems don’t pass along facial expressions and so the social aspects and overall experience are hindered.

Google Research is looking to resolve that problem with a new project it is working on with Daydream Labs. By combining 3D computer vision, machine learning, and advanced rendering methods, the project aims to create more of a realistic solution that can convey a user’s identity, focus, and face.

Basically, the solution uses a VR headset modified by SensoMotoric Instruments that includes a video camera and eye-tracking components to show a person’s facial variations while blinking and looking in certain directions. This information is overlaid inside the mixed reality environment using green screen technology, basically making it look like the VR headset is a scuba mask — the translucent effect is deliberate and intended to avoid the “uncanny valley” effect that can make avatars and robots come across as unnatural.

From there, this modified user representation is worked into VR and mixed reality environments. The experienced is completed by showing a more realistic and expressive view of the user including their facial expressions and the ability to see where the user is looking.

While the technology does nothing for the real-world headset user, it dramatically improves the experience inside a VR or mixed reality world. Users can interact more realistically, using facial expressions and nonverbal cues to greatly enhance the communication and social interaction possible in VR environments. While the gaming applications are obvious, more mundane and practical solutions like VR video conferencing would also be greatly improved.

There is no word yet on when this technology will make it to shipping products. Anyone who wants to delve into the details can visit the Google Research blog to learn more about how the pieces connect to create a much more realistic virtual representation of the VR user.

Emerging Tech

Awesome Tech You Can’t Buy Yet: Robo sidekicks, AC for your bed, and more

Check out our roundup of the best new crowdfunding projects and product announcements that hit the Web this week. You can't buy this stuff yet, but it sure is fun to gawk!
Computing

Apple AR glasses will launch in 2020, says respected industry analyst

Apple AR glasses may be closer to reality than we thought. Here is everything we know so far about the augmented reality system, including the rumored specifications of Apple's Project Mirrorshades.
Photography

Photo FOMO: Leica Elpro turns plain lenses into macro, Fujifilm Fest returns

In this week's photo industry news, Leica launches a way to turn plain lenses into macro lenses. Artificial Intelligence keeps growing with new uses with Getty Images and the Samsung Galaxy Note 9 camera.
Virtual Reality

Magic Leap One no longer asks for a leap of imagination. Here's how it works

The Magic Leap One AR headset is now available for a rather hefty price. Here's everything you need to know about the device including the price, where it can be purchased, the hardware powering Magic Leap's goggles and more.
Computing

Nvidia teases new GeForce RTX 2080 launch at Gamescom next week

Gamers will have something exciting to look forward to next week when Gamescom starts. Nvidia posted a teaser video to YouTube containing hints that it could use the venue to announce the new GeForce RTX 2080 graphics chip.
Computing

Nvidia introduces its eighth-generation ‘Turing’ design, but not in gaming cards

Nvidia revealed its new graphics chip design called “Turing” during SIGGRAPH 2018. Rumored to be the foundation of Nvidia’s next family of GeForce cards, the company instead showcased Turing in Quadro RTX-branded cards for pros.
Computing

The browser-based Monero miner Coinhive generates around $250,000 each month

Despite a fall in cryptocurrency mining, the Coinhive Monero miner is still highly active, generating around $250,000 each month. Coinhive also contributes 1.18 percent of the total mining power behind the Monero blockchain.
Home Theater

HDMI 2.0b is a whole lot more than just a connection to your TV

HDMI 2.0b is the backbone for many of the latest updates in 4K UHD technology. And while a new cable standard can often involve a bunch of changes for consumers, that is not the case this time around.
Mobile

Want to watch Netflix in bed or browse the web? We have a tablet for everyone

There’s so much choice when shopping for a new tablet that it can be hard to pick the right one. From iPads to Android, these are our picks for the best tablets you can buy right now whatever your budget.
Deals

For work or for play, these are the 5 best laptop deals for college students

Whether you're getting ready for a new school year, shopping for a special student, or just need a new computer, we've got you covered: These are the five best laptop deals going right now, from discounted MacBooks to an on-the-go gaming…
Computing

Steam survey shows PC gamers are still mostly playing in 1080p and lower

Valve Software’s latest hardware and software survey for July 2reveals that 63.72 percent of Steam’s registered members still play games with a 1080p resolution. Even more, only 1.14 percent are playing at a 4K resolution.
Computing

The Andromeda botnet still lingers as nations struggle to clean infected PCs

A report by Fortinet suggests that although the FBI and Europe ended the Andromeda botnet’s reign in late 2017, there are still infected PCs. Cleaning up these PCs isn’t progressing at the same pace across various regions.
Photography

8 easy ways for you to transfer photos from an Android phone to a PC

If you haven't already, you should back up your photos to a computer. Here's how to transfer photos from an Android phone to a PC using third-party services and a wealth of storage devices.
Computing

Windows 10 can split and resize windows with ease. Here's how to do it

Windows 10 is a great desktop operating system, and its many window management features are part of the reason why. Here's how to divvy up windows using Snap Assist and other native tools.