Skip to main content

Facebook wants to make your virtual self appear as real as possible in VR


Facebook wants to transport your physical self into the virtual world by allowing you to create photorealistic avatars for virtual reality headsets. The technology was unveiled by Facebook chief technology officer Mike Schroepfer during the second day of the company’s developer-centric F8 conference in Silicon Valley, California.

The company has made progress over the years to evolve its avatar creation technology to make digital representations more lifelike and emotive. Facebook originally represented avatars as a simple blue face, but the technology eventually allowed users to personalize their virtual selves with more details and lifelike features. The result is still a cartoon-like representation of an individual, and it is not dissimilar to Snap’s personalized Bitmoji or Samsung’s AR emoji. Creating a photorealistic avatar is a logical next step for Facebook’s VR journey, as the company hopes that advancing technologies will help blur the borders between the real and virtual worlds.

Facebook didn’t detail much about its work with photorealistic avatars. We learned from demos that the company is using motion-capture technology to map facial images from photographs to capture various points on a user’s face. By carefully mapping a user’s face and facial characteristics, Facebook can synchronize facial movements and expressions in real life with the photorealistic avatar in VR.

In late 2016, Facebook began experimenting with bringing more emotions into its VR avatar experience, according to Techristic. The company used body tracking to allow users to show that they were racing their fists in the air, demonstrating an angry expression, or a shoulder shrug. Photorealistic avatars with face tracking could allow Facebook to inject even more emotions into our digital personas in the virtual world. During his demo, Schroepfer showed that when an Oculus employee with a Rift headset spoke, his avatar’s mouth moved in unison with his speech.

Still, we don’t know when photorealistic avatars will arrive for consumers. New hardware may also be required, according to Upload VR, that will allow Oculus to track eye movements, which could allow our avatars to blink when we do. Similarly, Midmaze has been working on its sensor mask, which is designed to sit between your face and a VR headset, like the Oculus Rift, to track your facial movements and display them in real time in the virtual world.

Photorealistic avatars could help to further define and transform the virtual and augmented reality experiences that we have today, allowing users from remote locations to experience games and movies together as if they’re in the same room. If you look over and see a photorealistic image of your friend enjoying the same experience as you in the VR space, it would make virtual experiences feel more convincing.

Chuong Nguyen
Silicon Valley-based technology reporter and Giants baseball fan who splits his time between Northern California and Southern…
This futuristic haptic vest should make virtual reality feel more realistic
actronika haptic vest skinetic vr more realistic virtual reality

Actronika, a startup company known for its HD haptics technology has a futuristic new product. Expected to be on display at the Consumer Electronics Show (CES) in January 2022 is Skinetic, a haptic vest that should make virtual reality experiences feel a lot more realistic.

Skinetic works much as you'd expect. The wearable vest makes VR feel more immersive by bringing life-like sensations and touch-like experiences to areas of the body like the chest when paired with a compatible headset. As reported by Business Wire, the technology "works with 20 patented vibrotactile voice-coil motors, capable of generating a wide range of vibrations that cover 100% of human vibrotactile perception."

Read more
The future of immersive VR? ‘Chemical haptics’ applied to your skin
A woman in a VR headset holding her hands out.

VR headsets are currently able to simulate realistic environments to trick your brain into thinking it's actually there. But researchers at the University of Chicago are going a step further by simulating physical sensations using chemicals applied to your skin.

The implementation seems basic, but the results are fascinating and could provide a way to make VR even more immersive.

Read more
Pimax’s 12K QLED VR headset wants to take virtual reality to the next level
Pimax's new 12k QLED VR headset.

It seems that virtual reality may be about to become even more real than ever before -- all thanks to a new VR headset. Pimax, a company that manufactures VR equipment, announced the upcoming release of a new 12K QLED VR headset that will feature technologies such as eye tracking, full-body tracking, and refresh rates of up to 200Hz. The headset, dubbed Pimax Reality 12K QLED, is part of the company's venture into the metaverse and a step toward bringing true realism to using VR.

During today's Pimax Frontier event, the company's representatives talked at length about the goals behind the product -- naturalness, self-awareness, and freedom. Pimax wants to bring these qualities into virtual reality and the metaverse, allowing people from all over the world to interact and explore virtual worlds together. While VR technology already allows for some of that to happen, Pimax wants to take it to the next level with its new invention -- the Reality 12K QLED VR headset.

Read more