Skip to main content

Tongue-tracking in VR has arrived

Meta Quest Pro face-tracking demo shows a green-skinned flower person with surprised expression.
Meta

A new face-tracking extension lets Meta Quest Pro users poke their tongues out at you in a wordless statement of their feelings or even blow a raspberry.

How better to express a sweltering day or an exhausting workout? This could be the technology that revolutionizes VR in 2024. Am I being too tongue-in-cheek?

Honestly, it’s a nice option to add to the Quest Pro’s current hand-, eye-, and face-tracking. Meta’s most expensive VR headset allows quite a range of expression already. I can gesture with my hands, blink, wink, move my eyes, and open and close my mouth in various positions. You can’t do that with the new Quest 3.

Tongues were wagging when @0GUzzuqPjUVpY57 broke the news on X (formerly Twitter), along with providing a video demonstration showing two animated avatars alongside a Quest Pro user controlling the action.

Rleased new #VRCFT modules for new #QuestPro v2 facial tracking with support for tongue.

Supports (Air)Link and VD via VDX (when VD adds support) using the ALXR Local module and ALXR clients with the ALXR Remote module

You can download from here https://t.co/F37U2zA8is#VRChat pic.twitter.com/sUmfLaXVpN

— コレヂャン (@0GUzzuqPjUVpY57) December 14, 2023

Since the Quest Pro includes face-tracking, it seems like Meta should have included tongue-tracking, but perhaps felt it would be controversial. HTC makes a Face Tracker accessory to synchronize mouth and tongue movements with an avatar, and it’s compatible with many VR headsets.

Of course, you shouldn’t add more weight and extra expense if you can avoid it. With the new ALXR module from korejan on Github, you can emote with your tongue in compatible PC VR apps and games like VRChat.

The developer shows off Quest Pro tongue tracking extension.
A developer shows off the Quest Pro tongue-tracking extension. korejan

The extension reportedly works with Meta’s AirLink and Virtual Desktop via an app called VDX. You can install a tongue-tracking extension as a local module for ALXR or as a remote module if you use ALVR streaming.

If you’re unfamiliar with VRChat and ALXR, you’ll need to do a bit of reading to understand how to use the tongue-tracking extension. In the tweet thread, there’s a link to Reddit for more details about how to get started.

Note that installing this extension won’t add tongues to your Meta avatar and can’t help with the Quest version of VRChat. Also, few games and apps support face-tracking. It’s probably only worth the effort if you are already enjoying face- or body-tracking in VRChat or another social VR app on your PC.

Alan Truly
Alan is a Computing Writer living in Nova Scotia, Canada. A tech-enthusiast since his youth, Alan stays current on what is…
VisionOS 2 is arriving way ahead of schedule
A spatial video displayed on the Apple Vision Pro.

It's only been four months since Apple released the Vision Pro, but it's already working on the the second version of the VisionOS operating system powering the headset. At WWDC 2024, Apple announced a long list of updates coming to VisionOS 2 that will impact apps, the virtual desktop, and even gestures.
Train mode
One of the key updates is the new Train Mode. The Vision Pro caught some flak after launch when influencers took the headset out on busy streets and subways. With VisionOS 2, Apple is adding train support to the headset's Travel Mode, which will automatically turn on when the headset's sensors detect that you're on a train or plane.
Spatial photos and a new camera lens

Elsewhere, Apple updated the Photos app in VisionOS 2. A big feature coming to the headset is the ability to turn 2D images into spatial photos. Apple says the OS does this with machine learning, allowing you to see a spatial photo even if you didn't take it with a spatial camera. You can share these photos through SharePlay as well. Apple says VisionOS 2 allows you to look at spatial photos and videos together through SharePlay.

Read more
A free update just made the Quest 3 way better
First Encounter is the perfect introduction to mixed reality on Quest 3.

The Meta Quest 3 was already one of the best VR headsets for mixed reality, while keeping costs affordable. Soon Quest 3 owners will see a big upgrade that removes the distortion that sometimes broke the immersive feeling, simply by updating their headsets.

Meta has announced the v66 software update that, among many things, comes with improvements to the Quest 3's passthrough cameras. Since the Quest 3’s passthrough cameras are located a couple of inches in front of your eyes, the headset must adjust the image to match your true perspective. Otherwise, everything would seem slightly zoomed in. Distant objects are easy, but nearby hands hide a portion of the background, presenting a challenge.

Read more
The creator of the Oculus Rift is working on a mysterious new VR headset
Oculus Rift CV1

If you don’t recognize the name Oculus, it’s the company that kicked off the modern VR era. Facebook (now Meta) was so impressed by the Oculus Rift developer kit and sudden revival of interest in VR that it acquired the company in 2014. Now Oculus founder Palmer Luckey is back with plans for another VR headset.

While Luckey shared no specific details or even the name of the device, the announcement will no doubt create a buzz in the industry. The X (formerly Twitter) post came as a reply to VR analyst Brad Lynch’s reaction to Luckey’s X post about the ModRetro Chromatic, an upgraded reinterpretation of the wildly popular GameBoy Color handheld console.

Read more