Skip to main content

Tongue-tracking in VR has arrived

Meta Quest Pro face-tracking demo shows a green-skinned flower person with surprised expression.
Meta

A new face-tracking extension lets Meta Quest Pro users poke their tongues out at you in a wordless statement of their feelings or even blow a raspberry.

How better to express a sweltering day or an exhausting workout? This could be the technology that revolutionizes VR in 2024. Am I being too tongue-in-cheek?

Honestly, it’s a nice option to add to the Quest Pro’s current hand-, eye-, and face-tracking. Meta’s most expensive VR headset allows quite a range of expression already. I can gesture with my hands, blink, wink, move my eyes, and open and close my mouth in various positions. You can’t do that with the new Quest 3.

Tongues were wagging when @0GUzzuqPjUVpY57 broke the news on X (formerly Twitter), along with providing a video demonstration showing two animated avatars alongside a Quest Pro user controlling the action.

Rleased new #VRCFT modules for new #QuestPro v2 facial tracking with support for tongue.

Supports (Air)Link and VD via VDX (when VD adds support) using the ALXR Local module and ALXR clients with the ALXR Remote module

You can download from here https://t.co/F37U2zA8is#VRChat pic.twitter.com/sUmfLaXVpN

— コレヂャン (@0GUzzuqPjUVpY57) December 14, 2023

Since the Quest Pro includes face-tracking, it seems like Meta should have included tongue-tracking, but perhaps felt it would be controversial. HTC makes a Face Tracker accessory to synchronize mouth and tongue movements with an avatar, and it’s compatible with many VR headsets.

Of course, you shouldn’t add more weight and extra expense if you can avoid it. With the new ALXR module from korejan on Github, you can emote with your tongue in compatible PC VR apps and games like VRChat.

The developer shows off Quest Pro tongue tracking extension.
A developer shows off the Quest Pro tongue-tracking extension. korejan

The extension reportedly works with Meta’s AirLink and Virtual Desktop via an app called VDX. You can install a tongue-tracking extension as a local module for ALXR or as a remote module if you use ALVR streaming.

If you’re unfamiliar with VRChat and ALXR, you’ll need to do a bit of reading to understand how to use the tongue-tracking extension. In the tweet thread, there’s a link to Reddit for more details about how to get started.

Note that installing this extension won’t add tongues to your Meta avatar and can’t help with the Quest version of VRChat. Also, few games and apps support face-tracking. It’s probably only worth the effort if you are already enjoying face- or body-tracking in VRChat or another social VR app on your PC.

Editors' Recommendations

Alan Truly
Computing Writer
Alan is a Computing Writer living in Nova Scotia, Canada. A tech-enthusiast since his youth, Alan stays current on what is…
Can the Vision Pro play VR games?
A person wearing the Apple Vision Pro overlaid on a screenshot of Half-Life: Alyx.

A person wearing the Apple Vision Pro overlaid on a screenshot of Half-Life: Alyx. Apple/Valve

The Apple Vision Pro is best described as a spatial computer, but it's also a VR headset with great mixed-reality capabilities.

Read more
Does the Vision Pro require a computer or phone?
Apple Vision Pro being worn by a person while using a keyboard.

The Vision Pro is an exciting new headset that Apple calls a spatial computer, but you might be wondering if the computing really happens on this compact device or if it needs to connect to a computer or a phone for processing. That's a fair question to ask since many AR and VR devices require a separate device for power and computing.
The Vision Pro and the Apple ecosystem
You can still FaceTime friends, family, and co-workers in the Vision Pro. Apple / Apple

So, how does the Apple Vision Pro work, and what's needed to use it as a spatial computer? The good news is this $3,500 device is complete right out of the box. You don't need to buy an iPhone or a Mac to use it. It has an M2 processor inside, uses hand gestures for controls, and the entire operating system is self-contained.

Read more
Yet another serious competitor to the Vision Pro takes shape
A divided image shows an Apple Vision Pro and Meta Quest 3.

Profile views of the Apple Vision Pro (top) and Meta Quest Pro Digital Trends

Following rumors of a new extended reality (XR) headset, LG CEO Cho Joo-wan made the news official, confirming it could arrive as early as 2025.

Read more