The Meta Quest Pro has received an unexpected update – its face tracking can now follow your tongue movements.
One of the main hardware upgrades featured in the Meta Quest Pro is face and eye tracking. Thanks to inbuilt cameras, the headset can track your facial features and translate your real-life movements onto a virtual avatar. Because it’s perfectly mimicking your mouth flaps, nose twitches, and eye movements, the digital model can feel almost as alive as a real human at times – at least in my experience with the tech.
Unfortunately, this immersion can break down at points, as the tracking isn’t always perfect, with one fault many users noticed being that it can’t track your tongue. So if you wanted to tease one of your friends by sticking it out at them, or lick a virtual ice cream cone you couldn’t – until now.
Meta has released a new version of the face-tracking extension in its v60 SDK, which finally includes support for tongue tracking. Interestingly this support hasn’t yet been added to Meta avatars – so you might not see tongue-tracking in apps like Horizon Worlds – but it has already started to be added to third-party apps by developers.
Rleased new #VRCFT modules for new #QuestPro v2 facial tracking with support for tongue.Supports (Air)Link and VD via VDX (when VD adds support) using the ALXR Local module and ALXR clients with the ALXR Remote moduleYou can download from here https://t.co/F37U2zA8is#VRChat pic.twitter.com/sUmfLaXVpNDecember 14, 2023
This includes developer Korejan (via UploadVR) who develops a VR Face Tracking module for ALXR – an alternative to apps like Virtual Desktop and Quest Link, which help you connect your headset to a PC. Korejan posted a clip of how it works on X (formerly Twitter).
All the gear and nothing to do with it
Meta upgrading its tech’s capabilities is never a bad thing, and we should see tongue-tracking rolling out to more apps soonish – especially once Meta’s own avatar SDK gets support for the feature. But this isn’t the upgrade the feature needs. Instead, face tracking needs to get into more people’s hands, and there needs to be more software that uses it.
Before the Meta Quest 3 was released I seldom used mixed reality – the only times I did were as part of any reviews or tests I did for my job. That’s changed a lot in the past few months, and I’d go as far as to say that mixed reality is sometimes my preferred way to play if there’s a choice between VR and MR.
One reason is that the Quest 3 offers significantly higher quality passthrough than the Quest Pro – it’s still not perfect, but the colors are more accurate, and the feed isn’t ruined by graininess. The other, far more important reason is that the platform is now brimming with software that offers mixed reality support, rather than only a few niche apps featuring mixed reality as an aside to the main VR experience.