Recent data mining findings suggest that Meta’s long-standing research on Codec Avatars could be implemented on standalone headsets sooner than expected, with Messenger support aimed at competing with Apple.

Codec Avatars are one of the most promising technologies expected to emerge in the VR/AR space in the coming years, or perhaps even decades. These avatars are highly realistic virtual representations of people, distinguishing themselves from the more cartoony avatars currently used by Meta. They achieve a level of hyperrealism that successfully overcomes the uncanny valley, a challenge that has plagued similar technologies in the past.

Meta has been working on this technology for several years. Until recently, we only saw quick prototype videos recorded under perfect conditions using expensive camera rigs. However, this may change soon, as Meta is currently testing Codec Avatars on a standalone device.

Meta has been testing this technology on standalone devices for some time now. One year ago, Andrew Bosworth, Meta’s CTO, mentioned in his Instagram AMA that Meta is making “progress” on Codec Avatars for standalone headsets, but they are still “years away” from being fully realized.

Now, VR enthusiast Luna has discovered strings in the v68 PTC version of Meta Quest referencing Codec Avatars. These findings suggest that Meta is working on supporting Codec Avatars for Messenger video calls.

When will Codec Avatars be available on standalone headsets?

According to Meta’s leaked roadmap from The Verge last year, Codec Avatars will be a major feature on Meta’s upcoming Quest Pro headset, codenamed “La Jolla.” This report also provided details about the Quest 3 and Quest 3s.

Quest Pro 2 is set to be released in 2027, according to recent leaks from a highly reliable source, which also discuss the planned release dates for Quest 4 and Quest 4s.

Quest Pro 2 will, of course, feature eye and face tracking, just like its predecessor. This tracking is crucial for Codec Avatars, so we won’t see them on headsets like Quest 3… or will we?

Meta has demonstrated a version of Codec Avatars that doesn’t require face or eye tracking. Instead, facial movements are estimated from audio captured by the headset microphone. While this method isn’t ideal for achieving rich facial expressions, it could serve as a decent interim solution for existing Quest 3 and Quest 2 users.

In 2021, Meta demonstrated an efficient method for decoding Codec Avatars on Quest 2. This method allowed for rendering one Codec Avatar at 72 FPS, three at 63 FPS, and five at around 43 FPS. Given that Quest 3 is significantly more powerful than Quest 2, we can expect even better performance.

While the prospect of Codec Avatars on standalone headsets is exciting, it’s important not to expect the same quality as those seen in the Lex Fridman interview with Mark Zuckerberg. The avatars on standalone devices might end up resembling more closely those from Meta’s Codec Avatar Demo, which used a smartphone for a quick face scan.