Meta AI to Get Lip-synced Translations and Celebrity Voice Options Like Judi Dench and John Cena

| Updated on September 27, 2024
Meta AI Translations

At the Meta Connect 2024 Developer’s Conference, the company announced that the Meta AI can now respond to questions out loud across its platforms, such as Instagram, Messenger, WhatsApp, and Facebook.

To customize the response voice, you can choose from several voice options, including the AI clones of celebrities that Meta appointed. These celebrities include Awkwafina, Dame Judi Dench, John Cena, Keegan-Michael Key, and Kristen Bell.

It is said that the new Meta AI feature is not similar to OpenAI’s Advanced Voice Mode for ChatGPT and thus can’t pick up on emotional nuances in a person’s voice.

However, it’s pretty similar to the recently launched Gemini Live, which transcribes the speech and then uses synthetic voice and AI to read it aloud.

The Wall Street Journal reported that the company paid millions to resemble AI voices to sound like celebrities. Meta is supposedly relying on high-profile talent to make waves in the industry, but the impact solely depends on the users’ reception of it.

Reports say that in other updates, the assistant can analyze the images due to an upgrade to the AI models that power those capabilities. For example, you can share a picture of any object and ask the AI to name it or upload a photo of a dish and seek step-by-step guidance.

However, the drawback is that it is only available in the selected regions, and there is a high probability of getting wrong answers now and then. So, users must prepare themselves.

At the conference, Meta also revealed that it’s testing a Meta AI translation tool to translate voices in Instagram reels. The tool will dub the creator’s speech and auto-lip-sync it by stimulating the voice from other languages.

To watch Meta Connect 2024 and learn more about the event, click here!

Akriti Rana

Tech Journalist