YouTube has reportedly began rolling out a brand new AI-empowered translation function for its content material creators, one that may robotically redub a video’s contents into one among 9 languages with out altering the speaker’s voice.
In keeping with a publish from X person @levelsio, “YouTube will now auto dub movies in English, Spanish, Portuguese, German, French, Italian, Hindi, Indonesian and Japanese” and “will use AI to take the unique voice however change the language.”
The brand new function will arrive to creators’ channels within the coming weeks however will solely be obtainable to newly crafted content material, fairly than current movies, to start out.
I stated podcasts nevertheless it's taking place on YouTube first:
YouTube will now auto dub movies in English, Spanish, Portuguese, German, French, Italian, Hindi, Indonesian and Japanese
The dubs will use AI to take the unique voice however change the language (like @lexfridman's podcast… https://t.co/1awdnDF8lk pic.twitter.com/KhelUxtLZL
— @levelsio (@levelsio) November 21, 2024
The auto-dubbing function was first introduced in September on the firm’s “Made on YouTube” occasion. On the time, a YouTube spokesperson defined, “within the coming months we’ll be increasing our AI powered dubbing instrument, previously referred to as ‘Aloud,’ to lots of of hundreds of creators,” in addition to including further languages past the English, Spanish, and Portuguese obtainable for beta customers. “As soon as creators have entry, their movies might be robotically dubbed upon add, with the flexibility to choose out in the event that they so select,” the spokesperson defined.
YouTube isn’t alone in its AI translation efforts. In 2023, Spotify introduced an analogous function that reportedly creates “a extra genuine listening expertise that sounds extra private and pure than conventional dubbing.”
Upon its launch, customers had been restricted to translations between English and Spanish, although French and German have since been added. Meta has additionally lately launched a “common language translator” that it calls SeamlessM4T and is able to swapping between any of greater than 100 languages. Its skills additionally prolong to text-to-voice and text-to-text translations.
These new translation AIs might assist content material creators of all sizes attain new worldwide audiences that they in any other case can be unable to. After all, the expertise might additionally backfire resulting from its tendency to hallucinate info and responses. If it mistranslated your content material right into a language you don’t already converse, it’d be laborious know concerning the mistake earlier than viewer complaints began rolling in.
