YouTube Plans To Let AI Dub Your Videos In Other Languages

YouTube Plans To Let AI Dub Your Videos In Other Languages

Video dubbing isn’t new – but it’s so far only existed in film or online streaming services like Netflix. However, YouTube wants to automate the entire process by introducing AI into the mix – letting users dub their videos in any languages. The Google subsidiary is bringing the team from Aloud – one of the teams under Google’s Area 120 incubator program (where experimental ideas are developed and ‘graduated’ into Google services).

The way it works is fairly straightforward: Aloud will first generate a transcription of a video and hand it off to the user to make changes if needed. Then, it’ll handle the translation and AI will generate the dubbed audio that syncs with the original clip. In a statement to The Verge, YouTube VP of Product Management Amjad Hanif said Aloud currently supports a few languages (which includes Spanish, Hindi, Indonesian and Portuguese based on the website), with “more to come”.

Videos with dubs is already available, including this clip from Amoeba Sisters channel that currently contains English and Spanish audio tracks. You can switch between native audio and dubs by clicking on the Settings menu and hear for yourself.

The dub as it is right now isn’t the best when it comes to audio quality, though YouTube says that is in the works for further improvements which will make the dub “sound like the creator’s voice, with more expression, and lip sync,”. The timeline is currently set for 2024 as far as these features go.

Pokdepinion: This should save a lot of work for small-time creators that may not have the resources to hire voice talents.