YouTube Tests New AI Lip Sync Feature
YouTube is testing a new feature, AI lip sync, for videos across different languages, following the launch of AI dubbing in December.
The platform demonstrated the feature with a 15-second demo video, showing an Italian clip automatically translated into English, with the speaker's lip movements perfectly matching the dubbed voice.
The feature uses a custom tech stack that "modifies the pixels on the screen to match the translated speech," according to Buddhika Kottahachchi, YouTube's Head of Product for Dubbing.
With upcoming lip sync technology, translated videos will now visually match the speaker's lips with the newly dubbed language, making your content more accessible and engaging for global audiences.
This new feature is part of YouTube's expansion of AI-powered video tools, including Multi-Language Audio tracks.
Author's summary: YouTube tests AI lip sync feature for global creators.