YouTube Introduces AI-Powered Dubbing Feature For Videos (image-pixabay)

The Google-owned video streaming platform YouTube has now expanded its auto dubbing feature to include knowledge and information-focused content. The feature which was originally introduced at VidCon last year, utilises AI technology developed by Aloud.

Auto dubbing has the capacity to automatically transcribe and translate YouTube videos between English and other languages. This will enable the users to reach and engage viewers across language barriers.

Read also: A Sundar Pichai-Elon Musk Exchange After Google’s Willow Quantum Chip Announcement

YouTube detailed the expanded availability of its AI-powered auto-dubbing feature in a blog post. The video streaming platform says that hundreds of thousands of YouTube channels that are part of the YouTube Partner Program which focuses on knowledge and information will be able to take advantage of this feature.

The creators who now take the videos in English can get them dubbed into French, German, Hindi, Indonesian, Italian, Japanese, Portuguese and Spanish. And if the videos are in any of the aforementioned languages, then it will get dubbed into English. Videos that were dubbed using the feature will appear with auto-dubbed labels. Meanwhile, the users can choose to listen to the original audio using the track selector.

In order to use the feature, the creators just need to upload their videos and YouTube will automatically detect its language and dub it in other supported languages. All the dubbed videos can be viewed in the YouTube Studios in the Language section.

However, the creators will have control over the dub, and they can choose to unpublish or delete dubs that are not up to their liking, as per the platform.

And the company beforehand stated that there might be cases when the translation might stray a bit far or the dubbed voice does not match the original speaker.

Read also: Google Introduces Willow – State-Of-The-Art Quantum Chip

The company has also added an option for the users to submit feedback for the feature’s improvement. “Now, it’s important to remember that this technology is still pretty new, and it won’t always be perfect. We are working hard to make it as accurate as possible, but there might be times when the translation isn’t quite right or the dubbed voice doesn’t accurately represent the original speaker,” the company said.