Deepdub is launching its platform that uses AI to insert voices into videos so that entertainment companies can localize content in multiple languages with the click of a button.
Israel-based company Tel Aviv uses AI and in-depth learning to extend and sustain audience experiences for entertainment companies at a time when streaming is exploding around the world.
For decades, the entertainment industry has sought to find global markets by duplicating voices to movies, games, commercials, and TV shows. But it is a long and expensive process that leads to abstract audience experiences across forms and languages.
Market analysis firm Statista found that 59% of US adults said they would rather watch foreign language films introduced to English than view the original feature with subtitles.
Above: Deepdub Team
Image credit: Deepdub
Founded in 2019, Deepdub aims to close this gap by leading better audience experiences across film, TV, game, and advertising. Deepdub tackles the problem by lying in novel accents while retaining original actor voices across languages. To do this, Deepdub uses synthetic voices based on samples from the actors in one language to create foreign words using that actor’s synthesized voice, even if the actor never put those words in. the other language.
The technology integrates into the post-production process to provide faster turnaround time at a fraction of the cost of traditional black services.
Deepdub chief marketing officer Oz Krakowski said in an interview with VentureBeat that the company felt its AI and deep learning technology could benefit the entire entertainment industry, saving a lot of time for any type of content-based screen.
“We enable the entertainment industry to produce content locally in multiple languages at the click of a button,” said Krakowski. “And we do it all while maintaining and expanding the original entertainment experience.”
He said the company is in talks with a group of major entertainment companies, from studios to streaming companies.
“The idea is to integrate into the post-production process of content owners and take care of all the local needs,” Krakowski said. “The importance of managing quality and experience in the native language is now greater than ever. ”
Above: Deepdub can import 10 languages to a movie with the click of a button.
Image credit: Deepdub
Krakowski said the company cannot yet capture voices in real time, but in post-production they can import voices into six languages simultaneously. Soon, that will be the 12 languages. It usually takes two months to introduce one language to a movie.
“We use cloud networks to separate and separate the voice and replace it in the original way,” he said. “We’re trying to match the lip-sync or the movement of the lips. The whole game can be pretty much accomplished. ”
Former Fox Television Studios president Emiliano Calemzuk serves on the Deepdub advisory board. The company was founded in 2019 by CEO Ofir Krakowski and Nir Krakowski. Oz Krakowski came in after the start. All three are brothers. The company has raised seeds and has about 10 employees.
“We have seen significant progress in the past year,” said Oz Krakowski. “We’re focusing on entertainment now, but we plan to expand to games and adverts. These are great opportunities. ”
GamesBeat Gift Guide:
Everything we recommend this holiday season