Skip to main content

Spotify using AI to clone and translate podcasters’ voices

Spotify has unveiled a remarkable new feature powered by artificial intelligence (AI) that translates a podcast into multiple languages using the same voices of those in the show.

It’s been made possible partly by OpenAI’s just-released voice generation technology that needs only a few seconds of listening to replicate a voice.

Spotify said the feature makes for “a more authentic listening experience that sounds more personal and natural than traditional dubbing,” adding: “A podcast episode originally recorded in English can now be available in other languages while keeping the speaker’s distinctive speech characteristics.”

Starting today, Spotify is making available voice-translated episodes from select creators, with shows translated from English to Spanish. In the coming days, French and German episodes will also be made available.

Available episodes in Spanish include:

Lex Fridman Podcast – Interview with Yuval Noah Harari
Armchair Expert – Kristen Bell, by the grace of god, returns
The Diary of a CEO with Steven Bartlett – Interview with Dr. Mindy Pelz

Alternatively, head to the Voice Translation hub in Spotify’s app to view all of the translated shows that are currently available, with new shows arriving in the weeks and months to come.

Spotify said that around 100 million people “regularly” listen to podcasts on its platform, and its new AI-powered voice translation offering could notch up millions of more listens for shows that suddenly find themselves in new, enormous markets.

One of the tests of Spotify’s new feature will be whether the translation element manages to accurately capture the nuances of the original dialogue.

Either way, it looks like another setback for voice actors, as the technology could easily be transferred to movies and TV shows, replicating the voices of an entire cast for international versions of the content.

Voice cloning technology has been around for some time and is getting better all the time due to advances in AI. Not surprisingly, it’s already being used for nefarious purposes, too, with a growing number of related scams coming to the attention of law enforcement agencies. It’s feared that the technology could also fuel a rise in more convincing misinformation as bad actors use it to create audio of politicians or leading figures appearing to say things that they didn’t.

Editors' Recommendations

Trevor Mogg
Contributing Editor
Not so many moons ago, Trevor moved from one tea-loving island nation that drives on the left (Britain) to another (Japan)…
Euro 2024 Netherlands vs France live stream: Can you watch for free?
A soccer field.

The top of Group D at Euro 2024 is on the line today at Red Bull Arena in Leipzig when powerhouses France and Netherlands meet for a huge showdown. Both among the top favorites entering the tournament, they each won their opener but in unconvincing fashion. Netherlands fell behind early against Poland before rallying to a 2-1 victory. France's powerful attack couldn't solve Austria, but they were able to squeeze out a 1-0 win thanks to an own goal.

Netherlands vs France is just about to start, at 3:00 p.m. ET, and if you live in the United States it will be televised on Fox. But if you're looking for some ways to stream Euro 2024 online, we've found all the best options for watching a free live stream of Netherlands vs France today.
Is there a free Netherlands vs France live stream?

Read more
Best new movies coming to theaters in 2024
Tom Hardy and Austin Butler in The Bikeriders.

It seems that Hollywood was too quick to crown Bad Boys: Ride or Die as the savior of the summer box office. Because Pixar's Inside Out 2 blew away all box office projections with a $154 million opening last weekend. That's not too far behind Barbie's $162 million opening from last year. Inside Out 2 probably won't have the legs that Barbie did at the box office, but it's well on its way to being one of the biggest hits of the year. A $500 million domestic finish for Inside Out 2 is not an unreasonable estimate when the film finally leaves theaters.

In the short run, this week's new addition, The Bikeriders, has no shot at overtaking Inside Out 2. None. This battle was over before the first motorcycle started. Unfortunately for The Bikeriders, it's unlikely to take No. 2 either, since Bad Boys: Ride or Die proved to be good counterprograming for Inside Out 2 last weekend. That's likely going to mean a third place finish for The Bikeriders at best.

Read more