Baidu’s new A.I. can mimic your voice after listening to it for just one minute

Image used with permission by copyright holder

We’re not in the business of writing regularly about “fake” news, but it’s hard not to be concerned about the kind of mimicry technology is making possible. First, researchers developed deep learning-based artificial intelligence (A.I.) that can superimpose one person’s face onto another person’s body. Now, researchers at Chinese search giant Baidu have created an A.I. they claim can learn to accurately mimic your voice — based on less than a minute’s worth of listening to it.

“From a technical perspective, this is an important breakthrough showing that a complicated generative modeling problem, namely speech synthesis, can be adapted to new cases by efficiently learning only from a few examples,” Leo Zou, a member of Baidu’s communications team, told Digital Trends. “Previously, it would take numerous examples for a model to learn. Now, it takes a fraction of what it used to.”

Recommended Videos

Baidu Research isn’t the first to try and create voice-replicating A.I. Last year, we covered a project called Lyrebird, which used neural networks to replicate voices including President Donald Trump and former President Barack Obama with a relatively small number of samples. Like Lyrebird’s work, Baidu’s speech synthesis technology doesn’t sound completely convincing, but it’s an impressive step forward — and way ahead of a lot of the robotic A.I. voice assistants that existed just a few years ago.

The work is based around Baidu’s text-to-speech synthesis system Deep Voice, which was trained on upwards of 800 hours of audio from a total of 2,400 speakers. It needs just 100 5-second sections of vocal training data to sound its best, but a version trained on only 10 5-second samples was able to trick a voice-recognition system more than 95 percent of the time.

“We see many great use cases or applications for this technology,” Zou said. “For example, voice cloning could help patients who lost their voices. This is also an important breakthrough in the direction of personalized human-machine interfaces. For example, a mom can easily configure an audiobook reader with her own voice. The method [additionally] allows creation of original digital content. Hundreds of characters in a video game would be able to have unique voices because of this technology. Another interesting application is speech-to-speech language translation, as the synthesizer can learn to mimic the speaker identity in another language.”

For a deeper dive into this subject, you can listen to a sample of the voices or read a paper describing the work.

Editors' Recommendations

I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Alexa and Siri can’t understand the tone of your voice, but Oto can

Speech-recognition technology is everywhere these days, most notably in A.I. smart assistants such as Amazon’s Alexa, Apple’s Siri, and Google's Assistant. But as anyone who has ever had a conversation IRL (in real life) will know, speech isn’t just about the words that a person says, but the tone of voice in which they say them. It’s one reason that text-based conversations online can be such a nightmare, since the basic words themselves don’t allow for sufficient nuance to always convey a person’s meaning.

One exciting startup looking to inject more understanding into speech recognition is Oto, a spinoff from the prestigious SRI International, which helped spawn Siri more than a decade ago. Oto is working on voice-intonation technology that will, at least initially, enable call centers to better understand the vocal emotions of callers and sales agents alike.

Read more
New cardiology A.I. knows if you’ll die soon. Doctors can’t explain how it works

Here’s a scenario scary enough to warrant a horror movie: An artificial intelligence that is able to accurately predict your chances of dying in the next year by looking at heart test results, despite the fact that the results may look totally fine to trained doctors. The good news: The technology might just wind up saving your life one day.

“We have developed two different artificial intelligence algorithms that can automatically analyze electrical tracings from the heart and make predictions about the likelihood of a future important clinical event,” Brandon Fornwalt, from Pennsylvania-based healthcare provider Geisinger, told Digital Trends.

Read more
Microsoft has an A.I. coach that can critique your PowerPoint presentations

Public speaking, including the delivery of PowerPoint presentations, can be a trial. There's the need to pace yourself, as well as to avoid reading your slides word for word. Microsoft gets that.

Leaning on the power of artificial intelligence, the company is now launching a public preview of its PowerPoint Presenter Coach, a tool which can help critique your PowerPoint presentation.

Read more