Do you remember the cool Mission Impossible tech that lets Tom Cruise’s character Ethan Hunt mimic the voice of other characters using some nifty speech synthesis technology?
“We are developing new speech synthesis technologies which, among other features, allow us to copy the voice of someone with very little data,” Alexandre de Brebisson, one of the PhD students who developed the deep-learning tech behind the project. “Our experiments show that one minute of audio already contains a lot of the DNA of a human voice. We are able to learn a new voice with as little data because our model is able to capture similarities between the new voice and all the voices it already knows. Our models understand the underlying variables that make [one] voice different from another.”
Since the tech was shown off this week, de Brebisson said his team have received dozens of different suggested use-cases by email, some containing applications they’d thought of, and others containing ones that they hadn’t.
Some companies, for example, are interested in letting their users choose to have audio books read in the voice of either famous people or family members. The same is true of medical companies, which could allow people with voice disabilities to train their synthetic voices to sound like themselves, if recorded samples of their speaking voices exist. Another interesting idea is for video game companies to offer the ability for in-game characters to speak with the voice of the human player.
There are plenty more exciting opportunities, which have led to 10,000 people already signing up to be informed of the forthcoming beta version. “We will then add features over time, such as letting companies design a unique voice tailored for their needs, and control the emotion of the [voice] generation,” de Brebisson continued.
While it doesn’t sound perfect yet, it’s not hard to imagine how this might sound in just a few years. Combined with technology such as software for making convincing edits to the moving lips of a person who is speaking, “fake news” circa 2025 should certainly be a whole lot of fun.
- Tech for Change: New gadgets at CES 2021 finally bridge the language barrier
- What is Section 230? Inside the legislation protecting social media
- Pixar’s Soul team explains how it stayed true to the Black experience
- Tech for Change: Can new gadgets at CES 2021 solve hearing loss?
- How artists and activists are using deepfakes as a force for good