Skip to main content

Alexa and Siri can’t understand the tone of your voice, but Oto can

Speech-recognition technology is everywhere these days, most notably in A.I. smart assistants such as Amazon’s Alexa, Apple’s Siri, and Google’s Assistant. But as anyone who has ever had a conversation IRL (in real life) will know, speech isn’t just about the words that a person says, but the tone of voice in which they say them. It’s one reason that text-based conversations online can be such a nightmare, since the basic words themselves don’t allow for sufficient nuance to always convey a person’s meaning.

One exciting startup looking to inject more understanding into speech recognition is Oto, a spinoff from the prestigious SRI International, which helped spawn Siri more than a decade ago. Oto is working on voice-intonation technology that will, at least initially, enable call centers to better understand the vocal emotions of callers and sales agents alike.

Related Videos

“At Oto, our mission is to unlock empathy in machines, and to this end we have developed DeepTone, a unique technology based on deep neural networks trained on hundreds of thousands of real conversations to score tiny variations in the emotions present in speech,” Nicolas Perony, co-founder and chief technology officer at Oto, told Digital Trends.

These tiny variations, described as “latent speaker states,” allow the emotional tone of a speaker’s words to be registered in real time, many times per second. The system was trained on a database of 100,000 utterances from 3,000 people, taken from 2 million sales conversations.

“The applications of intonation are almost infinite,” said Teo Borschberg, co-founder and CEO. “We are entering a voice-first world. Soon you will speak with everything: Your car, watch, fridge, speakers, [and more]. Getting the nuances of speech will be key to creating meaningful conversations. Right now, we work on the human quality of conversations in contact centers. So far, it isn’t really possible to judge the experiential quality of a call based on text only; it is too ambiguous.”

Through Oto’s tech, sales agents can be prompted in real-time to put in “the right energy” during calls, while also showing sufficient customer empathy. “The value is that for the first time, call centers can measure the quality of experiences and act on this information at scale to save angry customers from churning,” Borschberg said.

Oto recently announced a seed-funding round of $5.3 million. This will be used to grow the company’s engineering and sales teams. It will also help it further expand its tech offerings to understand new emotions and behaviors through voice.

Editors' Recommendations

Nvidia’s $200 Jetson Orin Nano minicomputer is 80 times faster than the previous version
Nvidia Jetson Orin Nano system-on-module.

Nvidia announced the upcoming release of the Jetson Orin Nano, a system-on-module (SOM) that will power up the next generation of entry-level AI and robotics, during its GTC 2022 keynote today.

Nvidia says this new version delivers an 80x increase in performance over the $99 Jetson Nano. The original version was released in 2019 and has been used as a bare-bones entry into the world of AI and robotics, particularly for hobbyists and STEM students. This new version looks to seriously up the power.

Read more
You probably can’t hit max clock speeds on AMD’s Ryzen 9 7950X
The Ryzen 9 7900X sitting against a box.

As we inch closer and closer to the launch of AMD Ryzen 7000, we are learning more about the flagship Ryzen 9 7950X. Equipped with an impressive set of specifications, the CPU will undoubtedly become one of the best AMD processors on the market.

However, we've just heard of a little-known fact about the new Zen 4 CPU: its maximum clock speed will rely on temperatures, and the threshold is set so low that most people won't be able to achieve it.

Read more
This game lets hackers attack your PC, and you don’t even need to play it
Genshin Impact characters.

Hackers have been abusing the anti-cheat system in a massively popular game, and you don't even need to have it installed on your computer to be affected.

The game in question is called Genshin Impact, and according to a new report, hackers are able to utilize the game's anti-cheat measures in order to disable antivirus programs on the target machine. From there, they're free to conduct ransomware attacks and take control of the device.

Read more