AI assistants will soon recognize and respond to the emotion in your voice

emotion
Konstantynov/123RF
You know when people say that it’s not what you say, but how you say it that matters? Well, very soon that could become a part of smart assistants such as Amazon’s Alexa or Apple’s Siri. At least, it could if these companies decide to use new technology developed by emotion tracking artificial intelligence company Affectiva.

Affectiva’s work has previously focused on identifying emotion in images by observing the way that a person’s face changes when they express particular sentiments. Affectiva’s latest technology builds on that premise through the creation of a cloud-based application program interface (API) that is able to detect emotion in speech. Developed using the power of deep learning technology, the smart tech is capable of observing changes in tone, volume, speed, and voice quality and using this to recognize emotions like anger, laughter, and arousal in recorded speech.

“The addition of Emotion AI for speech builds on Affectiva’s existing emotion recognition technology for facial expressions, making us the first AI company to allow for a person’s emotions to be measured across face and speech,” Rana el Kaliouby, co-founder and CEO of Affectiva, told Digital Trends. “This is all part of a larger vision that we have. People sense and express emotion in many different ways: Through facial expressions, voice, and gestures. We’ve set out to develop multi-modal Emotion AI that can detect emotion the way humans do from multiple communication channels. The launch of Emotion AI for speech takes us one step closer.”

Affectiva developed its voice recognition system by collecting naturalistic speech data from a variety of sources, including commercially available databases. This data was then labeled by human experts for the occurrence of what the company calls “emotion events.” These human generated labels were used to train and validate the team’s deep learning models, so that over time it grew to understand how certain shifts in a person’s voice might indicate a particular emotion.

It’s smart stuff from a technology perspective but, like the best technology, it also has the possibility of helping users on a practical basis. One specific application could include car navigation systems that are able to hear a driver start to experience road rage, and react to prevent them from making a rash driving decision. It could similarly be used to allow automated assistants to change their approach when they hear anger or frustration from a user — or to learn what kind of responses elicit the best reactions and repeat these strategies.

Product Review

Glas may be gorgeous, but this spendy thermostat is no smarter than the rest

A stunning OLED screen tops the prettiest thermostat we’ve reviewed in years. But GLAS lacks the brains required to justify its premium price. Read more about it in our full review.
Computing

Go hands-free in Windows 10 with speech-to-text support

Looking for the dictation, speech-to-text, and voice control options in Windows 10? Here's how to set up speech-to-text in Windows 10 and use it to go hands-free in a variety of different tasks and applications within Windows.
Gaming

The best PS3 games of all time

Choosing the right PlayStation 3 game can be a conundrum, especially when there are nearly 1,500 titles to choose from. Thankfully, we've rounded up the best games to have ever made it to the platform.
Gaming

Everyone’s favorite Pokémon turns gumshoe in ‘Detective Pikachu’ trailer

The first Detective Pikachu trailer has arrived, and it looks like a video game movie could actually be good? Voiced by Ryan Reynolds, Pikachu is undeniably cute in what is shaping up to be a family-friendly buddy comedy.
Emerging Tech

Stronger than steel, thinner than paper, graphene could be the future of tech

Since its discovery, graphene has set the research world on fire. What exactly is it, though, and what could it mean for the future of tech? Here's everything you need to know about what could be the next supermaterial to take center stage.
Emerging Tech

The best drone photos from around the world

Most of today's drones come equipped with high-end cameras, which are quickly revolutionizing the world of aerial photography as we know it. Here are some of the best drone photos from around the world.
Emerging Tech

SpaceX makes rocketry look easy, sticks yet another Falcon 9 landing

SpaceX is due to perform its latest Falcon 9 rocket launch and landing on November 15 from NASA’s Kennedy Space Center in Cape Canaveral, Florida. Here's how you can watch the proceedings live.
Emerging Tech

In a weighty decision, scientists prepare to redefine the kilogram

Metrologists are meeting at the General Conference on Weights and Measures in Versailles to vote on whether to redefine the kilogram as a constant that can be observed in the natural world.
Photography

See the National Forests like never before in these awe-inspiring drone videos

What's the difference between a National Park and a National Forest? Drones. With no ban on drones in National Forests -- at least, not yet -- filmmakers have a way to capture the immensity of these locations with stunning results.
Emerging Tech

Google’s balloon internet is coming to Kenya in 2019

In order to bring the internet to those who lack it, a company called Loon is launching balloons into the stratosphere. From more than 12 miles up, these balloons beam connectivity over a large area on the ground.
Emerging Tech

Hikers missing on Mount Fuji could soon find a drone buzzing above their heads

Hikers who go missing while climbing Japan's highest mountain could soon find a drone buzzing above their head. A new system using the flying machines has been set up on Mount Fuji for future search-and-rescue missions.
Emerging Tech

Elon Musk receives FCC approval to launch over 7,500 satellites into space

Not surprisingly, SpaceX is thinking big with Starlink, its space-based global broadband network. This week, the company received FCC approval to launch 7,518 satellites into a low-Earth orbit for its satellite internet service.
Cars

The world’s first 3D-printed titanium wheels are so intricate they look fake

HRE Performance Wheels and GE Additive have teamed up to create the world's first 3D-printed titanium wheels. They are not only impressively durable, but extremely lightweight as well.
Emerging Tech

Of all the vape pens in the world, these 5 are the best

Vaping concentrates has become significantly more popular, especially among those that use cannabis for medicinal purposes. But don’t use just any vape pen: we found these five devices to be our favorites in 2018.