AI assistants will soon recognize and respond to the emotion in your voice

emotion
Konstantynov/123RF
You know when people say that it’s not what you say, but how you say it that matters? Well, very soon that could become a part of smart assistants such as Amazon’s Alexa or Apple’s Siri. At least, it could if these companies decide to use new technology developed by emotion tracking artificial intelligence company Affectiva.

Affectiva’s work has previously focused on identifying emotion in images by observing the way that a person’s face changes when they express particular sentiments. Affectiva’s latest technology builds on that premise through the creation of a cloud-based application program interface (API) that is able to detect emotion in speech. Developed using the power of deep learning technology, the smart tech is capable of observing changes in tone, volume, speed, and voice quality and using this to recognize emotions like anger, laughter, and arousal in recorded speech.

“The addition of Emotion AI for speech builds on Affectiva’s existing emotion recognition technology for facial expressions, making us the first AI company to allow for a person’s emotions to be measured across face and speech,” Rana el Kaliouby, co-founder and CEO of Affectiva, told Digital Trends. “This is all part of a larger vision that we have. People sense and express emotion in many different ways: Through facial expressions, voice, and gestures. We’ve set out to develop multi-modal Emotion AI that can detect emotion the way humans do from multiple communication channels. The launch of Emotion AI for speech takes us one step closer.”

Affectiva developed its voice recognition system by collecting naturalistic speech data from a variety of sources, including commercially available databases. This data was then labeled by human experts for the occurrence of what the company calls “emotion events.” These human generated labels were used to train and validate the team’s deep learning models, so that over time it grew to understand how certain shifts in a person’s voice might indicate a particular emotion.

It’s smart stuff from a technology perspective but, like the best technology, it also has the possibility of helping users on a practical basis. One specific application could include car navigation systems that are able to hear a driver start to experience road rage, and react to prevent them from making a rash driving decision. It could similarly be used to allow automated assistants to change their approach when they hear anger or frustration from a user — or to learn what kind of responses elicit the best reactions and repeat these strategies.

Emerging Tech

Awesome Tech You Can’t Buy Yet: camera with A.I. director, robot arm assistant

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Smart Home

With focus on interoperability, is Nevo Butler a smarter home hub?

Universal Electronics is the latest company getting into the smart home market, announcing at CES 2019 that it intends to market the Nevo Butler, a new smart home hub with onboard A.I. and voice control technology.
Smart Home

Amazon patents a technology to help Alexa fight fake voice attacks

Amazon filed a patent this month for a new technology that looks like it would help its digital assistant Alexa fight fake voice attacks that could potentially fool Alexa's biometric security protocols.
Smart Home

This just in: Alexa can now deliver the news like a professional newscaster

The Amazon Alexa team has given Alexa a newscaster voice that improves the way she delivers the news and reads Wikipedia articles, making the smart assistant easier to understand.
Emerging Tech

Water-based fuel cell converts carbon emissions to electricity

Scientists from Korea's Ulsan National Institute of Science and Technology have developed a system which can continuously produce electrical energy and hydrogen by dissolving carbon dioxide in an aqueous solution.
Emerging Tech

Scientists investigate how massive stars die in dramatic hypernova events

Our Sun will gradually fade before expanding into a red giant at the end of its life. But larger mass stars undergo extreme explosive events called hypernovas when they die which outshine their entire galaxies.
Emerging Tech

Pilotless planes are on their way, but would you fly in one?

Airbus says advancements in artificial intelligence can help it toward its goal of building a plane capable of fully autonomous flight, though whether passengers can be persuaded to travel in one is another matter entirely.
Emerging Tech

‘Tech vest’ prevents Amazon workers from colliding with robot co-workers

Amazon workers at its fulfillment centers are using "tech vests" to help protect them from collisions with their robot co-workers. The robots already have obstacle avoidance sensors, but the belt offers another layer of safety.
Emerging Tech

3D printers are finally affordable. Here are the best models under $500

3D printer prices have dropped dramatically over the past few years, but just because something is cheap doesn’t mean it’s worth buying. Here, we’ve rounded up all the cheap 3D printers that are actually worth spending your money on.
Mobile

T-Mobile 5G rollout: Here is everything you need to know

2019 will be a huge year for T-Mobile. Not only is a merger with Sprint likely, but T-Mobile is also in the midst of building out its next-generation mobile service. Here's everything you need to know about the T-Mobile 5G rollout.
Emerging Tech

ANYmal dog robot can get back on its feet when someone pushes it over

Roboticists at ETH Zurich have demonstrated how their ANYmal four-legged robot is capable of taking a kicking and keeping on walking -- or getting back to its feet if it's pushed over.
Emerging Tech

A.I. finds non-infringing ways to copy drugs pharma spends billions developing

Researchers have demonstrated an artificial intelligence which can find new methods for producing existing pharmaceuticals in a way that doesn’t infringe on existing patents. Here's how.
Emerging Tech

Coinstar machines will let you swap cash for Bitcoin at your local grocery store

Coinstar, the company which owns the coin exchange machines found at grocery stores and elsewhere, will soon let you easily buy Bitcoin with your cash money. Here's how it will work.
Emerging Tech

Facebook hasn’t given up on the idea of building an internet drone

Facebook's efforts to provide internet connectivity from the skies using solar-powered drones suffered a blow last year when the company abandoned its "Aquila" drone project. But the company clearly hasn't given up on the idea.