Listening to you speak could help reveal stress, depression, and even heart conditions

machine learning health insights voice
Can the same technology which analyzes emotion in voices also be used to identify health-related issues, ranging from stress and depression to heart conditions? That’s the question being asked as part of a collaboration between voice-driven emotions analytics company Beyond Verbal and researchers at leading global medical institutions, including the Mayo Clinic.

Their answer? An optimistic ‘yes.’

Over the past 21 years, Beyond Verbal has gathered an impressive broad dataset of 2.5 million emotion-tagged voices in upwards of 40 different languages. The idea is that, working with its medical partners, it can use the power of machine learning and big data to also examine the connection between vocal intonations and health issues.

“We are not calling what we’re doing right now diagnostics,” Yuval Mor, CEO of Beyond Verbal, told Digital Trends. “Instead, it’s about long-term monitoring and decision support systems. The diagnostic tools that a doctor can use right now can do a better job than we can with vocal markers. However, what we’re doing is to use voice abnormalities observed over time to say that your voice is significantly different from how it sounded yesterday, a week ago, or two months ago — and then to correlate those changes with specific things we can identify.”

The ability to recognize certain conditions based on voice is not new, and nor does it always require a machine. Listening to a person speak can be used to help reveal that they may be suffering from certain conditions, such as dementia or Parkinson’s disease. However, machine learning tools can be used to go further — by dialing in on granular details which may not be readily observable to the human ear.

In particular, what Beyond Verbal is hoping to do is expand this recognition to medical and physiological conditions which are not associated with the brain.

“That’s where this work is becoming very fascinating, and that’s what we’ve been working with the Mayo Clinic over the past two years to do,” Mor said. This may include the diagnosis of coronary artery disease, for example, which Mor said is something that is being looked at very closely.

Right now, the so-called Beyond Health Research Platform is still rolling out, but Mor noted that collaborators are certainly thinking big with the project.

“The long-term vision is that everyone will have their own companion, a guardian angel, which could be anything from your mobile phone to your Amazon Echo,” he said. “It might be that it monitors your phone conversations, or that you speak to an app for 30 seconds every morning — and from that it gives you high-level indications. You either get a green light saying everything is okay, a yellow light saying it’s worth monitoring closely, or a red light telling you that something is significantly different and it can be mapped to a specific condition, so you should go see your doctor.”

Coming soon to a device near you? We certainly hope so. In the meantime, this is a fascinating piece of research we’ll be sure to keep our eyes on.

Emerging Tech

Meet the MIT scientist who’s growing semi-sentient cyborg houseplants

Elowan is a cybernetic plant that can respond to its surroundings. Tethered by a few wires and silver electrodes, the plant-robot hybrid can move in response to bioelectrochemical signals that reflect the plant’s light demands.
Emerging Tech

MIT’s smart capsule could be used to release drugs in response to a fever

Researchers have developed a 3D-printed capsule which can monitor patients' vital signs, transmit this information to a connected device, and release drugs in response to symptoms.
Movies & TV

The best movies on Amazon Prime right now (December 2018)

Prime Video provides subscribers with access to a host of fantastic films, but sorting through the catalog can be an undertaking. Luckily, we've done the work for you. Here are the best movies on Amazon Prime Video right now.
Wearables

How to use the ECG app, set up irregular rhythm notifications on the Apple Watch

The Apple Watch Series 4 is the best smartwatch iPhone owners can own, and it just got even better with the addition of the ECG app and ability to identify irregular heart rhythms. Here's how to set it all up.
Emerging Tech

Rise of the Machines: Here’s how much robots and A.I. progressed in 2018

2018 has generated no shortage of news, and the worlds of A.I. and robotics are no exception. Here are our picks for the most exciting, game changing examples of both we saw this year.
Emerging Tech

Parker Solar Probe captures first image from within the atmosphere of the sun

NASA has shared the first image from inside the atmosphere of the sun taken by the Parker Solar Probe. The probe made the closest ever approach to a star, gathering data which scientists have been interpreting and released this week.
Emerging Tech

Awesome Tech You Can’t Buy Yet: Booze-filled ski poles and crypto piggy banks

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Emerging Tech

Say cheese: InSight lander posts a selfie from the surface of Mars

NASA's InSight mission to Mars has commemorated its arrival by posting a selfie. The selfie is a composite of 11 different images which were taken by one of its instruments, the Instrument Deployment Camera.
Emerging Tech

Researchers create a flying wireless platform using bumblebees

Researchers at the University of Washington have come up with a novel way to create a wireless platform: using bumblebees. As mechanical drones' batteries run out too fast, the team made use of a biology-based solution using living insects.
Emerging Tech

Bright ‘hyperactive’ comet should be visible in the sky this weekend

An unusual green comet, 46P/Wirtanen, will be visible in the night sky this month as it makes its closest approach to Earth in 20 years. It may even be possible to see the comet without a telescope.
Emerging Tech

Gorgeous images show storms and cloud formations in the atmosphere of Jupiter

NASA's Juno mission arrived at Jupiter in 2016 and has been collecting data since then. NASA has shared an update on the progress of the mission as it reaches its halfway point, releasing stunning images of the planet as seen from orbit.
Emerging Tech

Beautiful image of young planets sheds new light on planet formation

Researchers examining protoplanetary disks -- the belts of dust that eventually form planets -- have shared fascinating images of the planets from their survey, showing the various stages of planet formation.
Emerging Tech

Delivery robot goes up in flames while out and about in California

A small meal-delivery robot suddenly caught fire in Berkeley, California, on Friday. The blaze was quickly tackled and no one was hurt, but the incident is nevertheless a troubling one for the fledgling robot delivery industry.
Emerging Tech

High-tech dancing robot turns out to be a guy in a costume

A Russian TV audience was impressed recently by an adult-sized "robot" that could dance and talk. But when some people began pointing out that its actions were a bit odd, the truth emerged ... it was a fella in a robot suit.