A cardiac arrest-detecting smart speaker could save your life

Smart Speaker Detecting Agonal breathing
Sarah McQuate/University of Washington

Whether it’s picking the music we want to hear, controlling lights and other connected accessories in our smart home, or searching for a quick piece of information without having to type anything, smart speakers are pretty darn great. But could they soon make the leap from time-saver to life-saver? An innovative research project from the University of Washington suggests the answer may be a resounding yes.

At UW, a team of researchers have developed a way to transform smart speakers into tools able to monitor people for potential cardiac arrest while they’re asleep. According to recent research, a patient’s bedroom is one of the most common locations for an out-of-hospital cardiac arrest. UW’s tool can carry out this detection without the need for any additional hardware and without touching the user in question. How? By taking advantage of smart speakers’ ability to always listen.

The work was carried out by the lab of Shyam Gollakota, an associate professor in UW’s Allen School of Computer Science and Engineering. Gollakota’s team has carried out some fascinating work in the past, such as developing a smartphone app that can hear ear infections: thereby granting ordinary smartphones diagnostic abilities that would normally require specialist tools.

“It is known that during a cardiac arrest, victims will … exhibit a symptom known as ‘agonal breathing'”

“Smart speakers are increasingly becoming popular,” Gollakota told Digital Trends. “You don’t need them to be recharged, and so they are plugged in all the time. As a result, you don’t need to be worried about power.” Gollakota thinks that smart speakers, properly leveraged by researchers, offer a “unique opportunity in terms of medical diagnosis and care.” It’s one that goes way beyond the largely leisurely space that they currently occupy.

The tool the team has developed is, in essence, an app (or, as Amazon’s Echo might term it, a “skill”) that listens for the signature sounds of cardiac arrest. In the event that these are identified, it can call for help: potentially alerting a caregiver or even emergency medical services.

“It is known that during a cardiac arrest, victims will stop breathing normally, and in a majority of cases will exhibit a symptom known as ‘agonal breathing,’ a type of disordered gasping sound,” Gollakota said.

To recognize these “agonal” sounds, and differentiate them from the other sounds heard in a bedroom environment, the team developed what is known as a Support Vector Machine or SVM. This is a type of discriminative classifier; essentially a sorting machine which can be given labeled examples of what it is looking for and then categorize any new examples it experiences.

“Our technology was tested on agonal breathing sounds obtained from 911 calls to Seattle King County’s EMS services during cardiac arrests from 2009 to 2017,” Gollakota said. “We evaluated our technology on 164 hours of sleep sounds, collected across 35 different bedroom environments, as well as 82 hours of sleep lab sounds where patients had apneas, hypopneas and snoring events. [These] can sound similar to agonal breathing. We showed that we can identify agonal breathing sounds accurately in all these scenarios.”

The tool is not quite ready for prime time yet, Gollakota said. “To make the algorithm more robust, we will have to augment more data across different geographical areas beyond Seattle King County,” he noted.

Will a similar transformation take place with smart speakers as they move beyond the early novelty phase?

Nonetheless, the results prove extremely promising. According to a recent paper published in the journal npj Digital Medicine, the UW team’s tool can detect instances of agonal breathing with 97% accuracy from a distance of up to 20 feet away. They are currently looking to commercialize the technology through a spinoff company called Sound Life Sciences.

The next generation of smart speakers

The work of Shyam Gollakota’s lab suggests a promising new way to use smart speakers. As he points out, this category of device is rapidly growing. In the U.S., smart speaker sales — covering the likes of Google Home and Amazon’s myriad Echo devices — are outpacing the adoption of both smartphones and tablets.

However, until very recently these devices were largely confined to novelty use cases. Sure, it’s helpful for a smart speaker to set a kitchen timer or to find us the latest Kendrick Lamar track without having to suffer the indignity of physically scrolling down a list on Spotify. But these are not necessarily the “killer apps” that the devices might one day be known for.

Apple Watch ECG
The Apple Watch. Julian Chokkattu/Digital Trends

A “killer app” is a piece of software or a software feature that’s good enough to sell a device on its own. In the 1980s, personal computers remained the province of hobbyists before a program called VisiCalc came along. VisiCalc was a computer spreadsheet, the first of its kind, which suddenly made owning a personal computer a necessity for anyone who had a small business or simply wanted a better way to manage their finances.

More recently, health and wellness has turned out to be an enormous boon for the Apple Watch. Wearables have been around for many years now, but for most of those they remained niche products for tech geeks and, at their more functional, for select fitness freaks. When Apple launched the Apple Watch in 2015, it initially tried to expand wearables’ audience by presenting it as a fashion item. (Remember the $17,000 Apple Watch Edition?) Now, however, it has pivoted and embraced the life-saving features of the device — such as its ECG reader and fall detection — as major selling points. CEO Tim Cook has even said that Apple’s contributions to health care could turn out to be its biggest legacy.

Will a similar transformation take place with smart speakers as they move beyond the early novelty phase? Other tools such as the Alexa Guard, which uses the far-field microphones built into Echo devices to listen for glass breaks and alarms from smoke or CO detectors, suggests that manufacturers are looking for more life-changing ways of advancing their products. “You can think of [our tool as being] like Alexa Guard, but now for cardiac arrest detection,” Gollakota said.

Being able to say “Alexa, dim the lights and play my after-work playlist” is cool. But being able to say “Alexa, monitor my heart and listen out for other dangers”? That’s a game-changer.


SpaceX’s Starhopper rocket bursts into flames during tests

SpaceX ran into trouble Tuesday evening when a small fire erupted from the engine of a prototype rocket it was testing at the company’s facility in Boca Chica, Texas. It's not clear if the fire caused any damage to the rocket itself

Walmart sale has the lowest prices on Google Home smart speakers after Prime Day

Looking for a voice-assistant smart device? Walmart dropped prices on Google Home smart speakers to stay competitive with Amazon's Prime Day smart home sales. Find deals on Google Nest Hub, Home, and Mini.

It’s your last chance to get Echo Plus with the best sound quality on Prime Day

Amazon Prime Day’s mammoth midsummer two days of deals is winding down, but there’s still plenty of savings to be found. Before Prime Day wraps up, you can score an Amazon Echo Plus smart speaker for just $110, down from $150.
Smart Home

Google Home vs. Amazon Echo: Which one is better for you?

What happens when you compare the Google Home to the Amazon Echo? Both smart speakers have good qualities, but what happens when you compare theie features side-by-side? We think one of these smart gadgets wins over the other.
Smart Home

Should you buy the Amazon Echo, or the more affordable Echo Dot?

Having Alexa answer your questions is nothing short of futuristic, but which device should you get, Amazon's Echo or Echo Dot? We break down the differences between the two Amazon smart speakers.
Emerging Tech

Buying on a budget? Here's all the best tech you can snag for $25 or less

We live in a world where you can get a cheeseburger for $1, a functioning computer for $5, and thousands of HD movies for $10 -- so it stands to reason that you should be able to pick up some pretty sweet gear for $25.
Emerging Tech

IBM’s Wimbledon-watching A.I. is poised to revolutionize sports broadcasts

IBM has developed a smart A.I. with an appreciation for what makes a great tennis match like the recent epic at Wimbledon. Here's how IBM developed it -- and why tools like it are the future of sport broadcasting.
Digital Trends Live

Digital Trends Live: Emoji Day, Apollo 11 broadcast, drone flamethrowers

On this episode of DT Live, we discuss the top stories in tech, including Emoji Day festivities, the extended battery life of the new Nintendo Switch, an Apollo 11 real-time broadcast, and a functional flamethrower attachment for drones.
Emerging Tech

6 questions we have about Elon Musk’s Neuralink brain interface technology

Elon Musk's Neuralink sounds like an exciting leap forward for human-computer relations, but brain implants raise the specter of Black Mirror-esque privacy invasions. We have a few questions about how this would work.

Canadian medical project demonstrates the health care potential of smart homes

A medical project involving smart homes demonstrates the technology's potential in treating mental illness and providing patients with a level of independence previously thought impossible.
Emerging Tech

Implant restores sight in blind patients by beaming images directly to the brain

Engineers have developed a neural implant which could help restore vision for completely blind people by bypassing non-functioning optical nerves and inputting images directly into their brains.

Ride in style with the Xiaomi Mi electric scooter for $97 less post-Prime Day

Scooters started out as a plaything for kids. But now they are larger and have become a common and efficient means to commute, like the Xiaomi Mi electric scooter. It's available on Amazon as a post-Prime Day deal for $97 less.
Emerging Tech

Trippy VR demo reads your brain waves to create sleep-inducing visuals

Struggle to get to sleep? Researchers in Australia have been experimenting with ways to combine a person’s brain activity with virtual reality to create a kind of VR lullaby machine.
Emerging Tech

Elon Musk says SpaceX’s Starship can land on the moon by 2021

SpaceX boss Elon Musk said recently that he believes its Starship spacecraft can land on the moon by 2021, adding that he hopes his company can help to build a "permanently occupied lunar base" there.