Skip to main content

AI could turn your phone into a mobile health lab

Your phone might soon be getting AI-assisted upgrades to benefit your health.

Google Health has introduced research projects that promise to turn smartphones into disease=screening tools. One promising avenue involves using the onboard microphones on a phone as a stethoscope to detect circulatory irregularities like murmurs. The innovations could be deployed through telehealth, saving the need and time for patients to travel to a doctor.

Recommended Videos

“At Google, we’re focused on unlocking the potential of everyday devices to support people’s health and wellness,” Greg Corrado, head of Health AI at Google, told Digital Trends in an interview. “Such developments are becoming possible thanks to improvements in sensors on mobile devices, as well as advances in AI, and we want to be at the forefront of these developments.”

Diagnosis through your phone

Steth IO heart rate monitoring.
Steth IO heart rate monitoring. Steth IO

Google says it sees “early promising results” in using existing clinical cameras to detect diabetic eye disease. It plans to fund more clinical trials on the use of smartphones to do the same thing. The company uses Automated Retinal Disease Assessment, an AI engine, to process the images.

Corrado says mobile sensors combined with machine learning can give people insights into their daily health and wellness. The feature that allows you to measure your heart rate and respiratory rate with your phone’s camera is now available on Android and iOS devices.

Three screenshots of the Google Fit app
Image used with permission by copyright holder

Another area of research explores how a smartphone’s built-in microphones could record heart sounds when placed over the chest. Listening to someone’s heart and lungs with a stethoscope can help clinicians detect heart valve disorders. Screening for aortic stenosis typically requires specialized equipment, like a stethoscope or an ultrasound, and an in-person assessment.

“This newest area of research explores how a smartphone’s built-in microphone can record heart sounds when placed over the chest, and possibly detect heartbeats and murmurs,” Corrado said. “It’s important to note that we’re still in the beginning stages of research and development, but our hope is to provide doctors and patients with an additional tool for assessment and care.”

Connor Landgraf, the CEO of Eko, which created the first AI stethoscope, told Digital Trends in an interview that it’s not completely clear yet how Google plans to roll the stethoscope feature out to consumers.

A nurse uses the Eko Duo stethoscope and iPhone app.
The Eko DUO ECG + Digital Stethoscope Eko

“But a guess would be that Google plans to enable patients with some risk for heart disease to use the microphone on their smartphone to listen to their heart sounds and to share the auscultation data with their primary care physician,” Landgraf added. ”This could allow clinicians to gather a patient’s cardiac data, which is mostly available during an in-person exam, remotely, from anywhere in the world.”

Landgraf said that having a stethoscope on a smartphone could make the tool more available. “It would be straightforward to reach a large number of patients through these apps,” he added. “However, it would also likely trade off some accuracy since the smartphone is not an ideal stethoscope. It will also likely require a Food and Drug Administration (FDA) review of the software and may consider the smartphone as a medical device.”

Smartphone stethoscopes could also be a way to give patients more awareness and knowledge of their overall heart health, Landgraf said. A significant number of patients with heart valve disease are not diagnosed early enough by their primary doctor, and many patients are never treated.

“There is a tsunami wave of patients with undiagnosed cardiac conditions, and this technology could play a role in helping provide more knowledge to these patients,” Landgraf said.

Ultrasounds for everyone

A doctor used this iPhone ultrasound machine to diagnose his own cancer
The Butterfly iQ Butterfly Network

Corrado said AI could also help make ultrasound more available to low-income parents. Ultrasound uses high-frequency sound waves to create real-time pictures or videos of internal organs or other tissues, such as blood vessels and fetuses. But more than half of all birthing parents in low-to-middle-income countries don’t receive ultrasounds due to a shortage of expertise in reading ultrasounds.

Google is working on using AI to help providers conduct ultrasounds and perform assessments. “With more automated and accurate evaluations of maternal and fetal health risks, we hope to lower barriers and help people get timely care in the right settings,” Corrado said in a blog post.

Hila Goldman – Aslan, the CEO of DiA Imaging Analysis, a provider of AI-powered ultrasound analysis solutions, told Digital Trends in an interview that AI can act as a second set of eyes for overworked doctors or provide diagnostic power that is simply impossible for humans.

“In our area of ultrasound tests, visually analyzing ultrasound images is subjective, error-prone, and highly dependent on the operator’s experience,” Goldman – Aslan said.

Radiologists typically work chronologically on a first-come-first-served basis, without necessarily always knowing if there are more urgent cases down the list that need addressing first.

Elad Walach, the CEO of Aidoc, a provider of health care AI solutions, said that for medical imaging, AI addresses the challenges of labor shortages and physician fatigue. AI can flag the positive cases in the radiologist’s workflow so that patients can get timely treatment.

“Radiologists are facing larger case volumes, which can lead to burnout,” Walach said. “More importantly, radiologists typically work chronologically down a worklist on a first-come, first-served basis, without necessarily always knowing if there are more urgent cases down the list that need addressing first.”

But Ronald Dixon, a physician and the CEO of CareHive, told Digital Trends in an interview that he doesn’t think that the Google health tools will have much of an impact on patients.

“The focus of the Google effort has “really been on how you use technology to better diagnose or better manage patients without necessarily an understanding of the value of what that technology might provide,” he said.

Dixon said he’s concerned the use of AI could raise the costs of health care for consumers.

“If the cost goes up because you’re using technology to try to solve a problem, you’re not actually helping the health care system because you’re actually hurting it in that way,” he added. “You’re causing us to spend more money to likely get to the same outcome. And the reason why they do that is that they’re technology companies. So it’s a ‘technology-first’ strategy as opposed to a ‘clinical need-first’ strategy.”

Sascha Brodsky
Sascha Brodsky is a writer who focuses on consumer technologies and privacy issues for a broad range of outlets. He’s been…
Topics
M3GAN is your phone’s most unsettling chatbot yet
M3GAN stands still while wearing a brown overcoat in the film "M3GAN."

Blumhouse and Meta are giving you the chance to break every movie theater's no-texting policy, as they're launching a new AI chatbot experience called Movie Mate during a new screening of M3GAN on April 30, ahead of the release of its sequel, M3GAN 2.0. And who better to theme the chatbot after the leading killer doll?

Variety reported on the announcement of Movie Mate Wednesday, saying Meta is launching the chatbot program alongside the horror film studio to "augment and uplevel the 'second screen' viewing experience" by giving fans a second screen to interact with M3GAN and her namesake film on a deeper level than they have before. Fans who go see M3GAN in theaters at the end of this month will get to talk to the evil doll by DM'ing the movie's official Instagram account (@M3GAN), and she'll give access to exclusive content, trivia, and behind-the-scenes information as the movie is playing. It's like one of those pop-up editions of Disney Channel movies in the 2000s, except you'll see something to that effect on your phone instead on the silver screen. With M3GAN, it's all the more exciting and unsettling.

Read more
Your next phone could have a 10km Bluetooth connection
Person holding a phone while laying on a bed.

Bluetooth connections tend to have a somewhat limited range, often topping out around 33 feet. MediaTek has just announced the Dimensity 9400 Plus, a brand-new chipset that promises to blow that number out of the park and support distances up to 10 kilometers (about 6.2 miles). The original Dimensity 9400 could deliver distances of 1.5 kilometers, so this is a huge jump — but it's not quite as clear-cut as it sounds.

The estimated distance is for phone-to-phone direct Bluetooth connections, which means your wireless earbuds won't suddenly gain a huge bump in quality over distance. The key phrasing is found on MediaTek's website: "The Dimensity 9400+ extends phone-to-phone Bluetooth connections up to 10km when in line-of-sight, increasing over 6.6X further than the Dimensity 9400. These ultra-long reach direct connections don’t require cellular mobile services, saving data, and improving privacy."

Read more
Mobile AI isn’t Netflix, so phone makers need to keep subscriptions out of it
A person holding the Nothing Phone 3a Pro.

When I reviewed the Nothing Phone 3a Pro I loved the phone and was also taken by the Essential Space, the brand’s subtle and useful move into mobile AI. However, as the Nothing Phone 3a Pro finds its way into more hands, some hardcore users are hitting a limit in Essential Space where they can no longer use the AI feature on the phone.

This frustrating situation is causing alarm because any kind of AI feature limit is often followed by a subscription option to remove it. If Nothing does start to charge heavy users for the Essential Space, will anyone be prepared to pay? It’s a question every smartphone brand should be asking about mobile AI, and the answer may not be the one they want to hear.
What’s going on with Essential Space?
Essential Space Andy Boxall / Digital Trends

Read more