Skip to main content

Google wants your smartphone to be able to save your eyes

Google wants smartphone cameras to help users with the detection of heart issues and diabetes-related complications that can lead to vision loss. Google says its Automated Retinal Disease Assessment (ARDA) tool has shown promising results at detecting a condition called diabetic retinopathy that can lead to blindness if not treated in time.

The company claims tests done in Thailand have proved ARDA’s accuracy and that it is safe to deploy, especially in areas where eye screenings are not easy due to lack of infrastructure or financial constraints. Google plans to conduct more in-depth tests to see if pictures of a person’s eyes clicked with a smartphone camera can be used to detect diabetes, as well as non-diabetes-related health conditions.

A phone’s eye to save your eyes

Google claims early tests have proved that its A.I. is already capable of flagging heart-related issues such as abnormal blood sugar and cholesterol levels by reading pictures of the exterior of a person’s eyes. In addition to deploying a phone’s camera, Google also wants to employ the onboard microphone for health benefits.

A diagram showing a person's eye outlines Google's plan to test using phone camera to detect health issues.
Image used with permission by copyright holder

Essentially, health experts at Google aim to use a phone’s microphone as a stethoscope to record heart sounds. The goal is to help detect issues such as aortic stenosis, a condition that blocks the flow of blood from the heart to the rest of the body. Instruments like a stethoscope or ultrasound machines are usually required to detect such conditions, but Google is testing whether a smartphone’s built-in mics can be used to do the same.

Some progress has already been made

Google has already baked in a feature in its Google Fit app that allows users to measure their respiratory rate, as well as heart rate, using a phone’s camera. To measure the respiratory rate, all that needs to be done is fpr a person to sit in front of the phone, fire up the selfie camera in the Google Fit app, and let A.I. do its magic by analyzing the movement of the torso as one breathes in and out. For checking the heart rate, just place a finger on the rear camera lens.

The company also has a dermatology tool in the pipeline that again banks on A.I. smarts to identify skin, hair, and nail conditions with just a few photos taken from a phone’s camera. Trained to recognize over 280 skin conditions, the A.I. then gives a list of possible ailments. However, it is not intended to self-diagnose problems, and users are still advised to consult with a certified health professional.

Editors' Recommendations

Nadeem Sarwar
Nadeem is a tech journalist who started reading about cool smartphone tech out of curiosity and soon started writing…
Have a Google Pixel 8? You’re about to get these 4 new features
A person holding the Google Pixel 8a, showing the back.

A new set of features is set to debut as part of the June Google Pixel Feature Drop. These include fresh productivity tools and enhancements. Of the latest tools, four will undoubtedly be the most popular.

If you have a Pixel 8 or Pixel 8a, you will soon be able to use Gemini Nano on your phone. Gemini Nano, Google's most efficient AI model for on-device tasks, was previously only available on the Pixel 8 Pro. To access Gemini Nano, you must enable developer options on the phone. Gemini Nano is a bit limited today, but it sets the foundation for powerful on-device AI features down the road.

Read more
This is our very first look at the Google Pixel Watch 3
A leaked render of the Google Pixel Watch 3.

Google is expected to introduce the Google Pixel 9 smartphone series later this year. At the same time, the company is almost certainly going to reveal the Pixel Watch 3. Now, 91Mobiles has released renders that are purported to show the new smartwatch.

If you were hoping for something different from the previous two Pixel Watches, we have bad news for you.

Read more
Google Messages is getting a feature that could save your life
Google Messages app on a Pixel 8 Pro, showing an RCS Chat message thread.

Google has announced a new partnership with RapidSOS that could end up saving your life. This important partnership will allow Android users to message 911 emergency call centers through Rich Communication Services (RCS). This new feature will begin rolling out later this winter.

As of today, you can communicate with 911 through SMS texting, but only in select locations. It’s only available to about 53% of U.S. emergency responder call centers, and since it’s SMS only, you have all of the usual limitations that come with it.

Read more