Skip to main content

Microsoft has a free app designed to help visually impaired users

Seeing AI app from Microsoft
Microsoft is using artificial intelligence to tackle a huge problem — helping visually impaired users interact with the world around them. To that end, it has developed Seeing AI, an iPhone app that recognizes people, places, documents, currency, and more to narrate your surroundings.

Open the app and point your phone’s camera at a friend, and Seeing AI will tell you who you’re looking at and the expression on their face. Point it at a can of soup in the grocery store, and it will read off the brand as well as the directions. The app can also translate printed text to speech, whether it’s on a paper or a label on a door. It can even tell dollar bills apart from one and another.

Seeing AI isn’t only intended for your phone’s camera, either. You can import images to the app through iOS’ share menu, and it will describe the picture and read text if any is contained.

The app sports a few experimental features as well, though they require you to have a data connection to function. There’s a “scene” mode, which will literally describe your environment, rather than simply reading text. Another mode can decipher and read out handwriting.

One of the more impressive aspects of Seeing AI is that everything the app can do — outside of those last two features — is handled locally on the device. Most of the time, you’ll never need the cloud’s help to use Seeing AI, which is a massive benefit. Everyone expects to be able to connect to the internet wherever they go, but the reality is much spottier — so it’s reassuring to know Microsoft has planned for the inevitable.

Microsoft’s latest project comes at an interesting time for the company, just a day after it ended support for its Windows Phone 8.1 operating system. While Microsoft may have struggled in building its own mobile devices, it’s currently producing some of its most interesting, unique, and helpful apps for other platforms.

Seeing AI is debuting on iOS, and can be downloaded for free. Microsoft has not disclosed when or if Android users can expect the app.

Editors' Recommendations

Adam Ismail
Former Digital Trends Contributor
Adam’s obsession with tech began at a young age, with a Sega Dreamcast – and he’s been hooked ever since. Previously…
I record interviews for work. These are my favorite free recorder apps
The iPhone 14 Pro and Google Pixel 7 Pro's voice recording apps running together.

The Voice Recorder app on a phone (left) and the Voice Memos on another phone Andy Boxall / Digital Trends

Before you head to the app store on your phone to buy a voice-recording app, take a moment to consider the apps that may already be installed on your phone. Why? In my experience, they're likely all you really need. I’ve recorded interviews and voice-overs for work for years, and I’ve found the two best examples come preinstalled on your phone already, so they’re entirely free to use.

Read more
This $600 Android phone has one big advantage over the iPhone
Two people holding the Fairphone 4 showing off the phone's rear side.

After nearly two years of wondering if it'll ever be sold officially in the U.S., the Fairphone 4 — a smartphone that hangs its hat on its repairable design — has finally launched in North America. With the evergrowing issue of e-waste, it's nice to see a company that's focused on following sustainable practices that allow users to fix their phones themselves instead of the all-too-common problem of having to throw out your iPhone and buy a new one when small issues occur.

Take note that the U.S. release of the Fairphone 4 is actually a variant called the Murena Fairphone 4, which differs from the base device with its Android-based operating system /e/OS.

Read more
iOS 17’s coolest new feature is horrible news for Android users
iOS 17 contact posters

At the end of 2022, Google implored Apple to “get the message” and end the green-versus-blue bubble controversy by adopting RCS messaging. Apple’s response eventually came at WWDC 2023, where it introduced a new iOS 17 feature called Contact Posters, which instead of bringing everyone together, only furthers the us-versus-them split between Android and iOS.

If you thought the green/blue iMessage arguments could get fiery, there’s a lot more to come.
Blue good, green bad

Read more