Skip to main content

Microsoft’s Seeing A.I. app now lets users explore photos by touch

The Microsoft Seeing A.I. app was first announced in 2017 and was an instant hit for many vision-impaired users. The app essentially uses artificial intelligence to describe what’s in a photo, allowing blind and low vision users to get an idea of what an image looks like. Now, the app is getting even better, thanks to an update to the iOS version released by Microsoft.

Perhaps the most interesting new feature allows users to “explore photos by touch,” according to Microsoft. Specifically, users can now touch on a photo with their fingers to hear a description of a particular object within an image — making image descriptions a whole lot more detailed. With the feature, users can explore photos stored on the phone, photos on social media, and more.

A similar feature was already available in the app through the live camera view, allowing users to get descriptions of objects actually in front of them instead of just in an image.

There are other new features coming to the app, too. For example, the app now offers native iPad support, which could help produce an even better Seeing A.I. experience thanks to the larger display. Last but not least, the app offers improvements to the channels feature — for example, users can customize the order that channels are shown, which makes it easier to quickly access certain features.

This is the first time, the Seeing A.I. app has received a major update in a while. After launching in 2017, it received a major update a few months later, which added color recognition, identification of bank notes in four different currencies, light detection, and handwriting recognition. While the new update perhaps isn’t as major as that one was, it should still make Seeing A.I. a whole lot more useful for users.

Seeing A.I. is currently only available on iOS, though hopefully, it will eventually make it to Android. After all, the Android operating system is the most popular mobile operating system in the world, and Seeing A.I. would bring Microsoft’s arguably revolutionary tech to a whole lot more people who could make use of it.

Editors' Recommendations

Christian de Looper
Christian’s interest in technology began as a child in Australia, when he stumbled upon a computer at a garage sale that he…
Microsoft quits its creepy, emotion-reading A.I.
blonde woman with an expressionless face looks at camera while laser lights scan her features

Microsoft announced it will stop the development and distribution of controversial emotion-reading software as big tech companies pivot toward privacy and security. The company also says it will heavily restrict its own facial recognition platform.

Microsoft’s shift away from emotional recognition software is another sign of big tech’s growing prioritization of privacy. The company also admits there is little scientific evidence behind the technology.

Read more
Update your Mac now to fix vulnerability that gives full access to spying apps
Stock photo of laptop with code on its screen

Microsoft is warning Mac users to update to the latest version of MacOS Monterey after it found a vulnerability in Apple's Transparency, Consent, and Control (TCC) feature.

Exploiting this vulnerability could allow malicious actors to spoof the TCC and plant malware or hijack another app on the computer.

Read more
Apple will now let you fix your own iPhone in win for right-to-repair campaigners
iPhone 13 Pro style shot.

Apple will finally let iPhone users repair their own iPhones, the company announced this week. It will start this effort with the iPhone 12 and iPhone 13 series, with an expansion to older iPhones and more of its product lines in the near future. Dubbed Self Service Repair, it is aimed at those customers who have the experience, skills, and willingness to get hands-on with product repairs. The company will send (or rather, sell) people parts, tools, and a manual in what is a huge win for right-to-repair campaigners.

The new Apple Self Service Repair Online Store will offer more than 200 individual parts and tools for sale.  Apple also noted that these customers who get access to the parts, tools, and manuals join a club of more than 5,000 Apple Authorized Service Providers and 2,800 Independent Repair Providers.

Read more