Skip to main content

Microsoft’s Seeing A.I. app now lets users explore photos by touch

The Microsoft Seeing A.I. app was first announced in 2017 and was an instant hit for many vision-impaired users. The app essentially uses artificial intelligence to describe what’s in a photo, allowing blind and low vision users to get an idea of what an image looks like. Now, the app is getting even better, thanks to an update to the iOS version released by Microsoft.

Perhaps the most interesting new feature allows users to “explore photos by touch,” according to Microsoft. Specifically, users can now touch on a photo with their fingers to hear a description of a particular object within an image — making image descriptions a whole lot more detailed. With the feature, users can explore photos stored on the phone, photos on social media, and more.

A similar feature was already available in the app through the live camera view, allowing users to get descriptions of objects actually in front of them instead of just in an image.

There are other new features coming to the app, too. For example, the app now offers native iPad support, which could help produce an even better Seeing A.I. experience thanks to the larger display. Last but not least, the app offers improvements to the channels feature — for example, users can customize the order that channels are shown, which makes it easier to quickly access certain features.

This is the first time, the Seeing A.I. app has received a major update in a while. After launching in 2017, it received a major update a few months later, which added color recognition, identification of bank notes in four different currencies, light detection, and handwriting recognition. While the new update perhaps isn’t as major as that one was, it should still make Seeing A.I. a whole lot more useful for users.

Seeing A.I. is currently only available on iOS, though hopefully, it will eventually make it to Android. After all, the Android operating system is the most popular mobile operating system in the world, and Seeing A.I. would bring Microsoft’s arguably revolutionary tech to a whole lot more people who could make use of it.

Editors' Recommendations

Christian de Looper
Christian’s interest in technology began as a child in Australia, when he stumbled upon a computer at a garage sale that he…
Update your Mac now to fix vulnerability that gives full access to spying apps
Stock photo of laptop with code on its screen

Microsoft is warning Mac users to update to the latest version of MacOS Monterey after it found a vulnerability in Apple's Transparency, Consent, and Control (TCC) feature.

Exploiting this vulnerability could allow malicious actors to spoof the TCC and plant malware or hijack another app on the computer.

Read more
Apple will now let you fix your own iPhone in win for right-to-repair campaigners
iPhone 13 Pro style shot.

Apple will finally let iPhone users repair their own iPhones, the company announced this week. It will start this effort with the iPhone 12 and iPhone 13 series, with an expansion to older iPhones and more of its product lines in the near future. Dubbed Self Service Repair, it is aimed at those customers who have the experience, skills, and willingness to get hands-on with product repairs. The company will send (or rather, sell) people parts, tools, and a manual in what is a huge win for right-to-repair campaigners.

The new Apple Self Service Repair Online Store will offer more than 200 individual parts and tools for sale.  Apple also noted that these customers who get access to the parts, tools, and manuals join a club of more than 5,000 Apple Authorized Service Providers and 2,800 Independent Repair Providers.

Read more
Google One subscribers now have enhanced photo-editing tools on iPhones
Pixel 6 Pro and iPhone 13 Pro in hand.

Google One subscribers on iPhones can now tweak portrait photos and HDR levels in the Google Photos app as part of a new subscription perk. The change was spotted by 9to5Google and follows a broader rollout to Android phones that started in February.

If you're running iOS 14.0 and have an iPhone with 3GB of RAM -- essentially the iPhone 7 Plus, 8 Plus, X, and above -- you'll be able to make use of these new tools. The first of these features is portrait lighting, which lets you change the position of light sources in portrait photos. There's also a "blur" a tool that allows for the addition of retroactive software blur on images captured without portrait mode.

Read more