Skip to main content

Microsoft’s Seeing A.I. app now lets users explore photos by touch

The Microsoft Seeing A.I. app was first announced in 2017 and was an instant hit for many vision-impaired users. The app essentially uses artificial intelligence to describe what’s in a photo, allowing blind and low vision users to get an idea of what an image looks like. Now, the app is getting even better, thanks to an update to the iOS version released by Microsoft.

Perhaps the most interesting new feature allows users to “explore photos by touch,” according to Microsoft. Specifically, users can now touch on a photo with their fingers to hear a description of a particular object within an image — making image descriptions a whole lot more detailed. With the feature, users can explore photos stored on the phone, photos on social media, and more.

A similar feature was already available in the app through the live camera view, allowing users to get descriptions of objects actually in front of them instead of just in an image.

There are other new features coming to the app, too. For example, the app now offers native iPad support, which could help produce an even better Seeing A.I. experience thanks to the larger display. Last but not least, the app offers improvements to the channels feature — for example, users can customize the order that channels are shown, which makes it easier to quickly access certain features.

This is the first time, the Seeing A.I. app has received a major update in a while. After launching in 2017, it received a major update a few months later, which added color recognition, identification of bank notes in four different currencies, light detection, and handwriting recognition. While the new update perhaps isn’t as major as that one was, it should still make Seeing A.I. a whole lot more useful for users.

Seeing A.I. is currently only available on iOS, though hopefully, it will eventually make it to Android. After all, the Android operating system is the most popular mobile operating system in the world, and Seeing A.I. would bring Microsoft’s arguably revolutionary tech to a whole lot more people who could make use of it.

Editors' Recommendations

Christian de Looper
Christian’s interest in technology began as a child in Australia, when he stumbled upon a computer at a garage sale that he…
Apple users can now use Emergency SOS via satellite on iPhone 14
Person holding iPhone 14 searching for Emergency SOS satellite.

The highly anticipated Emergency SOS went live for iPhone 14 users on Tuesday, November 15. It was highlighted during Apple's Far Out event, which saw the release of iPhones, Apple Watches, and the next-gen AirPods Pro. The feature allows you to send messages using emergency services outside the cellular range. It is currently available to users in the U.S and Canada. Meanwhile, folks in France, Germany, Ireland, and the U.K. will have to wait until next month to get the same.

Recently, Apple said that it had to spend $450 million with U.S companies in order to get Emergency SOS via satellite rolling — with the majority of that money going to Globalstar, a Louisiana-based satellite operator. In an emergency, you can use the service by calling 911. Considering you are not in a cellular service region, a green SOS message button will appear saying “Emergency Text via Satellite.” After pressing the button, you will have to complete a multiple-choice questionnaire.

Read more
Wimbledon tennis returns along with IBM’s A.I.-powered app
twitter wimbledon live stream 23934787  centre court

Wimbledon is back again with another two weeks of top class tennis involving the world’s best players.

The prestigious sports tournament, which takes place a the All England Lawn Tennis Club in London, kicks off on Monday, June 27 and runs through Sunday, July 10.

Read more
Microsoft quits its creepy, emotion-reading A.I.
blonde woman with an expressionless face looks at camera while laser lights scan her features

Microsoft announced it will stop the development and distribution of controversial emotion-reading software as big tech companies pivot toward privacy and security. The company also says it will heavily restrict its own facial recognition platform.

Microsoft’s shift away from emotional recognition software is another sign of big tech’s growing prioritization of privacy. The company also admits there is little scientific evidence behind the technology.

Read more