Skip to main content
  1. Home
  2. Mobile
  3. News

Android P’s Lookout app uses camera to help visually impaired ‘see’

Brenda Stolyar
By

At this year’s Google I/O developer conference, the Android accessibility services team announced new changes coming to Android P in order to make the operating system easier to use for everyone. In preparation for Google’s release of Android P, the team added a slew of new features that allow users to accomplish more tasks easier than ever.

Here are all the new accessibility features to expect on Android P in the near future.

Related Videos

Lookout

Coming out in the U.S. this summer on Pixel devices (Android Oreo and above), Lookout is meant to help blind and visually impaired people learn about their surroundings. Lookout is able to capture live imagery of the scene by detecting objects, people, text, and more, and then decsribe it to them out loud. After opening the app, you’ll be able to select a mode — work and play, home, scan, and experimental. Lookout will then be able to share information such as text from a recipe book or the location of an exit sign, depending on the mode you choose.

The app is specifically meant to act as a personal guide without interrupting the activity the user in engaging in by having to look at the screen. It’s designed to allow users to wear their Pixel on a lanyard or in their shirt pocket and interact with it using external controls. This includes knocking on the device to begin recognition, covering the camera to pause it, or using the fingerprint sensor to switch between different modes. Lookout can also be used without an internet connection.

Sound Amplifier

Whether it’s trying to have a conversation with your friend at a loud restaurant or taking a call in a crowded airport, being able to clearly hear someone can be tough depending on your surroundings. With Sound Amplifier, users will now be able to turn down the noise and boost the signal using a smartphone and a pair of headphones — making it easier to understand conversations in loud environments.

Using the two sliders, the feature will allow you to control the loudness and tuning, including for each ear separately. You can therefore increase the volume of someone who speaks softly or adjust the volume on the TV so that it’s not too loud or too quiet for everyone else who’s watching.

Select to Speak with OCR

Currently available in the Android P beta, Select to Speak with optical character recognition is now available in the camera app and within pictures. After selecting  it while pointing your camera or in a photo you already took, Select to Speak will read text out loud and highlight it.

In a demo during the conference, the feature looked simple to use. By opening the camera, tapping the accessibility button in the corner, and selecting the specific text, you’ll hear your device speak what’s written out loud.

Accessibility menu

Taking a screenshot with one hand or performing specific gestures can be difficult for those with physical disabilities. Accessibility menu simplifies functions like power off, lock screen, take screen shot, and volume control along with gestures like swipe up, swipe down, and more. It’ll also allow you to enable the Google Assistant or instantly tap through to accessibility settings. Located at the bottom of the screen, the menu is designed to include large touch targets for reachability for those with smaller hands or limited reach and works in both portrait and landscape mode.

Morse Code input in Gboard

Google has added Morse code input to Gboard — its mobile keyboard app. Currently available in beta, users can customize the Morse code settings to align with their specific needs. It can also be used with Switch Access, allowing you to use the feature with outside devices as well. After switching to the Morse code layout, you’ll then be able to enter text using the dot and dash from Morse code. Above, you’ll also see a variety of word suggestions above the keyboard.

Editors' Recommendations

Topics
Google is making Android better for the visually impaired
Android 13 at Google I/O.

Google is bringing enhanced support for braille in Android with the next major update coming this fall. The company announced this on Global Accessibility Awareness Day. The move comes after a similar announcement by Apple earlier in the week.

In Android 12 and lower, people with visual impairments who needed braille displays to comfortably use their phones would need to download the BrailleBack app from the Play Store and connect their Android device to a braille display. The company is now building support for braille displays directly into Android itself. It'll be available for testing in Android 13 Beta 3, set for launch in July.

Read more
Google launches Switch to Android app to chirping crickets
Switch to Android app displaying Step 2 of 4 for transferring data from iPhone to new Android device.

Google has quietly launched the Switch to Android app on the App Store to the sound of chirping crickets. As reported by TechCrunch, the tech giant rolled out the app on Monday to make it easier for users who want to switch to an Android device, whether they want to try out Android for the first time or they just miss having one of the best Android phones in their hand. It was a quiet launch, so nobody paid any mind to it -- until now.

The Switch to Android website gives you steps on how to copy all the data in your iPhone -- contacts, photos, videos, calendar events, etc. -- and send them to the new Android device of your choice. It also instructs you to turn off iMessage, so you'll be able to see important text messages once you open your new device, and request Apple to transfer a copy of your data from iCloud. The app works in a similar manner to Move to iOS, which Apple launched in 2015 to ease users' transition from Android to iPhone.

Read more
Google adds more iMessage features to Android’s Messages app
Google Pixel 6 Pro wallpaper.

Google is upgrading Android's default messages app with support for iMessage reactions and enhanced media sharing as it tries to lure over customers from Apple's iPhones over to Pixels and other Android phones. The new updates are rolling out this week to the U.S. and some worldwide countries.

The biggest change Google is bringing here is support for iMessage reactions, or tapbacks. While Google supports reactions between Android phones, and iPhones support reactions between iPhones, this is the first time both are being cross-compatible -- kind of. iPhone users will now have their tapbacks converted to emoji on Android phones, but Android users will still remain unable to send reactions to iPhones. This does mean an end to "Laughed at," style messages, for Android users at least.

Read more