Skip to main content
  1. Home
  2. Mobile
  3. News

Android P’s Lookout app uses camera to help visually impaired ‘see’

Brenda Stolyar
By
Image used with permission by copyright holder
Sundar Pichai stands in front of a Google logo at Google I/O 2021.
This story is part of our complete Google I/O coverage

At this year’s Google I/O developer conference, the Android accessibility services team announced new changes coming to Android P in order to make the operating system easier to use for everyone. In preparation for Google’s release of Android P, the team added a slew of new features that allow users to accomplish more tasks easier than ever.

Here are all the new accessibility features to expect on Android P in the near future.

Recommended Videos

Lookout

Image used with permission by copyright holder

Coming out in the U.S. this summer on Pixel devices (Android Oreo and above), Lookout is meant to help blind and visually impaired people learn about their surroundings. Lookout is able to capture live imagery of the scene by detecting objects, people, text, and more, and then decsribe it to them out loud. After opening the app, you’ll be able to select a mode — work and play, home, scan, and experimental. Lookout will then be able to share information such as text from a recipe book or the location of an exit sign, depending on the mode you choose.

Related

The app is specifically meant to act as a personal guide without interrupting the activity the user in engaging in by having to look at the screen. It’s designed to allow users to wear their Pixel on a lanyard or in their shirt pocket and interact with it using external controls. This includes knocking on the device to begin recognition, covering the camera to pause it, or using the fingerprint sensor to switch between different modes. Lookout can also be used without an internet connection.

Sound Amplifier

Image used with permission by copyright holder

Whether it’s trying to have a conversation with your friend at a loud restaurant or taking a call in a crowded airport, being able to clearly hear someone can be tough depending on your surroundings. With Sound Amplifier, users will now be able to turn down the noise and boost the signal using a smartphone and a pair of headphones — making it easier to understand conversations in loud environments.

Using the two sliders, the feature will allow you to control the loudness and tuning, including for each ear separately. You can therefore increase the volume of someone who speaks softly or adjust the volume on the TV so that it’s not too loud or too quiet for everyone else who’s watching.

Select to Speak with OCR

Image used with permission by copyright holder

Currently available in the Android P beta, Select to Speak with optical character recognition is now available in the camera app and within pictures. After selecting  it while pointing your camera or in a photo you already took, Select to Speak will read text out loud and highlight it.

In a demo during the conference, the feature looked simple to use. By opening the camera, tapping the accessibility button in the corner, and selecting the specific text, you’ll hear your device speak what’s written out loud.

Accessibility menu

Image used with permission by copyright holder

Taking a screenshot with one hand or performing specific gestures can be difficult for those with physical disabilities. Accessibility menu simplifies functions like power off, lock screen, take screen shot, and volume control along with gestures like swipe up, swipe down, and more. It’ll also allow you to enable the Google Assistant or instantly tap through to accessibility settings. Located at the bottom of the screen, the menu is designed to include large touch targets for reachability for those with smaller hands or limited reach and works in both portrait and landscape mode.

Morse Code input in Gboard

Image used with permission by copyright holder

Google has added Morse code input to Gboard — its mobile keyboard app. Currently available in beta, users can customize the Morse code settings to align with their specific needs. It can also be used with Switch Access, allowing you to use the feature with outside devices as well. After switching to the Morse code layout, you’ll then be able to enter text using the dot and dash from Morse code. Above, you’ll also see a variety of word suggestions above the keyboard.

Editors' Recommendations

Topics
Brenda Stolyar
Brenda Stolyar
Former Digital Trends Contributor
Brenda became obsessed with technology after receiving her first Dell computer from her grandpa in the second grade. While…
5 things we’d love to see at Google I/O 2023 (but probably won’t)
Google Pixel Watch on a wrist.

Google's annual developer conference, Google I/O, kicks off on May 10. Don't let the words "developer conference" put you off, though, as Google I/O is one of the biggest and most exciting shows of the year.

We've already covered what we expect to see at Google I/O 2023, and that list includes the Pixel 7a, Android 14, and even a Google Pixel Fold. But although those are all things we're really looking forward to and expecting to see, there are a number of reveals we'd also love to happen ... but are extremely unlikely to appear on the grand stage.

Read more
I’ve used Android phones for 10 years, and I hate these ones the most
pixel 4 xl rear sticking out

I’ve been using and reviewing Android smartphones for at least a decade, and during that time, I’ve spent time with a massive variety of devices that mostly fall into three distinct categories: good, passable, and bad. But what about the ones that have really stirred my emotions in a negative way? The phones that have elicited a visceral, guttural response? I’m not talking about the ones I love, but the ones I’ve downright hated.

Here are the six models that have irked me the most over the last 10 years of using and reviewing smartphones, and the reasons why they’ve made this list.
Google Pixel 4

Read more
Google I/O 2023 is happening on May 10 with an in-person event

It's that time of year once again. The days are getting longer, the gray skies of winter are slowly fading away, and it's almost time for another Google I/O. While it's a given that we have a new I/O each year, Google always puts on a little show when announcing the date for the next one. And now, we officially know when Google I/O 2023 will take place.

The opening keynote for this year's I/O is taking place at the Shoreline Amphitheater in Mountain View, California. In its email confirming the time and date, Google says, "Join a select audience to learn about Google’s latest innovations and developer solutions that help you work smarter and improve productivity." The opening keynote for I/O 2023 — where most of the big news and announcements are revealed — kicks off at 10 a.m. PT on May 10.

Read more