Android P’s Lookout app uses camera to help visually impaired ‘see’

top tech stories 10 26 2017 dont buy your google pixel from verizon cropped

At this year’s Google I/O developer conference, the Android accessibility services team announced new changes coming to Android P in order to make the operating system easier to use for everyone. In preparation for Google’s release of Android P, the team added a slew of new features that allow users to accomplish more tasks easier than ever.

Here are all the new accessibility features to expect on Android P in the near future.


android p accessibility features lookout google

Coming out in the U.S. this summer on Pixel devices (Android Oreo and above), Lookout is meant to help blind and visually impaired people learn about their surroundings. Lookout is able to capture live imagery of the scene by detecting objects, people, text, and more, and then decsribe it to them out loud. After opening the app, you’ll be able to select a mode — work and play, home, scan, and experimental. Lookout will then be able to share information such as text from a recipe book or the location of an exit sign, depending on the mode you choose.

The app is specifically meant to act as a personal guide without interrupting the activity the user in engaging in by having to look at the screen. It’s designed to allow users to wear their Pixel on a lanyard or in their shirt pocket and interact with it using external controls. This includes knocking on the device to begin recognition, covering the camera to pause it, or using the fingerprint sensor to switch between different modes. Lookout can also be used without an internet connection.

Sound Amplifier

android p accessibility features sound amplifier

Whether it’s trying to have a conversation with your friend at a loud restaurant or taking a call in a crowded airport, being able to clearly hear someone can be tough depending on your surroundings. With Sound Amplifier, users will now be able to turn down the noise and boost the signal using a smartphone and a pair of headphones — making it easier to understand conversations in loud environments.

Using the two sliders, the feature will allow you to control the loudness and tuning, including for each ear separately. You can therefore increase the volume of someone who speaks softly or adjust the volume on the TV so that it’s not too loud or too quiet for everyone else who’s watching.

Select to Speak with OCR

android p accessibility features select to speak with ocr

Currently available in the Android P beta, Select to Speak with optical character recognition is now available in the camera app and within pictures. After selecting  it while pointing your camera or in a photo you already took, Select to Speak will read text out loud and highlight it.

In a demo during the conference, the feature looked simple to use. By opening the camera, tapping the accessibility button in the corner, and selecting the specific text, you’ll hear your device speak what’s written out loud.

Accessibility menu

android p accessibility features menu

Taking a screenshot with one hand or performing specific gestures can be difficult for those with physical disabilities. Accessibility menu simplifies functions like power off, lock screen, take screen shot, and volume control along with gestures like swipe up, swipe down, and more. It’ll also allow you to enable the Google Assistant or instantly tap through to accessibility settings. Located at the bottom of the screen, the menu is designed to include large touch targets for reachability for those with smaller hands or limited reach and works in both portrait and landscape mode.

Morse Code input in Gboard

android p accessibility features gboard morse code

Google has added Morse code input to Gboard — its mobile keyboard app. Currently available in beta, users can customize the Morse code settings to align with their specific needs. It can also be used with Switch Access, allowing you to use the feature with outside devices as well. After switching to the Morse code layout, you’ll then be able to enter text using the dot and dash from Morse code. Above, you’ll also see a variety of word suggestions above the keyboard.


Dozens of bite-sized features add up to a feast in Android 9.0 Pie

Google’s latest version of Android is here, and it’s called Android 9 Pie. We’ve been using it for the past few months on a Google Pixel to see how this flavor stacks up.

Customer data is compromised as hackers crack Newegg’s security

Online electronics retailer Newegg has found themselves at the heart of an online security breach as the company's payment system was breached, giving hackers of the notorious group, Magecart, potential access to confidential customer data…

Be an online phantom and web surf safely with Ghostery’s mobile browser

Keeping your private information to yourself has become progressively harder in the internet age. If you're worried about your personal information, check out the new version of the Ghostery browser for iOS and Android.
Social Media

How to turn off Snapchat’s location-based Snap Map

Thanks to an opt-in feature added last year, Snapchat may be sharing your location with friends whenever you open it. Here, we'll walk you through how to turn off said feature off and regain some peace of mind.

The best weather apps for the iPhone

Don't rely solely on your local meteorologist to stay up to date on the weather. Take matters into your own hands with one of these weather apps, each of which brings something unique to the table.

Updating to Apple’s iOS 12 will make your iPhone a whole lot smarter

iOS 12, the latest version of Apple’s iOS, is officially here. We took it for a spin to check out its new noteworthy features, and if it truly changes our smartphone habits for the better.

Google brings its high-accuracy emergency location tracking to the U.S.

Google has announced that its Emergency Location Service is coming to Android phones on T-Mobile, marking the service's U.S. debut. The service allows for high-accuracy location information to be sent to first responders.

OnePlus 6T may launch soon with in-display fingerprint sensor, dual cameras

According to a recent report, the launch of the OnePlus 6T could be different from any other OnePlus launch in history. How? It could have the backing of a major U.S. carrier. Here's everything we know about the OnePlus 6T.

Code found in iOS 12.1 beta suggests we will see a new iPad this fall

The new iPhone XS, iPhone XR, and Apple Watch aren't the last devices we'll see from Apple in 2018. There are plenty of rumors about a new iPad coming this year too, and it may share some design similarities with the new phones.

Cyber Monday 2018: When it takes place and where to find the best deals

Cyber Monday is still a ways off, but it's never too early to start planning ahead. With so many different deals to choose from during one of the biggest shopping holidays of the year, going in with a little know-how makes all the…

Fitbit’s new health care platform sets out to improve wellness in the workplace

Fitbit's new platform, Fitbit Care, aims to help improve wellness in the workplace. Using wearables, digital health coaching, and a more personalized health care experience, employees can have an easier time staying on top of their health.
Home Theater

Google Chromecast and Chromecast Ultra: Everything you need to know

Google's Chromecast plugs into your TV's HDMI port, allowing you to stream content from your tablet, laptop, or smartphone directly to your TV. Here's what you need to know about all iterations, including the 4K-ready Chromecast Ultra.

Samsung looks to Huawei for inspiration, and the new Galaxy A7 is born

Samsung has launched the Galaxy A7 smartphone, its first with a triple-lens rear camera, which, although sounds similar to the one fitted to the Huawei P20 Pro, works in a different way.

The Huawei Mate 20 Pro's body may wirelessly charge new Bluetooth headphones

Huawei is no stranger when it comes to big phones. And this year it plans to go even bigger with the Huawei Mate 20 and Mate 20 Pro. Here's what we think we know about the new range.