Skip to main content
  1. Home
  2. Emerging Tech
  3. Photography
  4. Legacy Archives

Researchers develop a smartphone app that can help the blind take pictures

Add as a preferred source on Google

smartphotoThe idea of a blind photographer seems like an oxymoron at first; after all, the ability to see and frame the shot before snapping the picture seems like the most basic asset to photography. Not to researchers from the University of California at Santa Cruz. The team has developed a smartphone app that can help photographers take pictures without needing to see what’s in front of them.

The unnamed app is the work of a team led by Dustin Adams, and the technology builds on existing smartphone facial detection sensors to create something that will guide partially-sighted users to create perfect photographs (or something close to it, at least).

Recommended Videos

Adams and his team started by polling more than 50 people between the ages of 18 and 78, all of whom had some degree of visual impairment – from fully blind to slight light perception – about the problems they had taking photographs. Using their feedback as a baseline for “must-have” elements they needed to work on, the team found that the most necessary adaptation wasn’t just how to help frame the shot, but to also fix control placements.

So to that, the USCS team said goodbye to buttons. The test app is voice controlled, allowing the user to take a picture without finding the right shutter buttons on the screen. Instead of finding the app icon on the phone, users can activate the app with upward swipe gesture and the app will begin talking to the user to identify the number of people in the frame before the shot is taken.

Once activated, the camera has a 30 second countdown before the picture is taken. In that time, audio cues will continue to count the number of people in the frame, allowing the user time to get everyone in shot, and explain whether the subjects are in focus. In addition to the speech guidance, the app also records the user within that 30 second window and the user can choose to save that audio file in combination with the photo to help with organization or photo sharing. Of course, thanks to most smartphones’ standard of built-in GPS, pictures can be geotagged.

So it seems like the app is useful for taking photos of friends and family and not so much the things surrounding the vision-impaired, but at least it’s a start. Sadly, the app hasn’t been made available to the public just yet. Before that happens, the UCSC research team will present the findings of their study at the Pervasive Technologies Related to Assistive Environments conference in Rhodes, Greece, later this month. Perhaps after that, it won’t be long before anyone could become a better photographer, regardless of their skill level or eyesight.

Graeme McMillan
Former Digital Trends Contributor
A transplant from the west coast of Scotland to the west coast of America, Graeme is a freelance writer with a taste for pop…
This touchscreen is made from thread, and scientists want to put it in your clothes
The washable, breathable textile display can run simple apps, play videos, and even measure body temperature.
Garment GUI featured

Forget smartwatches. Scientists have developed a touchscreen that can be woven directly into clothing, letting users interact with digital content without carrying a rigid display. Researchers at the National University of Singapore (NUS) have integrated 54 specialised fibres into a sleeve to create what they describe as the world's first touchscreen built into a garment. Published in Nature, the research could open the door to clothing that does more than just look good. Your next smart outfit might actually be smart enough to show what's happening on your phone.

Your clothes could soon run apps

Read more
Scientists have figured out how to send smells over the internet, and coffee is just the beginning
The AI-powered Scentronic system can detect, transmit, and recreate five familiar aromas, bringing digital smell a step closer to reality.
Woman smelling sniffing drinking a cup of coffee

Imagine smelling freshly brewed coffee through a video call or getting a whiff of perfume before buying it online. Scientists are bringing that idea closer to reality with Scentronic, an AI-powered system that can detect smells, transmit scent data over the internet, and recreate aromas remotely. Developed by researchers from Ohio State University and Zhejiang Laboratory in China, the research, published in Science Advances, explores how digital scent transmission could add an entirely new dimension to online communication. Your next shopping session might literally come with a sniff test.

How does sending smells over the internet work?

Read more
Mori might be the cutest AI companion robot yet, and it reacts to you like a pet
The Pokémon-like companion can blink, dance, act shy, and respond to what is happening around it.
OKA Mori The Nature Companion AI Home Robot

With AI progressing so fast, it's only a matter of time before we start getting AI companions like the ones we used to see in movies like R2-D2, Wall-E, or Baymax. Now, Singapore-based OKA Technology has unveiled Mori, a cute little AI companion that looks less like a conventional home robot and more like someone turned the Pokémon Foongus into a table lamp.

Mori isn't meant to clean your house or control your smart home, but to serve as what OKA calls a "Nature Companion." It uses subtle movements, warm lighting, nature-inspired sounds, and small reactions to make its presence around the house feel calming rather than distracting. Mori can sit quietly while you read, sway along to music, welcome you when you enter a room, or encourage you to slow down for a moment without requiring a screen or a conversation.

Read more