Skip to main content
  1. Home
  2. Emerging Tech
  3. Photography
  4. Legacy Archives

Researchers develop a smartphone app that can help the blind take pictures

Add as a preferred source on Google

smartphotoThe idea of a blind photographer seems like an oxymoron at first; after all, the ability to see and frame the shot before snapping the picture seems like the most basic asset to photography. Not to researchers from the University of California at Santa Cruz. The team has developed a smartphone app that can help photographers take pictures without needing to see what’s in front of them.

The unnamed app is the work of a team led by Dustin Adams, and the technology builds on existing smartphone facial detection sensors to create something that will guide partially-sighted users to create perfect photographs (or something close to it, at least).

Recommended Videos

Adams and his team started by polling more than 50 people between the ages of 18 and 78, all of whom had some degree of visual impairment – from fully blind to slight light perception – about the problems they had taking photographs. Using their feedback as a baseline for “must-have” elements they needed to work on, the team found that the most necessary adaptation wasn’t just how to help frame the shot, but to also fix control placements.

So to that, the USCS team said goodbye to buttons. The test app is voice controlled, allowing the user to take a picture without finding the right shutter buttons on the screen. Instead of finding the app icon on the phone, users can activate the app with upward swipe gesture and the app will begin talking to the user to identify the number of people in the frame before the shot is taken.

Once activated, the camera has a 30 second countdown before the picture is taken. In that time, audio cues will continue to count the number of people in the frame, allowing the user time to get everyone in shot, and explain whether the subjects are in focus. In addition to the speech guidance, the app also records the user within that 30 second window and the user can choose to save that audio file in combination with the photo to help with organization or photo sharing. Of course, thanks to most smartphones’ standard of built-in GPS, pictures can be geotagged.

So it seems like the app is useful for taking photos of friends and family and not so much the things surrounding the vision-impaired, but at least it’s a start. Sadly, the app hasn’t been made available to the public just yet. Before that happens, the UCSC research team will present the findings of their study at the Pervasive Technologies Related to Assistive Environments conference in Rhodes, Greece, later this month. Perhaps after that, it won’t be long before anyone could become a better photographer, regardless of their skill level or eyesight.

Graeme McMillan
Former Digital Trends Contributor
A transplant from the west coast of Scotland to the west coast of America, Graeme is a freelance writer with a taste for pop…
The camera on my smart glasses gives me the ick. The people around me feel the same.
Hey, stranger, you won't know it, but I just captured you in a picture and recorded you in a video!
Person wearing glasses with a camera

"Dude, I feel like a creep every time I press the camera button and the LED lights up." That was the blunt verdict from a friend who tried my camera-equipped smart glasses earlier today. My own feelings aren't too different. There's also a functional friction here, which I'll rant about soon enough.

I've used plenty of smart glasses. For the past four years or so, even before Meta flooded the market with its Ray-Ban-branded camera glasses, I've been playing around with another breed that lacked a camera but still offered plenty of fun. Brands like Rokid, XREAL, and Viture have been selling smart glasses with a built-in display unit, promising a private screen that sits right on your face. Immersive entertainment, or spatial computing on the go, all of it without a monitor in sight.

Read more
E Ink’s new color screen could make PDFs and digital notebooks easier on the eyes
Color e-paper wants a day job beyond reading books.
Advertisement, Poster, Animal

Color e-paper has always felt like a compromise to me. You get color, but the text loses some of its crisp, printed-page look. That’s always been my biggest gripe with color e-readers.

Turns out, E Ink has a solution called Kaleido 4, the latest version of its color e-paper platform, and it already ships on Hanvon’s M10C II notebook.

Read more
Xreal’s latest AR glasses fix the brightness problem, but leave the rest largely untouched
Accessories, Sunglasses, Glasses

AR glasses sound magical until I imagine wearing them somewhere bright. That’s why a new pair launched today caught my eye.

Xreal's 1 Pro Plus refreshes its One Pro glasses (which float a virtual screen in front of your eyes). It packs a much brighter display than the outgoing model and smoother 2D-to-3D conversion. You can buy it now for $599.

Read more