Skip to main content

Researchers develop a smartphone app that can help the blind take pictures

smartphotoThe idea of a blind photographer seems like an oxymoron at first; after all, the ability to see and frame the shot before snapping the picture seems like the most basic asset to photography. Not to researchers from the University of California at Santa Cruz. The team has developed a smartphone app that can help photographers take pictures without needing to see what’s in front of them.

The unnamed app is the work of a team led by Dustin Adams, and the technology builds on existing smartphone facial detection sensors to create something that will guide partially-sighted users to create perfect photographs (or something close to it, at least).

Adams and his team started by polling more than 50 people between the ages of 18 and 78, all of whom had some degree of visual impairment – from fully blind to slight light perception – about the problems they had taking photographs. Using their feedback as a baseline for “must-have” elements they needed to work on, the team found that the most necessary adaptation wasn’t just how to help frame the shot, but to also fix control placements.

So to that, the USCS team said goodbye to buttons. The test app is voice controlled, allowing the user to take a picture without finding the right shutter buttons on the screen. Instead of finding the app icon on the phone, users can activate the app with upward swipe gesture and the app will begin talking to the user to identify the number of people in the frame before the shot is taken.

Once activated, the camera has a 30 second countdown before the picture is taken. In that time, audio cues will continue to count the number of people in the frame, allowing the user time to get everyone in shot, and explain whether the subjects are in focus. In addition to the speech guidance, the app also records the user within that 30 second window and the user can choose to save that audio file in combination with the photo to help with organization or photo sharing. Of course, thanks to most smartphones’ standard of built-in GPS, pictures can be geotagged.

So it seems like the app is useful for taking photos of friends and family and not so much the things surrounding the vision-impaired, but at least it’s a start. Sadly, the app hasn’t been made available to the public just yet. Before that happens, the UCSC research team will present the findings of their study at the Pervasive Technologies Related to Assistive Environments conference in Rhodes, Greece, later this month. Perhaps after that, it won’t be long before anyone could become a better photographer, regardless of their skill level or eyesight.

Editors' Recommendations

Graeme McMillan
Former Digital Trends Contributor
A transplant from the west coast of Scotland to the west coast of America, Graeme is a freelance writer with a taste for pop…
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more
AI turned Breaking Bad into an anime — and it’s terrifying
Split image of Breaking Bad anime characters.

These days, it seems like there's nothing AI programs can't do. Thanks to advancements in artificial intelligence, deepfakes have done digital "face-offs" with Hollywood celebrities in films and TV shows, VFX artists can de-age actors almost instantly, and ChatGPT has learned how to write big-budget screenplays in the blink of an eye. Pretty soon, AI will probably decide who wins at the Oscars.

Within the past year, AI has also been used to generate beautiful works of art in seconds, creating a viral new trend and causing a boon for fan artists everywhere. TikTok user @cyborgism recently broke the internet by posting a clip featuring many AI-generated pictures of Breaking Bad. The theme here is that the characters are depicted as anime characters straight out of the 1980s, and the result is concerning to say the least. Depending on your viewpoint, Breaking Bad AI (my unofficial name for it) shows how technology can either threaten the integrity of original works of art or nurture artistic expression.
What if AI created Breaking Bad as a 1980s anime?
Playing over Metro Boomin's rap remix of the famous "I am the one who knocks" monologue, the video features images of the cast that range from shockingly realistic to full-on exaggerated. The clip currently has over 65,000 likes on TikTok alone, and many other users have shared their thoughts on the art. One user wrote, "Regardless of the repercussions on the entertainment industry, I can't wait for AI to be advanced enough to animate the whole show like this."

Read more