Skip to main content

Smartphones suck at low-light photos, but the right software could fix that

florian kainz low light smartphone experiment raw 2016 06 20 21 17 45 471 header
Florian Kainz / Google Research
When the average person accepts a dare, the result may range anywhere from a few stitches to some embarrassing photos. But when a Google software engineer accepts a challenge, the result might just be a solution that solves a common problem.

After Florian Kainz, of Google Research’s Gcam team, showed his co-workers a night landscape he’d shot with a DSLR, he was challenged to take the same photo, but with a smartphone. The result? A peek at a shooting and editing process, which he documented in a Google blog post, could eventually wind up in future Google smartphones, like the Pixel.

Related Videos

Kainz took inspiration from the HDR+ mode that combines multiple smartphone photos for better quality, as well as SeeInTheDark, an experimental app that produces low-light images by merging photos and dropping the resolution to a single megapixel. Using similar multiple-shot techniques, Kainz set out to see if he could shoot a photo in the dark but without the noisy images from SeeInTheDark or the limitations of HDR+.

He decided to use a similar bracketing method of merging multiple photos together to get better – and brighter – results. Unlike the automatic HDR+ feature, he merged long exposures instead of images taken at a tenth of a second, using the smartphone’s longest available shutter speed (four seconds for the Nexus 6P and two seconds for the Pixel). The longer exposures would be brighter and merging multiple brighter photos would produce better results, he theorized.

But first, he had to tackle the challenges all cameras face in the dark: focusing. Cameras need light to focus, which means even DSLR users need to switch to manual focus to shoot at night. Kainz then had to program an app that allows the camera’s focus to be manually set. For landscape photos, setting the camera’s focus at infinity worked for most of the subjects he shot, he wrote. The app also allowed him to control the shutter speed and ISO, as well as shooting in DNG, a type of digital negative with more control over the editing process.

Manual camera apps aren’t anything new, but Kainz’s experimental app also shot up to 64 single photos with one press of the shutter button – over six times the maximum ten frames the HDR+ will capture. To test the app, he shot at a number of locations during the light of a full moon as well as nights with no moon.

Kainz was able to successfully shoot low-light shots with detail not possible before, including capturing the Milky Way.

Those shots, with as many as 64 single photos including some black exposures with tape over the lens, were then taken into a desktop photo editing program and merged to eliminate the grain of high ISO. In scenarios where the ground or sky wasn’t sharp, he combined the images using layer masks to determine which parts of which photo showed in the final image.

The result? While the resolution still isn’t the same as a DSLR, Kainz was able to successfully shoot low-light shots with detail not possible before, including capturing the Milky Way.

While the process still requires a tripod, Kainz says an app that could handle the merging of those 64 photos could make low-light photography from a smartphone more accessible, even for users that have no idea how to merge 64 photos or how to use layer masks. “Trying to find out if phone cameras might be suitable for outdoor nighttime photography was a fun experiment, and clearly the result is yes, they are,” he wrote. “However, arriving at the final images required a lot of careful post-processing on a desktop computer, and the procedure is too cumbersome for all but the most dedicated cellphone photographers. However, with the right software a phone should be able to process the images internally, and if steps such as painting layer masks by hand can be eliminated, it might be possible to do point-and-shoot photography in very low-light conditions.”

Kainz doesn’t say whether Google is working on an app that could do all the heavy processing without a desktop computer, but he says the software might just be possible. To see the rest of the shots from the experiment, check out Kainz’ Google Photos album.

Editors' Recommendations

The Pixel 8 just leaked, and it has one big thing I can’t wait for
Google Pixel 8 in depicted in white.

For another year, Google’s next-gen phones are out in the wild months ahead of their grand reveal at a fancy event. Just a day ago, the Pixel 8 Pro was unceremoniously leaked, and now, the standard Pixel 8 has also received the same treatment. OnLeaks and MySmartPrice have shared reported renders and a 360-degree video depicting the upcoming Google phone from all angles.
The design changes are subtle, but easy on the eyes. Just like the Pixel 8 Pro, the corners are once again more rounded on the Pixel 8. The frame is metallic, and there’s a horizontal camera strip at the back with a metallic luster on top. Akin to the Pixel 7, we get two cameras on the Pixel 8, sitting in a pill-shaped cutout.

Another small aesthetic tweak is the earpiece grill at the top, which is now more prominent than what we saw on the Pixel 7 and Pixel 7 Pro. If the current-gen Pixels are any indication, the Pixel 8 is going to offer an excellent in-hand feel. Talking about in-hand feel, though, it appears that Google is once again pandering to the small phone loyalists.

Read more
5 things we’d love to see at Google I/O 2023 (but probably won’t)
Google Pixel Watch on a wrist.

Google's annual developer conference, Google I/O, kicks off on May 10. Don't let the words "developer conference" put you off, though, as Google I/O is one of the biggest and most exciting shows of the year.

We've already covered what we expect to see at Google I/O 2023, and that list includes the Pixel 7a, Android 14, and even a Google Pixel Fold. But although those are all things we're really looking forward to and expecting to see, there are a number of reveals we'd also love to happen ... but are extremely unlikely to appear on the grand stage.

Read more
Why the $450 Samsung Galaxy A54 may be 2023’s most savvy smartphone buy
The green and purple Galaxy A54's camera modules.

-Samsung’s Galaxy A Series has long been a great choice for people who want Galaxy S Series style without the S Series price. The Galaxy A54 and Galaxy A34 are the latest, and Samsung isn’t being shy about giving these phones the latest flagship look.

Even better news is that the A54 continues to provide a great screen, long battery life, a decent camera, and solid everyday features you’ll love — all for a value-driven price. Could the new Galaxy A54 phone be 2023’s savviest smartphone buys? I tried it out for a short time to find out.
Getting the Awesome colors right

Read more