Skip to main content

Google and MIT’s automatic photo software can edit your shots before you take them

Deep Bilateral Learning for Real-Time Image Enhancement
Photo editing software often enhances a smartphone’s limited hardware, but what if those shots could be edited automatically — in real time? That’s the question researchers from the Massachusetts Institute of Technology (MIT) and Google asked when expanding an earlier machine-learning program that automatically improved shots after sending them to the cloud. Presented during this week’s Siggraph digital graphics conference, the new automatic photo software edits so quickly that the user actually sees the results on the screen in real time — before that shot is even taken.

The program is based on earlier MIT research that trained a computer to edit images automatically. Researchers taught that program how to automatically apply specific adjustments by feeding the system five variations of each image, all edited by a different photo editor. After repeating that process a few thousand times, the program learned how to identify and fix common image issues.

Recommended Videos

The new software is built on the same artificial intelligence platform but speeds up the program to the point where it completes edits in a tenth of the previous time. This allows the live view from the camera to show edits in real time instead of sending the shot to a cloud system for editing. So how did researchers achieve the speed boost? The output of the software actually isn’t an image, but an image formula. Calculating the changes (and only applying them if a photo is taken) speeds up the process.

Please enable Javascript to view this content

The original image is also divided into grids, a form of downsizing the image for faster editing without losing pixels in the final image. The program works on each of the divided sections at once, editing hundreds of pixels simultaneously instead of factoring every single pixel.

With those two changes, the program only needs about 100 megabytes to perform each image edit, while without those two modifications the same software needed 12 gigabytes.

The research is a growing trend of looking to computational photography to solve the shortcomings of the hardware that can fit inside of a smartphone. Unlike earlier programs, the automatic photo software from MIT and Google looks to solve one of computational photography’s biggest obstacles, the limited processing power of a mobile device. In the researcher’s experiment, the program applied a high-dynamic range algorithm in real time, boosting the image’s colors and range of light beyond what the hardware itself could achieve.

“This technology has the potential to be very useful for real-time image enhancement on mobile platforms,” said Jon Barron, a Google researcher who worked on the project. “Using machine learning for computational photography is an exciting prospect but is limited by the severe computational and power constraints of mobile phones. This paper may provide us with a way to sidestep these issues and produce new, compelling, real-time photographic experiences without draining your battery or giving you a laggy viewfinder experience.”

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Best drone deals: Get a cheap drone for $47 and more
The DJI Mini 3 Pro in flight with spring flowers in the background.

There is a lot to love about drones, especially if you're somebody who loves nature and photography, as it gives you a really interesting perspective on the world that wouldn't usually be accessible. That said, owning a drone is often seen as a really expensive hobby, with expensive brands like DJI easily costing thousands of dollars. Luckily, there are a lot of great budget-oriented options, including quality DJI alternatives, and a lot of them have great deals on them, bringing them down to as low as $46. We've collected a few of our favorites below — all of which make great gifts for the holidays for the person in your life who appreciates the revolutionary bird's-eye view they offer.

Of course, if you prefer a more traditional experience, you could always check out these GoPro deals and camera deals instead.
Radclo Mini Drone -- $46 $230 80% off

Read more
Astronaut’s photo shows Earth as you’ve never seen it before
Earth as seen from the space station.

NASA astronaut Don Pettit already has a long-held reputation for creating stunning space photography, and his latest effort will only bolster it.

Shared on social media on Thursday, the image (top) shows Earth as a blaze of streaking light, an effect created by using long and multiple exposures to capture cities at night across several continents.

Read more
This GoPro camera is $100 off at Walmart today
The GoPro Hero 12 Black Creator Edition set up on a small tripod on the beach.

When it comes to high-octane sports and other speedy scenarios, our phone cameras can only do so much to capture the action. That’s why there’s such a big market for action cameras, and one of the O.G. camera companies in this realm is GoPro. For years, GoPro has been delivering HD and 4K cameras that are both durable and user-friendly, which is why we’re glad to shine a light on this fantastic offer we found while vetting Walmart deals:

When you purchase the GoPro Hero 12 at Walmart, you’ll pay $300. At full price, this model sells for $400.

Read more