Skip to main content

Neural Photo Editor works like magic thanks to machine learning

Neural Photo Editing with Introspective Adversarial Networks
Neural Photo Editor is an experimental piece of retouching software from researchers at the University of Edinburgh that uses neural networks to act like Photoshop on steroids. Thanks to machine learning, it can intuitively interpret how a user intends to retouch a photo based on a “contextual paintbrush.” A single brush can change hair color, fill in bald spots, or add a toothy grin.

The process couldn’t be simpler: Users select a color for their paintbrush and the system analyzes that color in context with the image in order to produce an intelligent output. Painting over a subject’s mouth with a white brush, for example, can make a smile larger, while painting with a dark color on a forehead can add bangs.

The software currently works best on images generated by it that have constrained limits on what can be manipulated. However, through the use of “introspective adversarial networks,” an advanced masking system allows it to be applied to existing images, as well.

The tech-savvy can download Neural Photo Editor from Github, but don’t go canceling your Adobe Creative Cloud subscription anytime soon. The tool is very much in its early days and is far from perfect. While it produces stable outcomes much of the time, it can still lead to bizarre results on occasion, as the video above demonstrates. The video also shows the system working with very low-resolution images, so the practical applications for such a tool for photographers are currently nonexistent.

Still, it is an intriguing look at how photo editing could evolve in the future to be smarter and more context-aware, significantly increasing the speed at which a photo could be majorly retouched. It also represents a practical application for the general use of neural networks in personal computing.

Editors' Recommendations

Daven Mathies
Former Digital Trends Contributor
Daven is a contributing writer to the photography section. He has been with Digital Trends since 2016 and has been writing…
Fujifilm’s most-hyped camera has just started shipping
Fujifilm's X100VI camera, released in 2024.

The latest iteration of Fujifilm’s X100 camera started shipping on Wednesday.

The X100VI is -- as the name cleverly suggests -- the sixth in the series. Early reviews have been mostly positive as the camera builds on the successes of the already impressive earlier models going all the way back to the original X100, which launched in 2011.

Read more
How to resize an image on Mac, Windows, and a Chromebook
Windows 11 set up on a computer.

Resizing an image is something we’re all going to have to do at some point in our digital lives. And whether you’re using Windows, macOS, or you’re rocking a Chromebook, there are ways to scale images up and down on each PC. Fortunately, these are all relatively simple methods too.

Read more
Watch an acclaimed director use the iPhone 15 Pro to shoot a movie
acclaimed director uses iphone 15 to shoot movie shot on pro midnight

Shot on iPhone 15 Pro | Midnight | Apple

As part of its long-running Shot on iPhone series, Apple recently handed acclaimed Japanese director Takashi Miike (Audition, 13 Assassins, The Happiness of the Katakuris) an iPhone 15 Pro to shoot a short film.

Read more