Skip to main content

Forget turning photos into paintings, this software copies another photo’s style

adobe cornell deep photo style trasfer adoberesearch
In this screenshot from the research report, the original image is listed first, the reference image second and the new software's result last, with previous programs in between. Adobe Research / Cornell University
Turning a photo into a painting is now simple thanks to artificially intelligent apps like Prisma, but research from Adobe and Cornell University suggests that style transfers could work from photo to photo. The research team developed a deep photo style transfer program that used a reference image to adjust the original image, mimicking the reference photo’s lighting and colors — even the weather, time of day, and season.

The research, published on March 22, builds on the artificial intelligence behind applications like Prisma, but instead aims to apply photorealistic effects instead of making that photo look like a certain painting style. Previous efforts to conduct automatic style transfers from photo to photo were either inconsistent in style matches or unable to handle a variety of different photos without obvious distortions. Photo-to-photo style transfers often resulted in distorted lines and perspectives, so instead the team from Adobe and Cornell developed a system that only considers color and lighting.

The new method, along with disregarding everything but that color and light information, also segments the photos into different parts, so the light in the sky of the reference picture is applied to only the sky in the second picture, even if the sky takes up a different amount of space than in that reference image. Since the system segments aspects, the effect is applied to the sky, not to the same area the sky takes up in the reference photograph.

By separating out the parts of the image and considering only color and light data, the software was able to successfully take a photo of a cityscape taken on a cloudy day and turn it into a cityscape at dusk, even turning the lights on inside some of the buildings. Since the system considers color, effects like shooting during golden hour could be mimicked, along with turning a summer photo into a fall scene.

The potential software appears to be more consumer-oriented than something that might make its way into Photoshop or Lightroom, but the program leaves opens up some interesting avenues. If a snapshot of a kitchen can be turned into a magazine-worthy image by copying the style of a professional interior photograph, what happens to that professional photographer’s career? Where is the line between style transfers of classic paintings and copying current copyrighted work?

The provided samples appear much more realistic than comparable programs, though many of them still have a few oddities. The researchers said their approach produced more photorealistic results than previous attempts, but identified further areas to develop the program, including enhancing the image segmentation and developing the system to run in real time.

Editors' Recommendations

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Adobe concocts an A.I. that can detect — and reverse — manipulated photos
pluralsight free trial online learning photoshop excel python html5 css premiere pro

Detecting Photoshopped Faces by Scripting Photoshop

Is the face in that photo or video you are eyeing on the web real or fake? Adobe, the creators of Photoshop, may soon have tools to help you spot an altered face -- letting you see what the original image likely looked like. Researchers with Adobe and the University of California, Berkeley recently developed an artificial intelligence program that recognizes when Photoshop’s Face Aware Liquify tool is used, a tool that can be used to alter facial expressions.

Read more
How to hide photos on an Android phone or tablet
Google Photos

While today's best Android phones are quite secure as long as they remain locked with a passcode or biometrics like a fingerprint, by default those features only protect the front door. If someone picks up your phone while it's unlocked, there aren't typically any barriers that will keep them out of exploring everything from your contacts and emails to your photos.

This can be particularly challenging when it comes to photos, since those are the things we like to show off the most from our phones. We've likely all had those moments when we want to show a friend or co-worker a funny cat meme, so we hand over our phone and trust that they won't swipe right and see the photo of the hairy mole that we sent to our doctor that morning.

Read more
Best Sony A7 III deals: Save $300 on the full frame mirrorless camera
Sony A7 III

Sony A7 III Daven Mathies/Digital Trends / .

Even if you have one of the best camera phones at the moment, if you're a photography fanatic, you're probably feeling the burn for something new and exciting. For example, the Sony A7 III line is like none other in the world of handheld cameras and you can find several cameras in that line on sale right now at Best Buy. Here, we round up the best deals in the sale, then analyze how buying a Sony Alpha A7 III looks at the moment.
Today's best Sony A7 III deals

Read more