Forget turning photos into paintings, this software copies another photo’s style

adobe cornell deep photo style trasfer adoberesearch
In this screenshot from the research report, the original image is listed first, the reference image second and the new software's result last, with previous programs in between. Adobe Research / Cornell University
Turning a photo into a painting is now simple thanks to artificially intelligent apps like Prisma, but research from Adobe and Cornell University suggests that style transfers could work from photo to photo. The research team developed a deep photo style transfer program that used a reference image to adjust the original image, mimicking the reference photo’s lighting and colors — even the weather, time of day, and season.

The research, published on March 22, builds on the artificial intelligence behind applications like Prisma, but instead aims to apply photorealistic effects instead of making that photo look like a certain painting style. Previous efforts to conduct automatic style transfers from photo to photo were either inconsistent in style matches or unable to handle a variety of different photos without obvious distortions. Photo-to-photo style transfers often resulted in distorted lines and perspectives, so instead the team from Adobe and Cornell developed a system that only considers color and lighting.

The new method, along with disregarding everything but that color and light information, also segments the photos into different parts, so the light in the sky of the reference picture is applied to only the sky in the second picture, even if the sky takes up a different amount of space than in that reference image. Since the system segments aspects, the effect is applied to the sky, not to the same area the sky takes up in the reference photograph.

By separating out the parts of the image and considering only color and light data, the software was able to successfully take a photo of a cityscape taken on a cloudy day and turn it into a cityscape at dusk, even turning the lights on inside some of the buildings. Since the system considers color, effects like shooting during golden hour could be mimicked, along with turning a summer photo into a fall scene.

The potential software appears to be more consumer-oriented than something that might make its way into Photoshop or Lightroom, but the program leaves opens up some interesting avenues. If a snapshot of a kitchen can be turned into a magazine-worthy image by copying the style of a professional interior photograph, what happens to that professional photographer’s career? Where is the line between style transfers of classic paintings and copying current copyrighted work?

The provided samples appear much more realistic than comparable programs, though many of them still have a few oddities. The researchers said their approach produced more photorealistic results than previous attempts, but identified further areas to develop the program, including enhancing the image segmentation and developing the system to run in real time.


Photography News: Taking a smartphone photo probably saved this guy’s life

A man was snapping a photo in Australia when the smartphone stopped an arrow shot at his face. In this week's photography news, see Canon's plans for a stabilized mirrorless, Hasselblad's newest accessories, Samyang's latest lens, and more.
Social Media

Twitter takes a cue from Instagram and Snapchat with new quick-swipe camera

Twitter is giving the "what's happening" treatment to photos and video by allowing users to access the in-app camera fast enough to catch and share the moment. The new Twitter camera is now accessible with a swipe.

Microsoft’s Seeing A.I. app now lets users explore photos by touch

Microsoft first released the Seeing A.I. app back in 2017, allowing users with vision impairments to get narrated descriptions of objects and scenes in a photo using artificial intelligence. Now, the app is getting a major update.

Six essential apps for improving your mobile photography

Across both Android and iOS, there's no shortage of photo-editing applications on the respective app stores. To make your life easier, we've rounded up seven of the best apps available, whether you want to add a filter or create complex…

Selfie snapper attacked by jaguar during foolhardy photo attempt

Selfies with animals don't always work out too well, as a woman at a zoo in Arizona found out recently. Passing a safety barrier to get closer to a jaguar, the animal responded angrily by digging its claws into her flesh.

From 4K powerhouses to tiny action cams, here are the best video cameras

Although not as popular as they once were, dedicated video cameras still have their benefits. From travel vlogging to home movies to recording your kid's little league game, here are the best video cameras you can buy right now.

CorelDraw Graphics Suite 2019 learns how to play nice with Macs

The design software CorelDraw Graphics Suite 2019 is here, bringing new features now to both Mac and Windows users. The update adds new tools for better organization, along with features to help creatives design sharper digital graphics.

The new HP OfficeJet Pro’s smart app cuts your time spent scanning in half

The new HP OfficeJet Pro series offers faster print speeds, but the company says a new app with shortcut options allows users to cut the time spend working on scanning files in half.

Amid confusion, the Red Hydrogen team promises a pro in-device camera

Learning from the Red Hydrogen One, the company is gearing up for a pro-level device. In a forum post, Red's founder shares how the team is designing a Red Hydrogen with a pro-level in-device camera.

Sony FE 135mm f/1.8 is sharp enough to handle futuristic 90-megapixel cameras

Lens launches come with a lot of hype and marketing speak but a recent test confirmed some of the initial claims around the Sony FE 135 f/1.8. A rental company says that the Sony 135mm is the sharpest lens that it has ever tested.

Forget folding phones, the Insta360 EVO camera folds in half to shoot 360 video

The Insta360 EVO is a...flip camera? Unfolded, the Insta360 Evo shoots 3D in 180 degrees, folded, the new camera shoots in 360 degrees. The EVO launches with what are essentially a pair of 3D glasses for your phone, not your face, the…

Obsbot Tail camera uses A.I. to follow the action (or a pet) for you

Want to capture more epic action selfies, or see what your pet is doing while you're gone? The Obsbot Tail is a camera-gimbal combo that uses artificial intelligence to follow the action.

The Lensbaby Composer Pro II with Edge 35 mimics tilt-shift blur for less cash

Want to create a tilt-shift image on a budget? The new Lensbaby Composer II with Edge 35 mimics the look of a tilt-shift lens for under $500. The new Edge 35 optic is part of the Composer Pro II optics system.

Loupedeck Plus can now edit video, audio with Final Cut Pro

The list of Loupedeck Plus-compatible software is growing. The photo-editing console now works with Final Cut Pro and Adobe Audition for video and audio editing. The controls can be configured to be used on either platform.