Forget turning photos into paintings, this software copies another photo’s style

adobe cornell deep photo style trasfer adoberesearch
In this screenshot from the research report, the original image is listed first, the reference image second and the new software's result last, with previous programs in between. Adobe Research / Cornell University
Turning a photo into a painting is now simple thanks to artificially intelligent apps like Prisma, but research from Adobe and Cornell University suggests that style transfers could work from photo to photo. The research team developed a deep photo style transfer program that used a reference image to adjust the original image, mimicking the reference photo’s lighting and colors — even the weather, time of day, and season.

The research, published on March 22, builds on the artificial intelligence behind applications like Prisma, but instead aims to apply photorealistic effects instead of making that photo look like a certain painting style. Previous efforts to conduct automatic style transfers from photo to photo were either inconsistent in style matches or unable to handle a variety of different photos without obvious distortions. Photo-to-photo style transfers often resulted in distorted lines and perspectives, so instead the team from Adobe and Cornell developed a system that only considers color and lighting.

The new method, along with disregarding everything but that color and light information, also segments the photos into different parts, so the light in the sky of the reference picture is applied to only the sky in the second picture, even if the sky takes up a different amount of space than in that reference image. Since the system segments aspects, the effect is applied to the sky, not to the same area the sky takes up in the reference photograph.

By separating out the parts of the image and considering only color and light data, the software was able to successfully take a photo of a cityscape taken on a cloudy day and turn it into a cityscape at dusk, even turning the lights on inside some of the buildings. Since the system considers color, effects like shooting during golden hour could be mimicked, along with turning a summer photo into a fall scene.

The potential software appears to be more consumer-oriented than something that might make its way into Photoshop or Lightroom, but the program leaves opens up some interesting avenues. If a snapshot of a kitchen can be turned into a magazine-worthy image by copying the style of a professional interior photograph, what happens to that professional photographer’s career? Where is the line between style transfers of classic paintings and copying current copyrighted work?

The provided samples appear much more realistic than comparable programs, though many of them still have a few oddities. The researchers said their approach produced more photorealistic results than previous attempts, but identified further areas to develop the program, including enhancing the image segmentation and developing the system to run in real time.

Social Media

No yolk! A photo of an egg has become the most-liked post on Instagram

Until this weekend, the most-liked post on Instagram was of Kylie Jenner's baby daughter, which has around 18 million likes. It's now been knocked off the top spot not by a stunning sunset or even a cute cat, but by an egg.

From 11K to just OK: The biggest photo gear announcements at CES 2019

From 11K cameras to 1 TB media cards, CES 2019 brought a peek at new gear for photographers and videographers. But what photography gear grabbed our attention the most? Here are the biggest photo gear announcements from CES 2019.
Emerging Tech

A.I. can generate pictures of a finished meal based on just a written recipe

Feeling hungry? Researchers from Tel-Aviv University in Israel have created an A.I. that's able to generate complete photos of meals, based only on reading the written recipes. Here's how.

See ya, CFast: 1TB CFexpress card transfers photos at 1,400MB per second

The latest trend in professional removable storage media is fast approaching. At CES 2019, ProgradeDigital revealed its first CFexpress card, featuring a 1-terabyte capacity and bewildering 1,400 megabyte-per-second transfer rate.

Olympus’ latest teaser shares glimpse of new OM-D camera geared toward sports

Is Olympus about to release a new mirrorless camera geared toward sports photographers? The latest teaser offers a glimpse of an upcoming OM-D camera set to launch on January 24, and by the looks of the teasers, it's geared toward sports.

Lexar’s latest SDXC card keeps you shooting with 1 TB of storage

Shoot large files at high capacity? Lexar's latest SDXC memory card will fit a terabyte of storage inside your camera. The Lexar SD card is part of the company's Professional 633x series. That higher capacity will come at a cost, however.
Emerging Tech

Awesome Tech You Can’t Buy Yet: heat-powered watches, phone cases with reflexes

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!

What to look for and what to avoid when buying a camera

Looking to buy a new camera? Our comprehensive camera guide for 2016 has answers to any camera or photography questions you might ask, whether in regards to pricing, image quality, or weatherproofing.

Going somewhere? Capture more than your phone can with the best travel cams

Hitting the road or doing some globetrotting this year? Bring along the right camera to capture those once-in-a-lifetime vacation memories. Here's a list of some of our current favorites.

From 4K powerhouses to tiny action cams, here are the best video cameras

Although not as popular as they once were, dedicated video cameras still have their benefits. From travel vlogging to home movies to recording your kid's little league game, here are the best video cameras you can buy right now.

Starting your very own vlog? Here are the best cameras to buy

Any camera that shoots video can be used to vlog, but a few models stand out from the crowd thanks to superior image quality, ergonomics, and usability. When it comes to putting your life on YouTube, here are the best cameras for the job.

Authentic, holistic, retro photography is in: Here are 2019’s predicted trends

What types of imagery are we most drawn to? According to recent stock photography data from Adobe, StoryBlocks, and Shutterstock, authentic, holistic, and humanitarian content will be in high demand in 2019.

The best mirrorless cameras pack all the power of a DSLR, minus the bulk

Mirrorless cameras offer a lot of photography firepower, inside a compact body. Explore the best mirrorless cameras, from the pro-level to the beginner-friendly shooters, in this guide.