Adobe is working on software to cut out the background from any photo

adobe research deep matte learning 64171312 m
Georgejmclittle / 123RF
Clipping out objects from photos and videos is often a time-consuming process — but Adobe is looking for new ways to change that with deep learning software. Published earlier this month, the research for Deep Image Mapping by Adobe, the Beckman Institute for Advanced Science and Technology and the University of Illinois at Urbana-Champaign aims to improve on software-based clipping solutions.

Researchers have developed a number of different artificially intelligent programs to automatically subtract a background from an image, but most are based on colors. When presented with an image with similar colors such as the greens in a landscape photo, those programs tend to fail, Adobe says. Similar applications also use a very narrow set of data points to train the software, the researchers say, which makes the system biased to only certain types of images.

Adobe’s latest method, however, relies on the structure of the objects in the photograph, not the colors. The program requires the image and a trimap, or a rough sketch of what should be cut from the image that labels the foreground, the background, and a range in between to enable the computer to find the edges.

The program works by learning the structure of alpha mattes, or the “color” channel that contains all the transparencies in an image. Common alpha mattes include hair and fur as well as semi-transparent objects or even optical blur created from a slow shutter speed. The research team used 49,300 images to train the deep learning program and 1,000 images to test its accuracy. By recognizing the structure instead of separating by color, the program has achieved accurate results even in images with similar tones.

Adobe’s process puts the image through two rounds of encoding, the first to find those edges and the second to refine the details for more accurate clips.

While artificially intelligent image clipping methods are still under research, Adobe’s latest look into the process could mean better clipping tools will eventually make their way inside programs like Photoshop and Premiere Pro — and even the possibility of eliminating the traditional green screen if the feature is robust enough.

Emerging Tech

Awesome Tech You Can’t Buy Yet: heat-powered watches, phone cases with reflexes

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Computing

Our favorite Windows apps will help you get the most out of your new PC

Not sure what apps you should be downloading for your newfangled Windows device? Here are the best Windows apps, whether you need something to speed up your machine or access your Netflix queue. Check out our categories and favorite picks.
Mobile

We tried all the latest and greatest smartphones to find the best of 2019

Smartphones are perhaps the most important and personal piece of tech on the planet. That’s why it’s important to pick the best phone for your individual needs. Here are the best smartphones you can buy.
Home Theater

The best movies on Netflix in December, from 'Buster Scruggs’ to 'Roma'

Save yourself from hours wasted scrolling through Netflix's massive library by checking out our picks for the streamer's best movies available right now, whether you're into explosive action, witty humor, or anything else.
Photography

See ya, CFast: 1TB CFexpress card transfers photos at 1,400MB per second

The latest trend in professional removable storage media is fast approaching. At CES 2019, ProgradeDigital revealed its first CFexpress card, featuring a 1-terabyte capacity and bewildering 1,400 megabyte-per-second transfer rate.
Photography

From 11K to just OK: The biggest photo gear announcements at CES 2019

From 11K cameras to 1 TB media cards, CES 2019 brought a peek at new gear for photographers and videographers. But what photography gear grabbed our attention the most? Here are the biggest photo gear announcements from CES 2019.
Social Media

No yolk! A photo of an egg has become the most-liked post on Instagram

Until this weekend, the most-liked post on Instagram was of Kylie Jenner's baby daughter, which has around 18 million likes. It's now been knocked off the top spot not by a stunning sunset or even a cute cat, but by an egg.
Photography

What to look for and what to avoid when buying a camera

Looking to buy a new camera? Our comprehensive camera guide for 2016 has answers to any camera or photography questions you might ask, whether in regards to pricing, image quality, or weatherproofing.
Photography

Going somewhere? Capture more than your phone can with the best travel cams

Hitting the road or doing some globetrotting this year? Bring along the right camera to capture those once-in-a-lifetime vacation memories. Here's a list of some of our current favorites.
Photography

From 4K powerhouses to tiny action cams, here are the best video cameras

Although not as popular as they once were, dedicated video cameras still have their benefits. From travel vlogging to home movies to recording your kid's little league game, here are the best video cameras you can buy right now.
Photography

Starting your very own vlog? Here are the best cameras to buy

Any camera that shoots video can be used to vlog, but a few models stand out from the crowd thanks to superior image quality, ergonomics, and usability. When it comes to putting your life on YouTube, here are the best cameras for the job.
Photography

Authentic, holistic, retro photography is in: Here are 2019’s predicted trends

What types of imagery are we most drawn to? According to recent stock photography data from Adobe, StoryBlocks, and Shutterstock, authentic, holistic, and humanitarian content will be in high demand in 2019.
Photography

The best mirrorless cameras pack all the power of a DSLR, minus the bulk

Mirrorless cameras offer a lot of photography firepower, inside a compact body. Explore the best mirrorless cameras, from the pro-level to the beginner-friendly shooters, in this guide.