Adobe is working on software to cut out the background from any photo

adobe research deep matte learning 64171312 m
Georgejmclittle / 123RF
Clipping out objects from photos and videos is often a time-consuming process — but Adobe is looking for new ways to change that with deep learning software. Published earlier this month, the research for Deep Image Mapping by Adobe, the Beckman Institute for Advanced Science and Technology and the University of Illinois at Urbana-Champaign aims to improve on software-based clipping solutions.

Researchers have developed a number of different artificially intelligent programs to automatically subtract a background from an image, but most are based on colors. When presented with an image with similar colors such as the greens in a landscape photo, those programs tend to fail, Adobe says. Similar applications also use a very narrow set of data points to train the software, the researchers say, which makes the system biased to only certain types of images.

Adobe’s latest method, however, relies on the structure of the objects in the photograph, not the colors. The program requires the image and a trimap, or a rough sketch of what should be cut from the image that labels the foreground, the background, and a range in between to enable the computer to find the edges.

The program works by learning the structure of alpha mattes, or the “color” channel that contains all the transparencies in an image. Common alpha mattes include hair and fur as well as semi-transparent objects or even optical blur created from a slow shutter speed. The research team used 49,300 images to train the deep learning program and 1,000 images to test its accuracy. By recognizing the structure instead of separating by color, the program has achieved accurate results even in images with similar tones.

Adobe’s process puts the image through two rounds of encoding, the first to find those edges and the second to refine the details for more accurate clips.

While artificially intelligent image clipping methods are still under research, Adobe’s latest look into the process could mean better clipping tools will eventually make their way inside programs like Photoshop and Premiere Pro — and even the possibility of eliminating the traditional green screen if the feature is robust enough.

Photography

Adobe concocts an A.I. that can detect — and reverse — manipulated photos

The company behind the software that's often used to manipulate photographs may help make it easy to spot a fake photo. Researchers at Adobe recently created an artificially intelligent program that can recognize fake photos of faces.
Movies & TV

Who needs sunshine? Stay inside and watch the best movies on Netflix instead

Save yourself from hours wasted scrolling through Netflix's massive library by checking out our picks for the streamer's best movies available right now, whether you're into explosive action, witty humor, or anything else.
Photography

What’s the difference between Lightroom CC and Lightroom Classic?

Lightroom CC has evolved into a capable photo editor, but is it enough to supplant Lightroom Classic? We took each program for a test drive to compare the two versions and see which is faster, more powerful, and better organized.
Social Media

These are the best ways to make your own animated GIF to share

Love sharing GIFs with your friends and peers, but wish you could make your own? Here's how to do so in Photoshop, or using a few other methods that don't require you to shell out a premium fee with each calendar year.
Photography

Sony’s new full-frame 600mm f/4 is a $13,000 monster of a lens

More expensive than a new Apple Mac Pro and Pro Display, Sony's $13,000, 600mm f/4 is a dream telephoto lens for professional sports and wildlife photographers. For the rest of us, Sony also announced a $2,000, 200-600mm f/5.6-6.3.
Photography

Fujifilm black-and-white film returns from the dead — thanks to millennials

After discontinuing black and white film, Fujifilm is bringing back the monochrome thanks to demand from younger photographers. The updated Neopan 100 Across II is designed for sharpness and minimal grain.
Photography

The Loupedeck Plus custom keyboard will make you feel like a pro video editor

With recently added support for Final Cut Pro X, the Loupedeck Plus improves speed and accuracy for video editors. With a collection of customizable buttons and dials, the Loupedeck can almost completely replace a mouse and keyboard setup.
Product Review

It's a camera! It's a printer! And it's more fun than it has any right to be

By going digital and adding a built-in mobile printer, the Instax Mini LiPlay puts more features into a smaller form factor than previous Instax cameras, while still being every bit as fun.
Social Media

Will this deepfake of a power-hungry Zuckerberg make Facebook rethink fake news?

Just how committed is Facebook to earlier statements on leaving deepfake videos intact but demoted? A fake video of Mark Zuckerberg proclaiming power over your data has lasted for four days on the platform.
Deals

The GoPro Hero7 action camera gets price cut on Amazon ahead of Father’s Day

Got an adventurous Dad? If so, a GoPro action camera will make a great Father’s Day gifts. Ahead of Father’s Day, capture the GoPro Hero7 Black on Amazon for just $329, down from its normal $400. Don't just settle for socks again this…
Photography

You don't need an epic budget to shoot epic photos with the best cheap cameras

You don't need a huge budget to shoot epic photos with the best cheap cameras. There are great deals to be found on both lower-end cameras and older versions of high-end cameras that you can still find new.
Photography

Can’t afford this $150 tripod head? Just 3D print the Edelkrone Ortak FlexTilt

Edelkrone's FlexTilt tripod head retails for about $150 — or you could 3D print your own with a $30 part kit and the cost of materials. The Edelkrone Ortak FlexTilt Head 3D is a 3D-printed tripod head.
Photography

Tapped out? Edit faster with 5 gesture shortcuts in Lightroom CC on mobile

Missing those keyboard shortcuts when photo editing on a smartphone or iPad? Lightroom has a handful of gesture-based controls that can help fill the gaps, if you know where to find them.
Mobile

Learn how to create a 360-degree panorama with your phone and Google Street View

Google Street View encourages you to explore the great outdoors, including landmarks, natural wonders, and even your own neighborhood. Learn how to create 360-degree imagery using your smartphone camera to add locations to Google Maps.