MIT, Adobe’s new A.I. could bring one-click background removal, social filters

Removing a background from a photo is a time-consuming process — but researchers from MIT, Adobe, and Microsoft may have just created technology that will allow for one-click background removal, even around tough edges like hair and fur. The process, called semantic soft segmentation, uses color and texture to automatically separate the image into layers. The technology is already good enough to be used for tasks like creating better Instagram and Snapchat filters, but the researchers anticipate future reiterations that will allow for one-click background removal for non-professional photo-editing apps and even video.

Selecting an object in a photograph is a common task for photo editors. With the image segmented into layers, it’s possible to create a transparent background, place the subject on an entirely different background, or apply changes just to the subject, or just to the background, like background blur.

Soft semantic segmentation uses machine learning to automate what’s typically a tedious task in photo editing. The neural network analyzes the image using texture and color as well as factors like object recognition. Using that information, the software separates the image into layers automatically. Once the image is segmented, then effects like background blur or background removal can be easily applied to the image.

The process currently works for still images, but the team says it hopes further research will allow the process to be used for videos as well. The technology also takes several minutes to work and further research could improve the system’s speed. Even in its early state, the team says that the technology could be used for creating photo filters for social networks that adjust only the background, or to mimic an image from a different kind of camera — which sounds a lot like a portrait mode without the dual camera.

“Instead of needing an expert editor to spend several minutes tweaking an image frame by frame and pixel by pixel, we’d like to make the process simpler and faster so that image editing can be more accessible to casual users,” Yagiz Aksoy, a visiting researcher at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL). “The vision is to get to a point where it just takes a single click for editors to combine images to create these full-blown, realistic fantasy worlds.”

The research isn’t the first to try to automatically separate the subject and the background — Photoshop already has a Select Subject tool that helps start a similar process and Instagram has a filter option for portrait-mode-like effects without the dual camera. The new process, however, uses what the researchers call “soft transitions” for all the layers. That creates a more realistic edge in the final image, particularly when working with edges that are traditionally difficult to select like hair and fur.

The research was presented during last week’s SIGGRAPH conference in Vancouver and published as a white paper.


Adobe Premiere Pro uses A.I. to streamline audio cleanup and other tedious tasks

Adobe Premiere Pro will soon be able to remove background noise and reverb in a few clicks. The upcoming feature was announced along with a slew of new features for Premiere Pro, After Effects, Audition, and Character Animator.
Emerging Tech

CRISPR gene editing creates cocaine-proof mice, aims to crack addiction puzzle

Scientists from the University of Chicago have used CRISPR gene editing to create cocaine-resistant mice by modifying the DNA of skin cells. Here's how the breakthrough skin graft works.
Product Review

More of the same isn’t a bad thing for the outstanding iPhone Xs

Apple turned traditional phone design on its head with last year’s iPhone X, so it’s no surprise that this year’s version keeps the style going. The iPhone Xs brings a faster processer, more camera features, and even slightly better…
Product Review

Sigma’s 105mm is the best portrait lens money can buy

The Sigma 105mm F1.4 DG HSM Art lens may be unwieldy to use, but for the effort, you’ll get what are possibly the best portrait images.

Tesla trims its color palette in bid to leave production hell behind

Tesla will stop offering two colors -- obsidian black metallic and silver metallic -- to simplify its production process. Reducing the number of available configurations will make the Model 3 easier to build.

Sick of black? Ethnotek’s Raja camera bag lets you customize designs on a whim

Like to change your bag as often as you change your socks? The Ethnotek Raja is a camera backpack that has interchangeable "Threads" or front panels to change up the look while still stashing two DSLR bodies and multiple lenses.

Aurora HDR 2019 applies A.I. to achieve more natural high dynamic range images

HDR is easy to overdo and difficult to get just right -- but Skylum says the new artificial intelligence inside Aurora HDR 2019 helps create more natural HDR images. The update also brings the LUT mapping popular in video editing.
Social Media

Facebook expands fact-checking net to try to catch doctored photos and videos

Facebook is now fact-checking images and video along with articles, using third-party organizations. New A.I. helps flag potential fakes for human review, but user flags and comments still help recognize what content might not be accurate.
Emerging Tech

The best drone photos from around the world

Most of today's drones come equipped with high-end cameras, which are quickly revolutionizing the world of aerial photography as we know it. Here are some of the best drone photos from around the world.

Photo FOMO: Recharge and stash lenses with this smartphone photo bag

Between lenses and extra batteries, smartphone photographers have lots of accessories too -- and could soon have a bag designed specifically for them. The bag isn't the only new accessory with wireless charging announced this week either.

These are the best action cameras money can buy

Action cameras are great tools for capturing videos of your everyday activities, whether it's a birthday party or the steepest slope you've ever descended on your snowboard. These are the best money can buy.

When you're ready to shoot seriously, these are the best DSLRs you can buy

For many photographers the DSLR is the go-to camera. With large selection of lenses, great low-light performance, and battery endurance, these DSLRs deliver terrific image quality for stills and videos.

These point-and-shoot cameras make your smartphone pics look like cave paintings

If your smartphone camera just isn't giving you the results you're looking for, maybe it's time to step up your game. The latest and greatest point-and-shoot cameras offer large sensors, tough bodies, and long lenses - something no phone…

The best mirrorless cameras pack all the power of a DSLR, minus the bulk

Mirrorless cameras offer a lot of photography firepower, inside a compact body. Explore the best mirrorless cameras, from the pro-level to the beginner-friendly shooters, in this guide.