Using this A.I.-based healing brush, repairing an image is no biggie

Photoshop’s healing brush can use surrounding pixels to repair an image or remove an object — but what if the surrounding pixels don’t have enough data to fill in those holes? Researchers from Nvidia recently used artificial intelligence to help fill in those gaps to create a tool similar to the healing brush tool that is able to intelligently fill in missing pieces, a technique called image inpainting for irregular holes using partial convolutions — here’s hoping Nvidia comes up with a nickname before making the tool widely accessible.

Nvidia isn’t the first to try to reinvent the healing brush using A.I., but the researchers say that earlier attempts left artifacts and blur. Rather than using full convolutional filter responses to those holes, Nvidia instead created a partial convolution method — in other words, the software creates a layer that renormalizes the pixels to create a more normal looking image without those artifacts. The new program also uses an automatically generated layer masks.

Unlike the traditional healing brush tool that only uses surrounding pixels to determine what to fill in the gap with, Nvidia trained its tool using three different sets of images, resulting in thousands of images to train the tool with. The researchers randomly applied masks to intentionally remove sections of images to those groups of photos. By showing the computer both the before and after, the program could learn how to fill in some of those gaps. “Our model can robustly handle holes of any shape, size location or distance from the image borders,” the researchers wrote. “Further, our performance does not deteriorate catastrophically as holes increase in size.”

While more robust than previous attempts, the researchers said that the tool struggles with the largest holes and images without a lot of structure.

The research could bring some significant changes to photo editing if the tool makes its way into an image editor. Nvidia’s program, for example, could replace an eye in an old, damaged portrait, even without the other eye to replicate. The resulting eye, of course, isn’t the same eye — in one example, the replaced eye is an entirely different color. In the demonstration video, the program also appears to give a young woman and an older gentleman the same pair of eyes. 

While giving a person different features using the database of images should raise ethical considerations for portraits, the concept could speed up the process of removing distractions from other types of images. The tool could potentially help remove objects in photographs, such as removing power lines or signs from the background, with more accuracy than current tools.

Emerging Tech

Researchers discover a way to make 3D printing 100 times faster using light

Researchers at the University of Michigan have invented a new method of 3D printing which is up to 100 times faster than conventional 3D-printing processes. Here's how it works and why it could prove a game-changer for 3D printing.
Home Theater

Still listening on tinny TV speakers? Try one of our favorite soundbars

You no longer have to sacrifice sound for size when selecting home audio equipment. Check out our picks for the best soundbars, whether you're looking for budget options, pure power, smarts, or tons of features.
Mobile

We tried all the latest and greatest smartphones to find the best of 2019

Smartphones are perhaps the most important and personal piece of tech on the planet. That’s why it’s important to pick the best phone for your individual needs. Here are the best smartphones you can buy.
Home Theater

QLED and OLED may have similar names, but they're totally different technologies

The names may look almost identical, but OLED and QLED are two entirely different beasts. In our QLED vs. OLED battle, we dissect the differences between these dueling TV technologies, and help determine which might be best for you.
Photography

Olympus’ latest teaser shares glimpse of new OM-D camera geared toward sports

Is Olympus about to release a new mirrorless camera geared toward sports photographers? The latest teaser offers a glimpse of an upcoming OM-D camera set to launch on January 24, and by the looks of the teasers, it's geared toward sports.
Photography

Lexar’s latest SDXC card keeps you shooting with 1 TB of storage

Shoot large files at high capacity? Lexar's latest SDXC memory card will fit a terabyte of storage inside your camera. The Lexar SD card is part of the company's Professional 633x series. That higher capacity will come at a cost, however.
Emerging Tech

Awesome Tech You Can’t Buy Yet: heat-powered watches, phone cases with reflexes

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Photography

See ya, CFast: 1TB CFexpress card transfers photos at 1,400MB per second

The latest trend in professional removable storage media is fast approaching. At CES 2019, ProgradeDigital revealed its first CFexpress card, featuring a 1-terabyte capacity and bewildering 1,400 megabyte-per-second transfer rate.
Photography

From 11K to just OK: The biggest photo gear announcements at CES 2019

From 11K cameras to 1 TB media cards, CES 2019 brought a peek at new gear for photographers and videographers. But what photography gear grabbed our attention the most? Here are the biggest photo gear announcements from CES 2019.
Photography

What to look for and what to avoid when buying a camera

Looking to buy a new camera? Our comprehensive camera guide for 2016 has answers to any camera or photography questions you might ask, whether in regards to pricing, image quality, or weatherproofing.
Social Media

No yolk! A photo of an egg has become the most-liked post on Instagram

Until this weekend, the most-liked post on Instagram was of Kylie Jenner's baby daughter, which has around 18 million likes. It's now been knocked off the top spot not by a stunning sunset or even a cute cat, but by an egg.
Photography

Going somewhere? Capture more than your phone can with the best travel cams

Hitting the road or doing some globetrotting this year? Bring along the right camera to capture those once-in-a-lifetime vacation memories. Here's a list of some of our current favorites.
Photography

From 4K powerhouses to tiny action cams, here are the best video cameras

Although not as popular as they once were, dedicated video cameras still have their benefits. From travel vlogging to home movies to recording your kid's little league game, here are the best video cameras you can buy right now.