Skip to main content

Sorry DSLRs, but Adobe’s A.I. is turning bad smartphone selfies into good portraits

Adobe Research on the Potential Future of Selfie Photography | Adobe Creative Cloud
Could artificial intelligence turn bad selfies into good portraits? Adobe Research thinks so — on Thursday, the team released a sneak peak at a current project developed by the company’s artificial intelligence framework, Adobe Sensei. While Adobe did not say how close the tech is to reality, the teaser video shows off a number of capabilities that could bring some serious selfie-editing power to smartphones.

The app appears to contain a trio of AI-powered developments on the forefront of today’s photo software research: 3D-facial mapping, automatic portrait masking and style transfers.

With 3D-facial mapping, the software can identify the facial features and make slight adjustments both in the pose and the appearance created by focal length. By collecting 3D-mapping data, the entire face can be moved, pointing the chin down for a more flattering look or tilting the face to one side — Adobe demonstrated the possibility in another teaser earlier in 2017.

The same 3D-facial mapping also allows the software to mimic the effect of a portrait lens. Wide-angle lenses tend to distort facial features, making the face appear thinner but the nose to appear larger — that is why many portrait photographers shoot with a 50mm or larger lens. In the teaser video, however, the system recognizes each facial feature and with a slider can create the look of a longer lens from a smartphone photo.

But that is not the only DSLR-like quality that Adobe Sensei is hoping to bring to smartphone photography. Using auto-portrait masking, the app will be able to mimic a shallow depth of field effect. The small sensor of a smartphone camera can’t create the same background blur of a DSLR. Dual lens cameras can simulate the effect by using data from two cameras to calculate where the subject ends and the background begins.

Adobe, however, appears to be teasing an effect that can be accomplished with single lens smartphones. The company did not go into detail on just how the software separates the background but in March, Adobe created an auto clipping program by allowing the neural network to watch more than 49,000 images being clipped by actual people.

The third feature in the teaser allows the app to transfer the style of one photo onto the image, like Prisma, only a photo-to-photo edit instead of turning a photo into a painting. Just two weeks ago, Adobe Research published a paper demonstrating software that was able to mimic the style of another photo, even allowing smartphone snapshots to mimic high-end magazine photos.

For now, Adobe is only teasing the tech — it’s unclear how close the program is to reality. Adobe, however, did confirm that the app in the video isn’t a computer-generated image. But, it does take the biggest advancements in using AI to edit images from academic research and puts them all into one consumer-oriented app.

Editors' Recommendations

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Fujifilm’s successor to the wildly popular X100V has just landed
fujifilm unveils x100v successor x100vi

FUJIFILM X100VI Promotional Video/ FUJIFILM

Fujifilm has finally unveiled the successor to its super-popular X100V camera.

Read more
How to download Instagram photos for free
Instagram app running on the Samsung Galaxy Z Flip 5.

Instagram is amazing, and many of us use it as a record of our lives — uploading the best bits of our trips, adventures, and notable moments. But sometimes you can lose the original files of those moments, leaving the Instagram copy as the only available one . While you may be happy to leave it up there, it's a lot more convenient to have another version of it downloaded onto your phone or computer. While downloading directly from Instagram can be tricky, there are ways around it. Here are a few easy ways to download Instagram photos.

Read more
Astronaut captures stunning images of a snowy Grand Canyon
A snow-covered Grand Canyon seen from space.

In the final days of his six-month stint aboard the International Space Station (ISS), Danish astronaut Andreas Mogensen took some time out of his science work to snap some striking photos of a snow-covered Grand Canyon.

The images were captured from the station in recent days as it orbited Earth at an altitude of around 250 miles.

Read more