Skip to main content

MIT researchers create algorithm that instantly turns your selfies into fine art

mit algorithm turns selfies into fine art signature style
Using a newly developed algorithm, you can transform your selfies into pro portraits. This image shows the original inputs on the left column, and the stylized outputs to their right, based on pro style examples in the inset. (Credit: MIT) Image used with permission by copyright holder

It usually takes a long time for pro photographers to develop distinctive styles and techniques, but a group of researchers at the Massachusetts Institute of Technology are looking to reduce that time to mere seconds for smartphone shooters by applying acclaimed professional styles to their selfies. 

MIT researchers, along with colleagues from Adobe and the University of Virginia, have created an algorithm that can instantly stylize your self-portraits to mimic the styles of pro shooters. According to MIT grad student YiChang Shih, one of the project’s lead researchers, this “style transfer” software uses examples from several photo pros (including Richard Avedon, Diane Arbus, and Martin Schoeller) to make an appropriate “style match” to your captured image. Shih said that Instagram, along with other filter-applying apps, aren’t well-suited to complement a person’s facial features. 

In the short video below, you can see the step-by-step process of the algorithm.

Basically, the algorithm takes your captured image and matches it against the style of the example to create a completely new image. You’ll be able to use the same captured image and apply as many differently example styles to it as you want. With each variation of the capture image, you’ll create some powerful self-portraits that look high-quality and very professional.

Shih was the lead author of the “Style Transfers For Headshot Portrait” paper, which carefully details the specifics of the project. The abstract of the paper states: “Headshot portraits are a popular subject in photography but to achieve a compelling visual style requires advanced skills that a casual photographer will not have. Further, algorithms that automate or assist the stylization of generic photographs do not perform well on headshots due to the feature-specific, local retouching that a professional photographer typically applies to generate such portraits.”

There is no discussion as of yet regarding how the creative parties are looking to get this app into public hands, but there’s already huge potential with this idea. According to Shih, who studies electrical engineering and computer science at MIT, “style transfer” is a thriving area of graphics research. Shih and his colleagues will present their findings at the 41st-annual Siggraph conference and exhibition that will take place this August. 

(Via TechCrunch)

Chase Melvin
Former Digital Trends Contributor
Chase Melvin is a writer and native New Yorker. He graduated from LIU Brooklyn where he spent 3 years as the News and Photo…
DJI Mini Pro 4 leak appears to reveal the drone’s specs
A retail box apparently showing DJI's upcoming Mini Pro 4 drone.

DJI appears close to unveiling the Mini 4 Pro, the successor to the Mini 3 Pro that launched in May last year.

First, as a reminder, DJI’s smallest and lightest “Pro” drone tips the scales at just 249 grams, a carefully considered move as it’s just 1 gram below the drone weight category that involves having to register it with the authorities. Sure, that’s no great hardship for most folks, but the fewer hoops you have to jump through to get your bird in the sky, the better.

Read more
GoPro unveils its latest action camera, the Hero 12 Black
GoPro's Hero 12 Black action camera.

GoPro: Introducing HERO12 Black | Everything You Need to Know

GoPro is back with the latest iteration of its popular action camera. The new GoPro Hero 12 Black is the kind of solid piece of kit we’ve come to expect from a company that’s been in the game for years. That’s actually created a bit of a problem for GoPro, with many customers happy to hang onto their current model rather than upgrade. So it'll be hoping the latest version will be attractive enough to prompt a wave of purchases among current owners, while at the same time attracting a bunch of first-time buyers, too.

Read more
How to hide photos on your Android phone or tablet
Google Photos

While modern smartphones are quite secure as long as they remain locked with a passcode or biometrics like a fingerprint, by default those features only protect the front door. If someone picks up your phone while it's unlocked, there aren't typically any barriers that will keep them out of exploring everything from your contacts and emails to your photos.

This can be particularly challenging when it comes to photos, since those are the things we like to show off the most from our phones. We've likely all had those moments when we want to show a friend or co-worker a funny cat meme, so we hand over our phone and trust that they won't swipe right and see the photo of the hairy mole that we sent to our doctor that morning.

Read more