Skip to main content

MIT researchers create algorithm that instantly turns your selfies into fine art

mit algorithm turns selfies into fine art signature style
Using a newly developed algorithm, you can transform your selfies into pro portraits. This image shows the original inputs on the left column, and the stylized outputs to their right, based on pro style examples in the inset. (Credit: MIT) Image used with permission by copyright holder

It usually takes a long time for pro photographers to develop distinctive styles and techniques, but a group of researchers at the Massachusetts Institute of Technology are looking to reduce that time to mere seconds for smartphone shooters by applying acclaimed professional styles to their selfies. 

MIT researchers, along with colleagues from Adobe and the University of Virginia, have created an algorithm that can instantly stylize your self-portraits to mimic the styles of pro shooters. According to MIT grad student YiChang Shih, one of the project’s lead researchers, this “style transfer” software uses examples from several photo pros (including Richard Avedon, Diane Arbus, and Martin Schoeller) to make an appropriate “style match” to your captured image. Shih said that Instagram, along with other filter-applying apps, aren’t well-suited to complement a person’s facial features. 

In the short video below, you can see the step-by-step process of the algorithm.

Basically, the algorithm takes your captured image and matches it against the style of the example to create a completely new image. You’ll be able to use the same captured image and apply as many differently example styles to it as you want. With each variation of the capture image, you’ll create some powerful self-portraits that look high-quality and very professional.

Shih was the lead author of the “Style Transfers For Headshot Portrait” paper, which carefully details the specifics of the project. The abstract of the paper states: “Headshot portraits are a popular subject in photography but to achieve a compelling visual style requires advanced skills that a casual photographer will not have. Further, algorithms that automate or assist the stylization of generic photographs do not perform well on headshots due to the feature-specific, local retouching that a professional photographer typically applies to generate such portraits.”

There is no discussion as of yet regarding how the creative parties are looking to get this app into public hands, but there’s already huge potential with this idea. According to Shih, who studies electrical engineering and computer science at MIT, “style transfer” is a thriving area of graphics research. Shih and his colleagues will present their findings at the 41st-annual Siggraph conference and exhibition that will take place this August. 

(Via TechCrunch)

Chase Melvin
Former Digital Trends Contributor
Chase Melvin is a writer and native New Yorker. He graduated from LIU Brooklyn where he spent 3 years as the News and Photo…
Canon’s smallest EOS R camera just got a $200 discount
Canon EOS R100 mirrorless camera with lens attached

Target is an excellent source of camera deals. Just last week it had a $300 discount on the Fujifilm X-T50 mirrorless digital camera bundle, and today it has an amazing offer for the Canon EOS R100. From its original price of $600, the mirrorless camera is down to a more affordable $400, for $200 in savings. We're not sure how long you have to take advantage of this offer though, so if you're interested in making this purchase, you should probably complete the transaction right now if you want to enjoy the 33% discount.

Why you should buy the Canon EOS R100 mirrorless camera
The Canon EOS R100 is the smallest model in the brand's EOS R series of mirrorless cameras, which makes it a perfect choice for rookie photographers. Unlike a DSLR camera, which uses a mirror for their optical viewfinder, a mirrorless camera uses an imaging sensor for a digital preview of the picture that you're planning to take. The lack of the mirror makes mirrorless cameras much smaller than DSLR cameras, and that's very apparent with the Canon EOS R100, as it only measures about 6.1 inches by 7.9 inches by 7.6 inches, and it weights just about 2 pounds.

Read more
The best photo printers you can buy in 2024
Alan compares draft, standard, and high-quality photos from Epson's EcoTank ET-8500.

If you love sharing photo prints or building physical photo albums, you might want to upgrade to a photo printer. When manufacturers optimize printers for pictures, the results often exceed the image quality of the best printers available.

Compared to sending photos to a lab or printing at a local office store, you have faster feedback and more control when you create pictures on your own photo printer. If you decide a print would benefit from a color or exposure adjustment, you can quickly make that change and print again with minimal delay. A printer that handles photos well offers instant gratification and convenience, while saving you money on print costs from a photo lab.

Read more
Adobe Photoshop or Adobe Lightroom: Which should you choose to edit your photos?
project felix lighting tool adobe beta

Within Adobe's Creative Cloud Suite, there are two programs designed specifically with photographers in mind: Adobe Photoshop and Adobe Lightroom.

At first glance, these two programs might appear redundant, as they're both made with the goal of editing photographs of all kinds. But the truth is, each program is designed with a different purpose in mind, and each offers a distinct post-production photography workflow.
Photoshop vs. Lightroom
In the most simple terms, Adobe Photoshop is effectively a digital darkroom, where you can make detailed adjustments and alterations to any kind of image. Adobe Lightroom, on the other hand, is closer to an entire photography studio, as it imports, organizes, edits, and exports photographs.

Read more