Facebook researchers are developing animated selfies based on emoji reactions

Future versions of Facebook could animate your profile picture as followers click the emoji reactions to your posts. Facebook and Tel Aviv University recently published the results of a study that created short animated selfies by starting with a single photo.

Moving photos aren’t anything new — just look at the millions of GIFs floating around Facebook. But all those animations are generally made from short videos or a sequence of still photos. Facebook and the researchers from Tel Aviv University set out to create an animation using only a single photo. (A Google researcher recently took on a project with a similar objective, creating a scenic video using artificial intelligence and a single photo as a starting point.)

The research team built software that maps a facial expression on a reference video and applies it to the still photo. The system uses several facial markers and watches how the expression changes in the reference video. Using similar facial markers on the image, the program then animates the photo using the same motions.

The result is an emoji-like animation of the still photo. But, a few things were still missing — literally. In a still photo where the expression didn’t include teeth, for example, mapping the photo to a smiling animation creates an odd pink space where the teeth should be. The team then took that coarse animation and created an algorithm to fill in the missing details. Of course, those teeth probably don’t match the teeth of the person in the photo, but the researchers say that since people don’t generally identify someone by their teeth, adding in the missing detail created better results than without the “false” teeth.

The team then further refined the results to add fine details to enhance the expression and remove anomalies, like wrinkles created from the animation that were not in the original photo.

Animating a still photo could create a number of different apps for creating animations with little data, like making the Mona Lisa smile. But as the researchers demonstrate in the project’s video, the tool could also create responsive photos on social media. For example, when a follower clicks the like reaction on Facebook, the image could animate with a smile while other reactions, like sad and angry, could have animations matching those emotions.

The resulting animations aren’t perfect with a few oddities to the animation, but further refinement could bring the feature mainstream. The team plans to continue developing the program by allowing the software to choose from a library of reference videos based on the sample that closely matches the facial features for more accurate animations, as well as expanding the work with 3D methods. Paired with the patent for recognizing emotions through a webcam, tracking facial expressions appears to be an area of interest for the social media company’s research.

The project will be presented at Sigggraph Asia in November.

Social Media

It’s over: Tinder won the dating wars. Swipe or stay home

From OKCupid to Bumble, a variety of online dating apps still elbow for superiority, but look at the numbers and the verdict is clear: Tinder wins by a mile. Here’s why the swiping model can’t be beat.
Photography

8 easy ways for you to transfer photos from an Android phone to a PC

If you haven't already, you should back up your photos to a computer. Here's how to transfer photos from an Android phone to a PC using third-party services and a wealth of storage devices.
Photography

Snap, print, and go: The 8 best portable photo printers

Printing your favorite smartphone pictures on the go is easier than ever with a portable photo printer. They are compact and easy to use, transforming your digital selfies into souvenir.
Mobile

Express yourself with our handy guide on how to make emoji

Emoji rule the world these days, but no matter how many are out there, there's always room for one more. Here's how to make an emoji of your own, so you can express yourself without relying on Unicode.
Mobile

Facebook Messenger now includes AR games you can play with your friends

If sending messages wasn't already enough with Facebook Messenger, users can now challenge friends to augmented reality games. With the new feature, you can play with up to six people at a time from anywhere in the world.
Social Media

Snapchat now uses speech recognition to animate your face

Get your tongue back in your mouth -- Snapchat's latest Lenses react instead to a specific keyword. The new Lenses animate after hearing a specific keyword, which Snapchat displays on the screen.
Computing

The Facebook dating service will be free of charge and free of ads

Facebook is getting into the dating game. While the feature was one of the surprises from this year's F8, new details suggest what the feature may entail, including a few screenshots from a computer programmer.
Mobile

Here’s how to hide your active status on Instagram

The Activity Status mode on Instagram shows people whenever you are online, similar to Facebook Messenger. If that annoys you, here's how to hide your active status on Instagram with a quick settings change.
Social Media

Three million people quit Snapchat after the redesign

After a million users signed petitions to get the old Snapchat back, the network's user count is showing the early results of the changes with a three-million-user drop in daily active users.
Social Media

Facebook wants to help you find a mentor with its latest Groups feature

Facebook is designed for connecting to other people -- so why not mentors? Today, Facebook launched a program inside Groups that allows for two users to go through a mentorship program together.
Social Media

Facebook’s less cluttered friend list feeds are no more

Facebook friend feeds created a more curated news feed -- but not anymore. Facebook discontinued the feature, saying it wasn't widely used. The move will help the network focus on improving the news feed, the company says.
Photography

Starting a vlog? Here are the best cameras to buy

Any camera that shoots video can be used to vlog, but a few models stand out from the crowd thanks to superior image quality, ergonomics, and usability.
Features

The numbers don’t lie: Facebook is faltering. So what will eventually replace it?

Facebook is faltering, and the data prove it. User growth is slowing, employee outlooks are dipping, and young people are looking elsewhere. But for Facebook to fail, an alternative must arise. Who will it be?
Photography

For Monaris, it’s a photography career launched on an iPhone and Instagram

On Instagram, she's known just as Monaris. But street photographer Paola Franqui has built a following largely with an iPhone and a smile. We sat down with her to talk photography, style, and Instagram, of course.