Skip to main content

Facebook wants to turn real emotions into emojis by using your webcam

Update: We’ve added an official statement from Facebook regarding the patents.

Sure, Facebook allows users to attach a feeling to any status but a recently approved patent suggests emotions could become an even bigger player through facial-recognition technology. Future versions of the platform could use cameras, keyboard movement, and touchpad gestures to track emotions, automatically inserting emojis and adjusting the font or even using emotions to analyze reactions, the patent suggests.

Recommended Videos

The set of three patents, recently uncovered by CB Insights, were submitted back in 2014 and 2015 but were only recently published publicly. All three patents detail technology designed to track the user’s emotions, but each one uses that tracking in different ways.

The first patent is designed for Facebook Messages. The idea is to aid text-only messages, which can sometimes be misconstrued without any hints of emotion or context. The technology works based on the way the user interacts with the keyboard, touchscreen or “other input devices.” Factors like how quickly the keys are pressed, how hard they are pressed and whether or not the smartphone is moving around or staying in place can offer clues as to the user’s emotions. The messaging platform then could take that data and adjust the font, the font size and other visual tools to help convey more meaning in the message.

The second patent detects emotion not from keyboard strokes, but from a smartphone’s front-facing camera or a webcam. Cameras and facial-recognition technology are able to trigger a photo with a smile — Facebook’s patent instead looks for visual emotional cues and stores that data to create a more customized newsfeed. According to the patent, the emotion data would be used to help deliver more content that users respond to as well as adding additional analytical data for publishers on what type of response their content received.

What could scare some users is that the camera doesn’t have to be “on” for the tech to work. The patent details using “passive imaging data” or information captured automatically without the user actually turning the camera on.

The third patent would use similar facial recognition technology, only instead of using the data to track your responses, this feature would find the most appropriate emoji automatically, matching your facial features to an emoji. Along with recognizing smiles, the patent suggests the technology could also recognize gestures, like a thumbs up, and translate those into emojis as well.

Patents may offer insight into what a company is researching, but they do not always become actual products. “We often seek patents for technology we never implement, and patents should not be taken as an indication of future plans,” a Facebook spokesperson told Digital Trends.

The idea of using emotion recognition technology to track responses is not a completely new idea — consider this billboard that determined each viewer’s response to the message. While most might be able to get onboard with not digging through the emoji list to find the right one, the idea of being watched while scrolling through Facebook might prompt more than a few to follow CEO Mark Zuckerberg in covering the camera with duct tape if the patent ever becomes reality.

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Bluesky finally adds a feature many had been waiting for
A blue sky with clouds.

Bluesky has been making a lot of progress in recent months by simplifying the process to sign up while at the same time rolling out a steady stream of new features.

As part of those continuing efforts, the social media app has just announced that users can now send direct messages (DMs).

Read more
Reddit just achieved something for the first time in its 20-year history
The Reddit logo.

Reddit’s on a roll. The social media platform has just turned a profit for the first time in its 20-year history, and now boasts a record 97.2 million daily active users, marking a year-over-year increase of 47%. A few times during the quarter, the figure topped 100 million, which Reddit CEO and co-founder Steve Huffman said in a letter to shareholders had been a “long-standing milestone” for the site.

The company, which went public in March, announced the news in its third-quarter earnings results on Tuesday.

Read more
Worried about the TikTok ban? This is how it might look on your phone
TikTok splash screen on an Android phone.

The US Supreme Court has decided to uphold a law that would see TikTok banned in the country on January 19. Now, the platform has issued an official statement, confirming that it will indeed shut down unless it gets some emergency relief from the outgoing president.

“Unless the Biden Administration immediately provides a definitive statement to satisfy the most critical service providers assuring non-enforcement, unfortunately TikTok will be forced to go dark on January 19,” said the company soon after the court’s verdict.
So, what does going dark mean?
So, far, there is no official statement on what exactly TikTok means by “going dark.” There is a lot of speculation out there on how exactly the app or website will look once TikTok shutters in the US.

Read more