Facebook wants to turn real emotions into emojis by using your webcam

Facebook Pages
Marcel De Grijs / 123RF
Update: We’ve added an official statement from Facebook regarding the patents.

Sure, Facebook allows users to attach a feeling to any status but a recently approved patent suggests emotions could become an even bigger player through facial-recognition technology. Future versions of the platform could use cameras, keyboard movement, and touchpad gestures to track emotions, automatically inserting emojis and adjusting the font or even using emotions to analyze reactions, the patent suggests.

The set of three patents, recently uncovered by CB Insights, were submitted back in 2014 and 2015 but were only recently published publicly. All three patents detail technology designed to track the user’s emotions, but each one uses that tracking in different ways.

The first patent is designed for Facebook Messages. The idea is to aid text-only messages, which can sometimes be misconstrued without any hints of emotion or context. The technology works based on the way the user interacts with the keyboard, touchscreen or “other input devices.” Factors like how quickly the keys are pressed, how hard they are pressed and whether or not the smartphone is moving around or staying in place can offer clues as to the user’s emotions. The messaging platform then could take that data and adjust the font, the font size and other visual tools to help convey more meaning in the message.

The second patent detects emotion not from keyboard strokes, but from a smartphone’s front-facing camera or a webcam. Cameras and facial-recognition technology are able to trigger a photo with a smile — Facebook’s patent instead looks for visual emotional cues and stores that data to create a more customized newsfeed. According to the patent, the emotion data would be used to help deliver more content that users respond to as well as adding additional analytical data for publishers on what type of response their content received.

What could scare some users is that the camera doesn’t have to be “on” for the tech to work. The patent details using “passive imaging data” or information captured automatically without the user actually turning the camera on.

The third patent would use similar facial recognition technology, only instead of using the data to track your responses, this feature would find the most appropriate emoji automatically, matching your facial features to an emoji. Along with recognizing smiles, the patent suggests the technology could also recognize gestures, like a thumbs up, and translate those into emojis as well.

Patents may offer insight into what a company is researching, but they do not always become actual products. “We often seek patents for technology we never implement, and patents should not be taken as an indication of future plans,” a Facebook spokesperson told Digital Trends.

The idea of using emotion recognition technology to track responses is not a completely new idea — consider this billboard that determined each viewer’s response to the message. While most might be able to get onboard with not digging through the emoji list to find the right one, the idea of being watched while scrolling through Facebook might prompt more than a few to follow CEO Mark Zuckerberg in covering the camera with duct tape if the patent ever becomes reality.

Product Review

Gate’s Smart Lock is locked and loaded but ultimately lacks important basics

In a world of video cameras and doorbells comes the Gate Smart Lock, a lock with a video camera embedded. It’s a great idea, but lacks some crucial functionality to make it a top-notch product.
Cars

Protect yourself and your ride with our favorite dash cams

Dashboard cameras can assist drivers in car accident claims, settle speeding ticket disputes, and even catch glimpses of incoming meteors, among other things. Here, we've compiled a list of the most noteworthy offerings available.
Mobile

Does this video show off the Huawei P30 Pro's impressive camera suite?

The Huawei P30 Pro will be announced on March 26. It has already started to leak ahead of this date, and expectations are high that the company will improve even further on the P20 Pro's camera.
Deals

The best budget-friendly GoPro alternatives that won’t leave you broke

Cold weather is here, and a good action camera is the perfect way to record all your adventures. You don't need to shell out the big bucks for a GoPro: Check out these great GoPro alternatives, including some 4K cameras, that won’t leave…
Social Media

Yep, it’s not just you. Facebook, Instagram, and WhatsApp are down for many

Facebook's family of apps has been suffering issues for much of the day. Instagram, WhatsApp, Facebook Messenger, and Facebook itself have been out of action for users around the world, with the company scrambling to sort it out.
Social Media

Facebook may soon let you watch live TV with friends in Watch Party

Facebook Watch Party is designed to allow friends to watch together, even when they can't be in the same physical space. Now, that feature could be expanding to include live TV. Facebook announced a test of the feature, starting with live…
Social Media

Federal investigation digs into Facebook’s data-sharing deals

Facebook confirmed it is cooperating with a federal criminal investigation. According to a report, the company is under investigation for sharing user data with smartphone and tablet companies.
Social Media

Facebook explains its worst outage as 3 million users head to Telegram

Facebook, if you didn't already know it, suffered a bit of an issue on Wednesday, March 13. An issue that took down not only its social networking site, but also Instagram, WhatsApp, and Messenger. On Thursday it offered an explanation.
Gaming

Snapchat could soon let you play games in between your selfies

If a new report is accurate, Snapchat will be getting an integrated gaming platform in April. The platform will feature mobile games form third-party developers, and one publisher is already signed on.
Social Media

Twitter is testing a handy subscription feature for following threads

Twitter has recently started testing a feature that lets you subscribe to a thread so that you’ll no longer need to like a comment or post to it yourself in order to receive notifications of new contributions.
Social Media

Your Google+ public content will remain viewable on the web, if you want it to

Google's failed social network — Google+ — will soon be wiped from the internet, but there's a team of volunteers working right now to save its public content for the Internet Archive.
Computing

There’s more space on MySpace after ‘accidental’ wipe of 50 million songs

MySpace is no longer a safe refuge for music and media produced in the 2000s. It said that almost any artistic content uploaded to the site between 2003 and 2015 may have been lost as part of a server migration last year.
Computing

Intel and Facebook team up to give Cooper Lake an artificial intelligence boost

Intel's upcoming Cooper Lake microarchitecture will be getting a boost when it comes to artificial intelligence processes, thanks to a partnership with Facebook. The results are CPUs that are able to work faster.
Social Media

New Zealand attack shows that as A.I. filters get smarter, so do violators

The shootings in Christchurch, New Zealand were livestreamed to social media, and while stats show networks are improving at removing offending videos, as the system improves, so do the violators' workarounds.