Skip to main content

MIT algorithm learns to understand emotions and sarcasm through emojis

Image used with permission by copyright holder
In less than a decade, emojis have become a cultural phenomenon. In 2011, comedian Aziz Ansari pointed out that a popular rap song could be nearly translated into emojis. July 17, 2014, was named the first annual World Emoji Day, and this summer we even got the The Emoji Movie.

Despite that unfortunate film, the emoji trend is far from dead. In fact, they’re as prevalent as ever, conveying meaning and emotion when words just aren’t enough.

Researchers at the Massachusetts Institute of Technology have now developed an artificial intelligence system that understands emotion and sarcasm after being trained on emojis.

Teaching meaning through emojis might sound like a whimsical lesson, but the researchers behind the project had more grand goals for their system, DeepMoji.

“We wanted to study racism and bullying on social media, but the traditional methods couldn’t handle modern slang,” Bjarke Felbo, a graduate student who worked on the project, told Digital Trends. “So we turned to the billions of emojis on social media and AI techniques for help.”

The model developed by Bjarke and his team, including associate professor Iyad Rahwan, learned to discern emotion and meaning from slang like bae and swag, while — more impressively — unraveling entire phrases. For example, the model realized that a phrase like “this is the shit” is actually a positive statement and “i love to clean toilets” is said sarcastically.

“Having an understanding of modern slang and sarcasm is critical to capture insults on social media,” Felbo said.

“The basic idea is that if the model is able to predict which emoji was included with a given sentence, then it has an understanding of the emotional content of that sentence,” he added. “We thus train our model to predict emojis on a dataset of 1.2 billion tweets.”

During its lesson, DeepMoji was tasked with grouping emojis into categories like negativity, positivity, and love. Within these categories, the model differentiated emojis into subcategories, such as angry or annoyed.

“Once the model has this nuanced understanding of emotional content in language, it’s much easier for it to learn concepts like sarcasm,” Felbo said. “Hopefully, with this model, AI researchers and social scientists can now go beyond the traditional dull positive and negative sentiment analysis.”

Felbo pointed out that DeepMoji is capable of understanding emotions in any text, not just emojis. “In fact,” he said, “we tested it across different types of text such as article headlines, written emotional experiences, serious debate forums … and beat state-of-the-art algorithms across all of these.”

Felbo and his team have developed a DeepMoji website where users can see the emoji aspect of the system in action. By highlighting certain parts of a sentence, the algorithm shows which emojis are most associated with the resulting phrase. Users can also annotate their own tweets in order to contribute to the research.

Editors' Recommendations

Dyllan Furness
Dyllan Furness is a freelance writer from Florida. He covers strange science and emerging tech for Digital Trends, focusing…
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more
AI turned Breaking Bad into an anime — and it’s terrifying
Split image of Breaking Bad anime characters.

These days, it seems like there's nothing AI programs can't do. Thanks to advancements in artificial intelligence, deepfakes have done digital "face-offs" with Hollywood celebrities in films and TV shows, VFX artists can de-age actors almost instantly, and ChatGPT has learned how to write big-budget screenplays in the blink of an eye. Pretty soon, AI will probably decide who wins at the Oscars.

Within the past year, AI has also been used to generate beautiful works of art in seconds, creating a viral new trend and causing a boon for fan artists everywhere. TikTok user @cyborgism recently broke the internet by posting a clip featuring many AI-generated pictures of Breaking Bad. The theme here is that the characters are depicted as anime characters straight out of the 1980s, and the result is concerning to say the least. Depending on your viewpoint, Breaking Bad AI (my unofficial name for it) shows how technology can either threaten the integrity of original works of art or nurture artistic expression.
What if AI created Breaking Bad as a 1980s anime?
Playing over Metro Boomin's rap remix of the famous "I am the one who knocks" monologue, the video features images of the cast that range from shockingly realistic to full-on exaggerated. The clip currently has over 65,000 likes on TikTok alone, and many other users have shared their thoughts on the art. One user wrote, "Regardless of the repercussions on the entertainment industry, I can't wait for AI to be advanced enough to animate the whole show like this."

Read more
4 simple pieces of tech that helped me run my first marathon
Garmin Forerunner 955 Solar displaying pace information.

The fitness world is littered with opportunities to buy tech aimed at enhancing your physical performance. No matter your sport of choice or personal goals, there's a deep rabbit hole you can go down. It'll cost plenty of money, but the gains can be marginal -- and can honestly just be a distraction from what you should actually be focused on. Running is certainly susceptible to this.

A few months ago, I ran my first-ever marathon. It was an incredible accomplishment I had no idea I'd ever be able to reach, and it's now going to be the first of many I run in my lifetime. And despite my deep-rooted history in tech, and the endless opportunities for being baited into gearing myself up with every last product to help me get through the marathon, I went with a rather simple approach.

Read more