Skip to main content

Keymochi, the smart mobile keyboard, can judge your mood based on how you type

how to send a text from your email account
There are a plethora of third-party keyboards that have been created for iPhone and iPad since Apple opened its mobile platform for keyboard support with iOS 8 in 2014. However, no keyboard that has been created thus far is quite like Keymochi.

You know that old saying about how it’s not what you say, but how you say it? Keymochi takes that idea and runs with it. Created as a research project by three Cornell Tech students, Hsiao-Ching Lin, Huai-Che Lu, and Claire Opila, Keymochi uses information about the way that we type to try and gauge our emotions.

Related Videos

This data includes information like typing speed, punctuation changes, smartphone motion sensor data, time of day, number of backspaces, distance between keys, and — yes — a smattering of sentiment analysis to work out how you’re feeling. All of this data is then fed into a machine-learning model to decode — with the results reportedly 82 percent accurate.

“For us, emotion-sensing is fascinating because it’s currently a missing part in today’s human-AI communications,” researcher Huai-Che Lu told Digital Trends. “Imagine a chatbot can recommend you a healing song when you are sad or suggest that you take some deep breaths when you are nervous.”

As Lu pointed out, detecting emotions based on physiological changes is not something completely new. There is an entire field dedicated to “affective computing,” with one key aspect of it — called sentic modulation — focused on studying the physiological changes that accompany changing emotions, such as facial expression, voice intonation, heart rate, and more.

One of the key differentiators with Keymochi — in addition to the fact that it focuses on the lesser-studied topic of emotion detection using mobile keyboards — is that it aims to protect user privacy by doing all the data preprocessing on mobile devices. In this instance, the server only gets pseudonymous metadata and Keymochi’s creators are therefore unable to carry out reverse-engineering to learn what users are actually typing.

Unfortunately, the Keymochi app isn’t available to the public just yet. The keyboard is unlikely to find its way into the App Store anytime soon, although Lu said that the plan is to release its different components under open-source licenses. This would allow researchers to use the work to, for example, collect data (with the knowledge of users) in future HealthKit or CareKit research projects.

As for what is next, Lu said the team would like to build on this work.

“In the next semester, we’re planning to pivot a little bit by developing a productivity app to help people be more focused in their work based on the activity patterns on laptops,” he said. “Based on different focus levels, the app would suggest tasks that best suit to your current status — like doing some coding when you are ‘in the flow,’ and writing some emails when you are drained, as well as toggling the ‘do-not-disturb’ mode automatically.”

Editors' Recommendations

If you use a Mac, you should know these 5 keyboard shortcuts
Apple MacBook Pro side view showing keyboard deck and ports.

There are plenty of keyboard shortcuts that you're probably already using on your MacBook for common tasks. Yet, Apple has also built in several system shortcuts that might end up saving you some time or, in some cases, some struggles.

That's why we put together this guide looking at five different Mac shortcuts you didn't know about. Our guide covers volume and brightness adjustments, Airdrop, and much more.
Fine-tune your brightness

Read more
How to tell if your smartphone has been hacked
Kids playing on a smartphone.

Smartphones have profoundly changed the way people live, communicate with each other, and keep themselves entertained. But like everything else, there's a downside. Corrupt people always want what doesn't belong to them, and devise elaborate criminal methods to get what they want and make everyone else miserable. When thieves hack smartphones, they take more than possessions -- they steal information, money, identity, and -- in some cases -- reputation, all of which can destabilize and endanger the target's health and well-being.

Don't bother expending any effort to identify the hacker. While it's possible to find out who broke into your phone, most of these searches wind up failing. That's because most phone hackers operate on the dark web and behind proxy servers. They specialize in covering their tracks. Most cyberattacks and phone hacks are carried out via malware, anyway, so despite how personal it may feel, mostly it's not personal at all.

Read more
How to find your own phone number on iOS or Android
Rebtel Calling

Gone are the days when phone numbers were as commonly memorized as street addresses. While you once had your own phone number, your best friend's, your crush's, and the one for the local pizza shop all at the top of mind, the advent of smartphones has rendered this memory exercise moot. Like most people, you probably don’t call your own phone number very often -- and if you do, it's likely listed in your Favorites -- so you may not know it off the top of your head.

With that reality comes the familiar grip of panic when a new acquaintance asks for your mobile phone number and you have no clue. Or maybe you're so used to sharing your second phone number that you forgot the first! 

Read more