Keymochi, the smart mobile keyboard, can judge your mood based on how you type

how to send a text from your email account
kantver/123RF
There are a plethora of third-party keyboards that have been created for iPhone and iPad since Apple opened its mobile platform for keyboard support with iOS 8 in 2014. However, no keyboard that has been created thus far is quite like Keymochi.

You know that old saying about how it’s not what you say, but how you say it? Keymochi takes that idea and runs with it. Created as a research project by three Cornell Tech students, Hsiao-Ching Lin, Huai-Che Lu, and Claire Opila, Keymochi uses information about the way that we type to try and gauge our emotions.

This data includes information like typing speed, punctuation changes, smartphone motion sensor data, time of day, number of backspaces, distance between keys, and — yes — a smattering of sentiment analysis to work out how you’re feeling. All of this data is then fed into a machine-learning model to decode — with the results reportedly 82 percent accurate.

“For us, emotion-sensing is fascinating because it’s currently a missing part in today’s human-AI communications,” researcher Huai-Che Lu told Digital Trends. “Imagine a chatbot can recommend you a healing song when you are sad or suggest that you take some deep breaths when you are nervous.”

As Lu pointed out, detecting emotions based on physiological changes is not something completely new. There is an entire field dedicated to “affective computing,” with one key aspect of it — called sentic modulation — focused on studying the physiological changes that accompany changing emotions, such as facial expression, voice intonation, heart rate, and more.

keymochi emotion keyboard team  1

One of the key differentiators with Keymochi — in addition to the fact that it focuses on the lesser-studied topic of emotion detection using mobile keyboards — is that it aims to protect user privacy by doing all the data preprocessing on mobile devices. In this instance, the server only gets pseudonymous metadata and Keymochi’s creators are therefore unable to carry out reverse-engineering to learn what users are actually typing.

Unfortunately, the Keymochi app isn’t available to the public just yet. The keyboard is unlikely to find its way into the App Store anytime soon, although Lu said that the plan is to release its different components under open-source licenses. This would allow researchers to use the work to, for example, collect data (with the knowledge of users) in future HealthKit or CareKit research projects.

As for what is next, Lu said the team would like to build on this work.

“In the next semester, we’re planning to pivot a little bit by developing a productivity app to help people be more focused in their work based on the activity patterns on laptops,” he said. “Based on different focus levels, the app would suggest tasks that best suit to your current status — like doing some coding when you are ‘in the flow,’ and writing some emails when you are drained, as well as toggling the ‘do-not-disturb’ mode automatically.”

Emerging Tech

Fears about kids’ screen use may have been overblown, Oxford researchers find

Many people take it as gospel that digital technologies are harmful to young people’s mental health. But is this true? A recent study from the University of Oxford takes a closer look.
Computing

Watch out for these top-10 mistakes people make when buying a laptop

Buying a new laptop is exciting, but you need to watch your footing. There are a number of pitfalls you need to avoid and we're here to help. Check out these top-10 laptop buying mistakes and how to avoid them.
Computing

Keep your laptop battery in tip-top condition with these handy tips

Learn how to care for your laptop's battery, how it works, and what you can do to make sure yours last for years and retains its charge. Check out our handy guide for valuable tips, no matter what type of laptop you have.
Computing

Yes, Android apps can run on your PC, and it's easier than you think

Wish you knew how to run Android apps in Windows? It's easier than you might think and there are a number of different ways to do it. In this guide, we break down the steps so you can follow along with ease.
Mobile

Is your smartphone frozen? Here's how to reset your iPhone

You can do a lot with an iPhone, but if you ever run into an issue with it, the first thing you should do is restart it. In this guide, we tell you how to reset your iPhone, and explain how it differs from a factory reset.
Emerging Tech

Meet Wiliot, a battery-less Bluetooth chip that pulls power from thin air

A tiny chip from a semiconductor company called Wiliot could harvest energy out of thin air, the company claims. No battery needed. The paper-thin device pulls power from ambient radio frequencies like Wi-Fi, Bluetooth, and cell signals.
Emerging Tech

Hexbot is a modular robot arm that does everything from drawing to playing chess

Who wouldn’t want their own personal robot arm to do everything from laser engraving to competing against you in a game of chess? That's what Hexbot, a new modular robot, promises to deliver.
Emerging Tech

The best drone photos from around the world will take your breath away

Most of today's drones come equipped with high-end cameras, which are quickly revolutionizing the world of aerial photography as we know it. Here are some of the best drone photos from around the world.
Emerging Tech

Too buzzed to drive? Don’t worry — this autonomous car-bar will drive to you

It might just be the best or worst idea that we've ever heard: A self-driving robot bartender you can summon with an app, which promises to mix you the perfect drink wherever you happen to be.
Emerging Tech

Scientists successfully grow human blood vessels in a Petri dish

Researchers have managed to grow human blood vessels in a Petri dish for the first time, and even to successfully implant them into live mice. The results could be a game-changer for diabetes.
Emerging Tech

Tiny animals discovered in Antarctic lake deep beneath the ice

Scientists have made a surprising discovery in Antarctica: the carcasses of tiny animals including crustaceans and a tardigrade were found in a lake that sits deep beneath over half a mile of Antarctic ice.
Emerging Tech

How long is a day on Saturn? Scientists finally have an answer

The length of Saturn's day has always been a challenge to calculate because of the planet's non-solid surface and magnetic field. But now scientists have tracked vibrations in the rings to pin down a final answer.
Emerging Tech

Awesome Tech You Can’t Buy Yet: camera with A.I. director, robot arm assistant

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Emerging Tech

Google’s radar-sensing tech could make any object smart

Computer scientists have shown how Google’s Soli sensor can be used to make dumb objects smart. Here's why radar-powered computing could finally make the dream of smart homes a reality.