Keymochi, the smart mobile keyboard, can judge your mood based on how you type

how to send a text from your email account
kantver/123RF
There are a plethora of third-party keyboards that have been created for iPhone and iPad since Apple opened its mobile platform for keyboard support with iOS 8 in 2014. However, no keyboard that has been created thus far is quite like Keymochi.

You know that old saying about how it’s not what you say, but how you say it? Keymochi takes that idea and runs with it. Created as a research project by three Cornell Tech students, Hsiao-Ching Lin, Huai-Che Lu, and Claire Opila, Keymochi uses information about the way that we type to try and gauge our emotions.

This data includes information like typing speed, punctuation changes, smartphone motion sensor data, time of day, number of backspaces, distance between keys, and — yes — a smattering of sentiment analysis to work out how you’re feeling. All of this data is then fed into a machine-learning model to decode — with the results reportedly 82 percent accurate.

“For us, emotion-sensing is fascinating because it’s currently a missing part in today’s human-AI communications,” researcher Huai-Che Lu told Digital Trends. “Imagine a chatbot can recommend you a healing song when you are sad or suggest that you take some deep breaths when you are nervous.”

As Lu pointed out, detecting emotions based on physiological changes is not something completely new. There is an entire field dedicated to “affective computing,” with one key aspect of it — called sentic modulation — focused on studying the physiological changes that accompany changing emotions, such as facial expression, voice intonation, heart rate, and more.

keymochi emotion keyboard team  1

One of the key differentiators with Keymochi — in addition to the fact that it focuses on the lesser-studied topic of emotion detection using mobile keyboards — is that it aims to protect user privacy by doing all the data preprocessing on mobile devices. In this instance, the server only gets pseudonymous metadata and Keymochi’s creators are therefore unable to carry out reverse-engineering to learn what users are actually typing.

Unfortunately, the Keymochi app isn’t available to the public just yet. The keyboard is unlikely to find its way into the App Store anytime soon, although Lu said that the plan is to release its different components under open-source licenses. This would allow researchers to use the work to, for example, collect data (with the knowledge of users) in future HealthKit or CareKit research projects.

As for what is next, Lu said the team would like to build on this work.

“In the next semester, we’re planning to pivot a little bit by developing a productivity app to help people be more focused in their work based on the activity patterns on laptops,” he said. “Based on different focus levels, the app would suggest tasks that best suit to your current status — like doing some coding when you are ‘in the flow,’ and writing some emails when you are drained, as well as toggling the ‘do-not-disturb’ mode automatically.”

Emerging Tech

Awesome Tech You Can’t Buy Yet: Folding canoes and ultra-fast water filters

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Computing

Here’s how to install Windows on a Chromebook

If you want to push the functionality of your new Chromebook to another level, and Linux isn't really your deal, you can try installing Windows on a Chromebook. Here's how to do so, just in case you're looking to nab some Windows-only…
Gaming

How to make a clan in ‘Destiny 2’ and where to go from there

Want to know how to make a clan in 'Destiny 2'? Here's everything you need to know, including how to design your clan's banner, earn extra loot, and help other players with guided games.
Emerging Tech

An A.I. cracks the internet’s squiggly letter bot test in 0.5 seconds

How do you prove that you’re a human when communicating on the internet? The answer used to be by solving a CAPTCHA puzzle. But maybe not for too much longer. Here is the reason why.
Smart Home

How to talk to Santa on Alexa and Google Assistant

Nothing say "holiday" like talking to Santa. Here's how to talk to Santa on Alexa and Google Assistant, whether he's helping you create a playlist or checking to see if you've been naughty or nice this week.
Emerging Tech

New experiment casts doubt on claims to have identified dark matter

A South Korean experiment called COSINE-100 has attempted to replicate the claims of dark matter observed by the Italian DAMA/LIBRA experiment, but has failed to replicate the observations.
Emerging Tech

It’s no flying car, but the e-scooter had a huge impact on city streets in 2018

Within just a year, electric scooters have fundamentally changed how we navigate cities. From San Francisco to Paris, commuters have a new option that’s more fun than mass transit, easier than a bike, and definitely not a car.
Emerging Tech

White dwarf star unexpectedly emitting bright ‘supersoft’ X-rays

NASA's Chandra Observatory has discovered a white dwarf star which is emitting supersoft X-rays, calling into question the conventional wisdom about how X-rays are produced by dying stars.
Business

Amazon scouted airport locations for its cashier-free Amazon Go stores

Representatives of Amazon Go checkout-free retail stores connected with officials at Los Angeles and San Jose airports in June to discuss the possibility of cashier-free grab-and-go locations in busy terminals.
Emerging Tech

Full-fledged drone delivery service set to land in remote Canadian community

Some drone delivery operations seem rather crude in their execution, but Drone Delivery Canada is building a comprehensive platform that's aiming to take drone delivery to the next level.
Emerging Tech

Intel wants its fleet of drones to monitor America’s aging, unsafe bridges

Intel has signed a deal to use its Falcon 8+ drones to carry out bridge inspections. The hope is that these drones will be useful in spotting potential problems before they become serious.
Emerging Tech

Transplanted pig hearts show promise in baboon trials. Are humans next?

Researchers in Germany have successfully transplanted modified pig hearts into baboons. The results take us one step closer to ending organ transplant waiting lists for good. Here's why.
Emerging Tech

Makerbot is back with a new 3D printer that’s faster and more precise than ever

MakerBot's new Method 3D printer aims to bridge the gap between home 3D printers and more industrial 3D printing tech. Here are a few of the tantalizing things you can expect from it.
Giveaways

Print your heart’s desire: Enter our giveaway to win a free Monoprice 3D printer

We’re giving away a $400 Monoprice MP Voxel 3D Printer. It's easy to use, especially for beginners, with its simple menu system and touchscreen display. It comes fully assembled so you can spend more time printing instead of setting up.