Skip to main content

Don’t speak: This wearable lets you give voice commands without saying a word

Playing Chess with Alterego by Arnav Kapur and MIT
Arnav Kapur/MIT

Imagine if you had a version of Amazon’s Alexa or Google Assistant inside your head, capable of feeding you external information whenever you required it, without you needing to say a single word and without anyone else hearing what it had to say back to you. An advanced version of this idea is the basis for future tech-utopian dreams like Elon Musk’s Neuralink, a kind of connected digital layer above the cortex that will let our brains tap into hitherto unimaginable machine intelligence.

Arnav Kapur, a postdoctoral student with the MIT Media Lab, has a similar idea. And he’s already shown it off.

The current AlterEgo device prototype looks a bit like one of those popstar Britney mics, as imagined by the designers of the Star Trek: The Next Generation TV show. It’s not exactly inconspicuous, but it also doesn’t look significantly different from the kind of hands-free kits that people too busy to physically hold their phones have been using for years. But it’s what it does that makes it really exciting.

AlterEgo: Interfacing with devices through silent speech

AlterEgo is, for all intents and purposes, the closest thing we’ve got to detailed mind-reading technology. No, it doesn’t actually read the electrical signals from your brain, but it does let you silently ask questions, and then either have the answer fed back to your via bone-conduction technology. For a person with a speech impediment, it could also be used to dictate words for a computer to read out.

“Throughout the history of personal computing, computers have always been external systems or entities that we interact with: desktops, smartphones, artificial intelligence tools, and even robots,” Kapur told Digital Trends. “Could we flip this paradigm? Could we augment and extend human abilities and weave the powers of computing and machine intelligence as an intrinsic human cognitive ability.”

Augmenting abilities

Picture, for instance, wondering what the weather is like in Cape Town, South Africa. Like a surreptitious Siri, AlterEgo could look up this information and let you know the answer in an audio form that only you can hear. Or how about relaying information to your smart home devices to switch your lights on and off, or to start up your coffee machine from another room? Or how about traveling to a foreign country, internally vocalizing a phrase and having it translated into another language to enable multilingual conversation? Or doing complex sums in your head and instantly “knowing” the answer.

Alterego by Arnav Kapur and MIT
Arnav Kapur/MIT

The applications become more profound when considering how such a device could be used for a person with a neurodegenerative disease like Alzheimer’s. It could be possible to internally record semantic information and access this at a later time. (To be honest, many of us would probably benefit from this!). Or to offer unspoken cues in the form of memory aids. The dictation element would additionally prove a game-changer for people with speech disabilities caused by conditions ranging from strokes, brain injuries and tumors to Parkinson’s disease, ALS, Huntington’s disease, cerebral palsy, and more.

“My goal with AlterEgo is to enable people with speech pathologies to communicate in real time, the rates at which I speak,” Kapur said. “My current work with the system is working with a variety of patients and optimizing and engineering the system to enable communication.” According to him, the total number of people in the U.S. who fall into this category number around 7.5 million, roughly equivalent to the entire state of Washington.

So how does this potentially revolutionary technology work? “There are over 100 muscles involved in speech,” Kapur explained. “Now imagine only using a small fraction of those, and talking to yourself internally without producing any sound, without moving your lips, jaw or facial muscles. The system captures subtle neurological activation of the internal speech systems from the surface of the skin, even though the signal source is inside.”

Arnav Kapur: $15,000 "Use it!" Lemelson-MIT Student Prize Graduate Winner

Kapur refers to the principle of electrical communication as “the currency of the human body.” When a person picks up a glass of water, moves their eyes, or types a brilliant article for Digital Trends, this involves an electrical signal traveling through the nerves to instruct a specific muscle to activate in a certain way in order to complete the action.

The power of inner speech

“You could think of internal speech system as really small batteries and what we do is measure change in the voltage,” he continued. “By carefully measuring the change in electrical field, you could sense activation of the neuromuscular unit — this is then translated into speech. The A.I. is trained on recognizing these signals and then makes sense of those commands. [Finally, it] sends an audio response through audio conducted through the skull into the user’s inner ear so as to not disrupt the user’s natural hearing of the world.”

The AlterEgo device is not yet available commercially, although for his work on it Kapur has picked up a $15,000 Lemelson-MIT Student Prize. Should this device make it to market, and live up to its potential, we imagine plenty more of both of those — prizes and cash — will follow.

“Our priority is to develop a non-invasive and non-intrusive system that does not render ethics as an afterthought,” Kapur said. “We are currently refining the technology and working on deployment with full steam.”

Before too long, hopefully you’ll be able to whip out your wallet and buy one. You know you want to: the little voice in your head, inaudible to everyone else, told you to.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more
AI turned Breaking Bad into an anime — and it’s terrifying
Split image of Breaking Bad anime characters.

These days, it seems like there's nothing AI programs can't do. Thanks to advancements in artificial intelligence, deepfakes have done digital "face-offs" with Hollywood celebrities in films and TV shows, VFX artists can de-age actors almost instantly, and ChatGPT has learned how to write big-budget screenplays in the blink of an eye. Pretty soon, AI will probably decide who wins at the Oscars.

Within the past year, AI has also been used to generate beautiful works of art in seconds, creating a viral new trend and causing a boon for fan artists everywhere. TikTok user @cyborgism recently broke the internet by posting a clip featuring many AI-generated pictures of Breaking Bad. The theme here is that the characters are depicted as anime characters straight out of the 1980s, and the result is concerning to say the least. Depending on your viewpoint, Breaking Bad AI (my unofficial name for it) shows how technology can either threaten the integrity of original works of art or nurture artistic expression.
What if AI created Breaking Bad as a 1980s anime?
Playing over Metro Boomin's rap remix of the famous "I am the one who knocks" monologue, the video features images of the cast that range from shockingly realistic to full-on exaggerated. The clip currently has over 65,000 likes on TikTok alone, and many other users have shared their thoughts on the art. One user wrote, "Regardless of the repercussions on the entertainment industry, I can't wait for AI to be advanced enough to animate the whole show like this."

Read more