Skip to main content

Facebook’s ‘brain-computer interface’ could let you type with your mind

To many, the idea of typing with your thoughts may sound like the stuff of sci-fi movies, but Facebook has been financing research on this endeavor for the last couple of years. And it’s getting somewhere.

This week, Facebook’s research division offered an update on its bold scientific ambition — an ambition that some may believe has the potential to extend Facebook’s sprawling social networking tentacles to the inside of our very minds. What do you mean you didn’t sign up for that?

Related Videos

The company’s plan for a noninvasive, wearable, brain-reading computer interface is making progress following recent research at the University of California, San Francisco (UCSF) on human volunteers. It could ultimately allow those who have lost the ability to vocalize words to instead communicate in real-time through their thoughts, giving them a whole new lease of life.

An update on the work, published in Nature on Tuesday, July 30, reveals that the team of Facebook-backed engineers has been able to develop so-called “speech decoders” capable of understanding what a person wants to say through analysis of their brain signals.

“Currently, patients with speech loss due to paralysis are limited to spelling words out very slowly using residual eye movements or muscle twitches to control a computer interface,” speech neuroscientist Eddie Chang, who’s working on the research, said in a release. “But in many cases, information needed to produce fluent speech is still there in their brains.” The technology being developed will allow them to express it.

Creating a brain-computer interface

To reach its goal of creating an effective and reliable brain-computer interface, Chang’s team, together with postdoctoral researcher David Moses, conducted research using electrodes implanted into the brains of three volunteers at the UCSF Epilepsy Center.

Experiments were geared toward developing a method of instantly identifying the volunteers’ spoken responses based only on the activity of their brain. After much effort, the researchers reached a point where they were able to see — on a PC screen — a word or phrase derived from brain activity as the participant spoke it.

An early research kit of a wearable brain-computer interface device, built by Facebook Reality Labs. Facebook

At the current time, however, the technology is only able to recognize a very limited number of words, but Moses said that in future studies “we hope to increase the flexibility as well as the accuracy of what we can translate from brain activity.”

Chang said that for years, his lab “was mainly interested in fundamental questions about how brain circuits interpret and produce speech,” adding, “With the advances we’ve seen in the field over the past decade, it became clear that we might be able to leverage these discoveries to help patients with speech loss, which is one of the most devastating consequences of neurological damage,” whether through brainstem stroke, spinal cord injury, neurodegenerative disease, or some other condition.

Facebook AR glasses

Technology emerging from the research could also be incorporated into the AR glasses being developed by  Facebook. Andrew Bosworth, Facebook vice president of AR/VR, tweeted on Tuesday that the research could help it to build “a noninvasive wearable device that lets people type just by imagining what they want to say,” adding, “Our progress shows real potential in how future inputs and interactions with AR glasses could one day look.”

The company said that its face-based technology is unlikely to be ready anytime soon, describing its current state as “bulky, slow, and unreliable,” but added that it would continue to work on it as it has “significant” potential.

Facebook isn’t the only high-profile tech firm to take an interest in the squishy, gray matter inside our cranium. SpaceX and Tesla founder Elon Musk has also found the time to launch Neuralink, a company with an aim to better understand and treat brain disorders, as well as to “preserve and enhance your own brain” to keep pace with artificial intelligence (A.I.).

Editors' Recommendations

Facebook’s newest tech will let you type with your brain and hear with your skin
facebook typing with your brain thinking feat

Facebook has some pretty surprising ideas about the future of communication, and they extend far beyond news feeds and even augmented reality. The social media giant announced during day two of its F8 developer conference that its Building 8 hardware lab is working on technology that will one day allow you to type with your thoughts and hear through your skin.

Our brains, along with the cochleas in our ears, possess the power to reconstruct language from components, and Facebook is looking at hardware and software to transmit those components to the body via pressure changes and vibrations. During the day 2 keynote, the company demonstrated a video of one of its engineers repeating words communicated to her through sensors embedded in a sleeve on her arm. Simple words, like "blue" or "cube," were sent through a smartphone, and the engineer was able to understand without a single word being uttered.

Read more
See the cyborg system that lets humans control turtles with their minds
parasitic robot turtles mind control human turtle interface

Researchers from the Korea Advanced Institute of Science and Technology (KAIST) are developing a technology that enables humans to control turtles with their minds. The human-turtle interface combines features from brain-computer interfaces and computer-brain interfaces, which send signals from brains to computers and computers to brains respectively.

Over the past few years, handful of labs have demonstrated remote control of animals, typically insects. However, these techniques are usually invasive and require operations, such as implanting electrodes in the animal’s brain or nervous system.

Read more
Apps let you see how furniture will look in your home without straining your back
chairish decaso augmented reality chairish02

Two applications that help furniture shoppers find items to buy have now added augmented reality functionality, which lets them see how potential purchases would look in their homes. It allows them to make sure that whatever they're buying will fit perfectly -- in terms of size, color and style --into whatever room they plan to put it.

One of the biggest downsides to buying anything online is that you never quite know how it will look or feel in the real world. That goes doubly so for larger items like furniture, because even with tape measures, dimensions and pictures, it's not always easy to envision just how it will look. The new augmented reality feature in Chairish and Decaso's applications, removes much of the guesswork.

Read more