Skip to main content

A.I. system seeks to turn thoughts of people unable to talk into speech

For the first time, neuroengineers have developed a system capable of translating thoughts directly into recognizable speech, marking an important step toward more advanced brain-computer interfaces for people who lack the ability to speak.

The system, which was created by researchers at Columbia University, works by monitoring a person’s brain activity, identifying brain signals, and reconstructing the words the individual hears. Powered by speech synthesizers and artificial intelligence, the technology lays the groundwork for helping individuals who are unable to speak due to disability regain their capacity to communicate verbally.

Recommended Videos

“Our ultimate goal is to develop technologies that can decode the internal voice of a patient who is unable to speak, such that it can be understood by any listener,” Nima Mesgarani, an electrical engineer at Columbia University who led the project, told Digital Trends by email.

Please enable Javascript to view this content

Parts of the brain light up like a Christmas tree — neurons firing left and right — when people speak or even simply think about speaking. Neural researchers have long endeavored to decode the patterns that emerge in these signals. But it isn’t easy. For years, scientists like Mesgarani have tried to translate brain activity to intelligible thought, using tools like computer models to analyze visual representations of sound frequencies.

In their recent work, Mesgarani and his team used a computer algorithm called a vocoder, which can generate speech-like sounds when trained on recordings of human speech. But to train the vocoder, Mesgarani needed brain models, so he partnered with Ashesh Dinesh Metah, a neurosurgeon at Northwell Health Physician Partners Neuroscience Institute in New York who treats epilepsy patients.

Mesgarani and Metah asked some of Metah’s patients to listen to speech recordings and measured their brain activity. The patterns in their brain activity trained the vocoder. The researchers then recorded the patients’ brain activity as they listened to people count to nine, which the vocoder attempted to recite by analyzing the neural signals.

The result isn’t perfect. The sounds it produces are robotic and, even after an A.I. system was used to “clean up” the vocoder to more intelligible levels, vaguely recognizable. But the researchers found that individuals could understand and repeat the sounds about 75 percent of the time.

Moving forward, the researchers plan to trial more complicated words before moving on to sentences. Their end goal is to integrate the system into an implant that could translates the thoughts directly into words.

A paper detailing the research was published last month in the journal Scientific Reports.

Dyllan Furness
Former Digital Trends Contributor
Dyllan Furness is a freelance writer from Florida. He covers strange science and emerging tech for Digital Trends, focusing…
Neuro-symbolic A.I. is the future of artificial intelligence. Here’s how it works
IBM Watson Shapes

Picture a tray. On the tray is an assortment of shapes: Some cubes, others spheres. The shapes are made from a variety of different materials and represent an assortment of sizes. In total there are, perhaps, eight objects. My question: “Looking at the objects, are there an equal number of large things and metal spheres?”

It’s not a trick question. The fact that it sounds as if it is is proof positive of just how simple it actually is. It’s the kind of question that a preschooler could most likely answer with ease. But it’s next to impossible for today’s state-of-the-art neural networks. This needs to change. And it needs to happen by reinventing artificial intelligence as we know it.

Read more
Is a Jeep Cherokee replacement slated for 2025?
Jeep Cherokee

Jeep is remaining somewhat mysterious about the name of a new hybrid SUV slated to be part of the brand’s lineup in 2025.
Speaking at the Los Angeles Auto Show recently, Jeep CEO Antonio Filosa would only say that a new compact SUV with a hybrid powertrain was indeed on the way, according to Automotive News.
Filosa had already confirmed last spring that a new “mainstream” large SUV would soon be launched by Jeep, adding that we "could probably guess what it will be called." His comments had sparked speculation that the Cherokee brand name would be back.
While the brand name has existed since 1974, the Cherokee Nation in the U.S. had officially asked Jeep to stop using its name in 2021.
Early last year, Jeep quietly discontinued the model, which was one of its most iconic SUVs of the past 50 years.
The reason? Besides slumping sales, Jeep at the time cited the confluence of market dynamics, consumer preferences, and strategic brand realignment.
The Cherokee was viewed as a classic four-door SUV, known both for its reliability and its ability to suit both off-road and urban environments.
But with time, “consumer preferences have significantly shifted towards larger SUVs equipped with the latest technology and enhanced safety features,” Jeep said at the time. “This trend is accompanied by an increasing demand for environmentally friendly vehicles, steering the market towards hybrid and electric models.”
While no one knows for sure what the new SUV hybrid will be called, Jeep's parent company, Stellantis, is certainly doing everything it can to steer all its brands in the hybrid and electric direction.

Stellantis recently launched a new platform called STLA Frame that’s made for full-size trucks and SUVs. The platform is designed to deliver a driving range of up to 690 miles for extended-range electric vehicles (EREVs) and 500 miles for battery electric vehicles (BEVs).

Read more
Teslas likely won’t get California’s new EV tax rebate
teslas likely wont get californias new ev tax rebate ap newsom 092320 01 1

California seems eager to reassert itself, not only as one of the largest economies in the world, but one where EVs will continue to thrive.

Governor Gavin Newsom has announced California will seek to revive state-tax rebates for electric vehicles should the incoming Trump administration carry out its plans to end the existing $7,500 federal incentive on EVs.

Read more