Skip to main content

This hearing aid will read your brain to help you understand what’s being said

Aminah Mohd Idris/EyeEm/Getty Images
Aminah Mohd Idris/EyeEm/Getty Images

One common complaint from people who wear a hearing aid is that, while they can hear speech, they are unable to make out its meaning. That is because, while the two things are related, hearing and understanding aren’t the same thing. A new technique developed by researchers from KU Leuven in Belgium, in collaboration with the University of Maryland, may offer an alternative solution, however.

They have developed an automatic test involving an EEG brain cap, in which scientists can look at a person’s brainwaves to see not only whether they have heard a particular sound, but whether they have actually understood it. The test involves using 64 electrodes to measure a patient’s brainwaves while they listen to a sentence. Based on the brain waveform response, this can then be used to reveal whether or not a patient understands what has been said to them.

“Our method is independent of the listener’s state of mind,” Jonas Vanthornhout, one of the researchers on the project, told Digital Trends. “Even if the listener doesn’t pay attention, we can measure speech understanding. We can do this because we directly measure speech understanding from the brain. We reconstruct the speech signals from your brainwaves. When the reconstruction succeeds, this means that you have understood the message. When the reconstruction fails, you didn’t understand the message. Our method will allow for a more accurate diagnosis of patients who cannot actively participate in a speech understanding test because they’re too young, for instance, or because they’re in a coma.”

At present, this is just a neat tech demo. However, as Vanthornhout suggests, long-term, this be used to create some fascinating consumer-facing products. Imagine, for example, smart hearing aids or cochlear implants which adjust their signal based on how well you are understanding a particular speaker. The technology could also decrease the screening time for hearing loss. In addition, we would be fascinated to see whether this has any application within education, to discover whether learners are understanding the words they hear in class. (Although apparently it can not be used to test a deep understanding of course material.)

“We are currently mapping the effects of attention on speech understanding,” Vanthornhout continued. “In order to make our method more clinically relevant, we are also validating it in a population of hearing aid users, cochlear implant users, and in multiple age groups. We are also investigating how the different parts of the brain contribute to speech understanding.”

A paper describing the work was recently published in the Journal of the Association for Research in Otolaryngology.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
This A.I. literally reads your mind to re-create images of the faces you see
parkinsons disease brain cells reprogrammed scan

Do you see what I see? Harnessing brain waves can help reconstruct mental images

Google’s artificial intelligence technology may sometimes seem like it’s reading our mind, but neuroscientists at Canada’s University of Toronto Scarborough are literally using A.I. for that very purpose -- by reconstructing images based on brain perception using data gathered by electroencephalography (EEG).

Read more
Next-gen cochlear implant restores hearing by shining a laser beam in your ear
laser cochlear implant img 6396

Could focused laser light be used to help deaf people hear again? Based on some innovative work by a team of researchers in Europe, the answer certainly seems to be a resounding “yes.” What the team of engineers from Germany, Switzerland, and Austria have invented is a brand-new type of cochlear hearing implant that uses laser pulses to trigger auditory signals from hair cells in the inner ear. The result? A more focused listening device that could prove transformative for those lucky enough to wear it.

The laser-based approach differs significantly from conventional cochlear implants, which use electric fields to stimulate auditory nerves. The problem with this method is the challenge of stimulating a single auditory nerve in the cochlea, due to the fact that the auditory portion of the inner ear is tiny and crams lots of nerves into a closed space -- meaning-less focused electric fields, and worse sound quality. Lasers, on the other hand, are much more efficient at targeting specific areas of the ear.

Read more
Cognitive hearing aid uses AI and brain waves to enhance voices
hearing aid

Whether it’s Apple’s smart cochlear implant collaboration or tools designed to make sign language communication easier, there is no shortage of cutting-edge gadgetry available to make life easier for people who are deaf or hard of hearing. A new piece of technology coming out of Columbia University School of Engineering and Applied Science could make things even better, however -- courtesy of a hearing aid that is designed to read brain activity to determine which voice a hearing aid user is most interested in listening to and then focusing in on it. The resulting “cognitive hearing aid” could be transformative in settings like crowded rooms in which multiple people are speaking at the same time.

“My research has been focused on understanding how speech is processed in the brain, and to create models of it that can be used in automatic speech-recognition technologies,” Nima Mesgarani, an associate professor of electrical engineering, told Digital Trends. “Working at the intersection of brain science and engineering, I saw a unique opportunity to combine the latest advances from both fields, to create a solution for decoding the attention of a listener to a specific speaker in a crowded scene which can be used to amplify that speaker relative to others.”

Read more