Skip to main content

Cognitive hearing aid uses AI and brain waves to enhance voices

hearing aid
Alexander Raths/123RF
Whether it’s Apple’s smart cochlear implant collaboration or tools designed to make sign language communication easier, there is no shortage of cutting-edge gadgetry available to make life easier for people who are deaf or hard of hearing. A new piece of technology coming out of Columbia University School of Engineering and Applied Science could make things even better, however — courtesy of a hearing aid that is designed to read brain activity to determine which voice a hearing aid user is most interested in listening to and then focusing in on it. The resulting “cognitive hearing aid” could be transformative in settings like crowded rooms in which multiple people are speaking at the same time.

“My research has been focused on understanding how speech is processed in the brain, and to create models of it that can be used in automatic speech-recognition technologies,” Nima Mesgarani, an associate professor of electrical engineering, told Digital Trends. “Working at the intersection of brain science and engineering, I saw a unique opportunity to combine the latest advances from both fields, to create a solution for decoding the attention of a listener to a specific speaker in a crowded scene which can be used to amplify that speaker relative to others.”

Mesgarani says that, up until now, no hearing aid on the market has addressed this specific problem. While the latest hearing aids feature technology designed to suppress background noise, these hearing aids have no way of knowing which voices a wearer wants to listen to, and which are the distractors.

The device Mesgarani and team came up with constantly monitors the brain activity of the wearer to solve this issue. To do this, it uses a deep neural network which automatically separates each of the speakers from the background hubbub and compares each speaker with the neural data from the user’s brain. The speaker who best matches the neural data is then amplified to assist the user.

It’s a great concept — although it may still be a bit longer before the finished product is available to wearers. Next, the team hopes to develop better algorithms for performing the task in all possible conditions, as well as finding a way to make the neural recording process less intrusive.

“Many researchers have been developing techniques for measuring the brain signal from inside the ear,” Mesgarani continued. “Imagine an earbud with electrodes placed around it. [Another solution might include] C-shape grids placed around the ear, similar to a [regular] hearing aid.”

A paper describing this work was recently published in the Journal of Neural Engineering.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Don’t buy the Meta Quest Pro for gaming. It’s a metaverse headset first
Meta Quest Pro enables 3D modeling in mixed reality.

Last week’s Meta Connect started off promising on the gaming front. Viewers got release dates for Iron Man VR, an upcoming Quest game that was previously a PS VR exclusive, as well as Among Us VR. Meta, which owns Facebook, also announced that it was acquiring three major VR game studios -- Armature Studio, Camouflaj Team, and Twisted Pixel -- although we don’t know what they’re working on just yet.

Unfortunately, that’s where the Meta Connect's gaming section mostly ended. Besides tiny glimpses and a look into fitness, video games were not the show's focus. Instead, CEO Mark Zuckerberg wanted to focus on what seemed to be his company’s real vision of VR's future, which involves a lot of legs and a lot of work with the Quest Pro, a mixed reality headset that'll cost a whopping $1,500.

Read more
Meet the game-changing pitching robot that can perfectly mimic any human throw
baseball hitter swings and misses

Who’s your favorite baseball pitcher? Shane McClanahan? Sandy Alcantara? Justin Verlander? Whoever you said, two of the top sports-tech companies in the U.S. -- Rapsodo and Trajekt Sports -- have teamed up to build a robot version of them, and the results are reportedly uncannily accurate.

Okay, so we’re not talking about walking-talking-pitching standalone robots, as great a sci-fi-tinged MLB ad as that would be. However, Rapsodo and Trajekt have combined their considerable powers to throw a slew of different technologies at the problem of building a machine that's able to accurately simulate the pitching style of whichever player you want to practice batting against -- and they may just have pulled it off, too.

Read more
The best portable power stations
EcoFlow DELTA 2 on table at campsite for quick charging.

Affordable and efficient portable power is a necessity these days, keeping our electronic devices operational while on the go. But there are literally dozens of options to choose from, making it abundantly difficult to decide which mobile charging solution is best for you. We've sorted through countless portable power options and came up with six of the best portable power stations to keep your smartphones, tablets, laptops, and other gadgets functioning while living off the grid.
The best overall: Jackery Explorer 1000

Jackery has been a mainstay in the portable power market for several years, and today, the company continues to set the standard. With three AC outlets, two USB-A, and two USB-C plugs, you'll have plenty of options for keeping your gadgets charged.

Read more