Skip to main content

New A.I. can identify the song you’re listening to by reading your brain waves

song identifying ai
Krishna P. Miyapuram

From Journey’s “Don’t Stop Believin’” to Queen’s “Bohemian Rhapsody” to Kylie Minogue’s “Can’t Get You Out Of My Head,” there are some songs that manage to successfully worm their way down our ear canals and take up residence in our brains. What if it was possible to read the brain’s signals, and to use these to accurately guess which song a person is listening to at any given moment?

That’s what researchers from the Human-Centered Design department at Delft University of Technology in the Netherlands and the Cognitive Science department at the Indian Institute of Technology Gandhinagar have been working on. In a recent experiment, they demonstrated that it is eminently possible — and the implications could be more significant than you might think.

For the study, the researchers recruited a group of 20 people. and asked them to listen to 12 songs using headphones. To aid with their focus, the room was darkened and the volunteers blindfolded. Each was fitted with an electroencephalography (EEG) cap that’s able to noninvasively pick up the electrical activity on their scalp as they listen to the songs.

This brain data, alongside the corresponding music, was then used to train an artificial neural network to be able to identify links between the two. When the resulting algorithm was tested on data it hadn’t seen before, it was able to correctly identify the song with 85% accuracy — based entirely on the brain waves.

“The songs were a mix of Western and Indian songs, and included a number of genres,” Krishna Miyapuram, assistant professor of cognitive science and computer science at the Indian Institute of Technology Gandhinagar, told Digital Trends. “This way, we constructed a larger representative sample for training and testing. The approach was confirmed when obtaining impressive classification accuracies, even when we limited the training data to a smaller percentage of the dataset.”

Reading minds, training machines

This isn’t the first time that researchers have shown that it’s possible to carry out “mind-reading” demonstrations that would make David Blaine jealous, all using EEG data. For instance, neuroscientists at Canada’s University of Toronto Scarborough have previously reconstructed images based on EEG data to digitally re-create face images stored in a person’s mind. Miyapuram’s own previous research includes a project in which EEG data was used to identify movie clips viewed by participants, with each one intended to provoke a different emotional response.

song identifying ai
Krishna P. Miyapuram

Interestingly, this latest work showed that algorithms that proved very effective at guessing the songs being listened to by one participant, after being trained on their specific brain, wouldn’t work so well when applied to another person. In fact, “not so well” is a gross understatement: The accuracy in these tests plummeted from 85% to less than 10%.

“Our research shows that individuals have personalized experiences of music,” Miyapuram said. “One would expect that the brains respond in a similar way processing information from different stimuli. This is true for what we understand as low-level features or stimulus-level features. [But] when it comes to music, it is perhaps the higher-level features, such as enjoyment, that distinguish between individual experiences.”

Derek Lomas, assistant professor of positive A.I. at Delft University of Technology, said that a future goal of the project is to map the relationship between EEG frequencies and musical frequencies. This could help answer questions such as whether greater aesthetic resonance is accompanied by greater neural resonance.

To put it another way, is a person who is “moved” by a piece of music going to show greater correlations between the music itself and the brain response, making it possible to accurately predict how much a person enjoys a piece of music simply by looking at their brain waves? While everyone’s response to music may be subtly different, this could help shed light on why humans seek out music to begin with.

The road to brain-computer interfaces

“For near-term applications [in the next two years], we imagine a music recommendation engine that could be based on a person’s brain response,” Lomas told Digital Trends. “I currently have a student working on algorithmically generated music that maximizes neural resonance. It’s quite eerie: The maximum neural resonance is not the same as maximum aesthetic resonance.”

song identifying ai
Krishna P. Miyapuram

In the medium term, Lomas suggested it could lead to powerful applications for gaining information on the “depth of experience” enjoyed by a person engaging with media. Using brain-analysis tools, it may (and, indeed, should) be possible to accurately predict how deeply engaged a person is while, say, watching a movie or listening to an album. A brain-based measure of engagement could then be used to hone specific experiences. Want to make your movie more engaging for 90% of viewers? Tweak this scene, change that one.

“In the long term — 20 years — this field of work may enable methods for transcribing the contents of the imagination,” Lomas continued. “For example, transcribing thoughts to text. That’s the big future of [brain-computer interfaces.]”

As Lomas noted, we are still a distance away from that eventual goal of a brain-computer interface. Nonetheless, work such as this suggests that there’s plenty of tasty lower-hanging fruit on that tree before we finally fell it.

A paper describing this research, titled GuessTheMusic: Song Identification from Electroencephalography, was recently presented at CODS-COMAD 2021.

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
How to switch from Spotify to Apple Music
Spotify and Apple Music transfer on a smartphone.

Spotify is the world's most popular music streaming service for a reason. It has a massive catalog of music and podcasts, is full of cool music discovery and sharing features, and is really easy to use.
However, with its recent price increase and the fact that it still hasn't joined most of its peers in offering a hi-res audio quality option, you may be considering jumping ship for its closest competitor, Apple Music, which counts lossless hi-res tracks, mind-bending spatial audio, Dolby Atmos Music tracks, and a catalog that rivals Spotify's among the many attractive reasons to switch.

But there's one problem: you’ve spent a lot of time creating playlists and marking songs and albums as your favorites in Spotify. Is it worth the switch? Will all that hard work be lost in translation?

Read more
The best laptops for music production, chosen by experts
best laptops for music production

The world has gone pretty far when it comes to the processing power that we carry around with us, and if you're big into music production, then you're the luckiest of all. Some of the best laptops on the market have high-end CPUs for relatively low prices, which means that if you want to do music production on a laptop, you have a huge number of choices. Of course, that does also mean that it can be hard to navigate and pick the best laptop for your budget and needs, which is why we've done the legwork for you. We've collected our favorite picks below in various categories so that you can pick them with ease. Plus, we've even thrown in a quick guide on what to look for so that if you don't find what you want here, you can check out these other laptop deals for alternatives.
The Best Laptops for Music Production

Best overall laptop for music production:
Best Windows device for music production:
Best portable laptop for music production:
Best large-screen laptop for music production:
Best for 2-in-1 laptop for music production:

Read more
The most common Spotify problems and how to fix them
How to fix common Spotify problems

At any given time, Spotify is probably the most popular music streaming service with countless listeners tuning in to songs, stand-up, podcasts, and even audiobooks. However, between an AI-driven DJ and clients for iOS, Android, and PC, a lot of things can go wrong with the entertainment system. And that's not even including problems with your iPhone or headphones.

To make sure you get to spend as much time as possible listening and as little time as possible sorting through errors, we're providing expert tips and tricks for the most common Spotify problems. Everything from the app simply not working to aspects of Spotify glitching out. Is your Spotify not working? Try these fixes and see if your problem gets better.

Read more