Skip to main content

This mind-reading tech helped a paralyzed violinist control a live orchestra

Activating Memory

Back in 1988, when she was a rising star in the Welsh National Opera Orchestra, Rosemary Johnson was in a terrible car accident that left her in a coma for seven months, and a head injury caused brain damage that left her unable to speak or move. Her ability to make music was suddenly gone.

After 27 years with the belief she would never be able to do so again, violinist Rosemary Johnson has made music, thanks to an incredible piece of technology called a brain computer music interface, or BCMI, developed by a team of doctors and researchers at Plymouth University in the U.K.

The BCMI is an EEG headset that contains electrodes for monitoring brain activity, which knows where someone is looking on a screen. The screen shows patterns of different colored lights, which are actually musical notes or phrases, that the BCMI wearer focuses on to select. By concentrating harder, the speed and volume of the musical notes generated can be adjusted.

Except the music isn’t played by a computer or synthesizer. It’s played live, in real-time, by an orchestra. Using the BCMI, they’re remotely controlling an able-bodied musician to produce the notes selected using the power of their mind, all thanks to this astounding technology.

The affect it has on the patient, said Professor Eduardo Miranda, director of the program, is “Really very moving. The first time we tried with Rosemary we were in tears. We could feel the joy coming from her at being able to make music,” he told the Telegraph. He said that making it possible for people who cannot move to create music was, “the project’s greatest achievement.” Miranda produced a short documentary on the BCMI, and how the technology works, which you can see above.

The musicians playing are known as the Paramusical Ensemble, and the first piece of music recorded and created by the quartet and BCMI wearers will be played at a music festival in Plymouth during February. It’s called Activating Memory, and a preview can be heard below.

Although Rosemary Johnson is the latest person to use the BCMI to great effect, the project has been running for more than a decade, and Professor Miranda recently explained to CNN how the technology works. The headset measures eight different frequencies, and is so sensitive it knows which pulsating panel on the display the wearer is looking at, even if the differences between them are just a few hertz.

It takes 10-seconds for the music selected to be played by the orchestra, and although no musical skill is needed to use the BCMI, musical knowledge and talent is essential to producing something people will want to hear. Unfortunately, the technology is very expensive, with each station costing at least $15,000, so it’s unlikely to be in wide use very soon. However, the team wants to set up booths where the public can try it out, then upload the resulting composition to the Internet.

As for Rosemary Johnson, her 80-year-old mother Mary, who in the past helped Rosemary tap nothing more than a few chords on the piano, said the BCMI project has given her daughter new hope.

Editors' Recommendations

Andy Boxall
Senior Mobile Writer
Andy is a Senior Writer at Digital Trends, where he concentrates on mobile technology, a subject he has written about for…
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more
AI turned Breaking Bad into an anime — and it’s terrifying
Split image of Breaking Bad anime characters.

These days, it seems like there's nothing AI programs can't do. Thanks to advancements in artificial intelligence, deepfakes have done digital "face-offs" with Hollywood celebrities in films and TV shows, VFX artists can de-age actors almost instantly, and ChatGPT has learned how to write big-budget screenplays in the blink of an eye. Pretty soon, AI will probably decide who wins at the Oscars.

Within the past year, AI has also been used to generate beautiful works of art in seconds, creating a viral new trend and causing a boon for fan artists everywhere. TikTok user @cyborgism recently broke the internet by posting a clip featuring many AI-generated pictures of Breaking Bad. The theme here is that the characters are depicted as anime characters straight out of the 1980s, and the result is concerning to say the least. Depending on your viewpoint, Breaking Bad AI (my unofficial name for it) shows how technology can either threaten the integrity of original works of art or nurture artistic expression.
What if AI created Breaking Bad as a 1980s anime?
Playing over Metro Boomin's rap remix of the famous "I am the one who knocks" monologue, the video features images of the cast that range from shockingly realistic to full-on exaggerated. The clip currently has over 65,000 likes on TikTok alone, and many other users have shared their thoughts on the art. One user wrote, "Regardless of the repercussions on the entertainment industry, I can't wait for AI to be advanced enough to animate the whole show like this."

Read more