In the groundbreaking experiment, the team worked with seven epileptic patients who were each equipped with temporary brain implants to help with their seizures. During the experiment, Rao and Ojemann showed patients random series of pictures that included human faces, houses, and blank grey screens for 400 milliseconds each. They were asked to identify a specific photo of an inverted house.
Concurrently, the patients’ electrodes were hooked up to software that monitored two brain signal properties — “event-related potentials” (which occur when large groups of neurons light up in response to an image) and “broadband spectral” changes (which occur when neurons remain active after seeing an image).
The team’s algorithm examined these two components and determined what combination of these signal properties corresponded to what images. “We got different responses from different (electrode) locations; some were sensitive to faces and some were sensitive to houses,” Rao said.
Once this initial phase was complete, the team showed the seven patients totally new pictures, and shockingly, the computer was able to almost instantaneously predict, based on the brain waves that were produced, when subjects were seeing each of the images, and at an accuracy rate of 96 percent.
“We were trying to understand, first, how the human brain perceives objects in the temporal lobe, and second, how one could use a computer to extract and predict what someone is seeing in real time,” explained Rao to the UW NewsBeat. “Clinically, you could think of our result as a proof of concept toward building a communication mechanism for patients who are paralyzed or have had a stroke and are completely locked-in,” he said.
Full details of the UW study can be found in a study published in PLOS Computational Biology, and while more work needs to be done to better understand the full implications of the new-found results, it’s pretty wild to think that we’re getting closer and closer to legitimately predicting human thought.
Editors' Recommendations
- Alexa can now tell you if you left the water on or the fridge door open
- Victim of Zoombombing? You may have some cash coming your way
- Spotify adds a Netflix hub so you can listen to the chilling sounds of Squid Game
- Need to weigh yourself? ‘Empathic technology’ may soon let you do it on a rug
- Apple will now let you fix your own iPhone in win for right-to-repair campaigners
