‘Mind-reading’ A.I. produces a description of what you’re thinking about

ai reading minds producing written descriptions gettyimages 117146176

RichVintage/Getty Images

Think that Google’s search algorithms are good at reading your mind? That’s nothing compared to a new artificial intelligence research project coming out of Japan, which can analyze a person’s brain scans and provide a written description of what they have been looking at.

To generate its captions, the artificial intelligence is given an fMRI brain scan image, taken while a person is looking at a picture. It then generates a written description of what they think the person was viewing. An illustration of the level of complexity it can offer is: “A dog is sitting on the floor in front of an open door” or “a group of people standing on the beach.” Both of those turn out to be absolutely accurate.

“We aim to understand how the brain represents information about the real world,” Ichiro Kobayashi, one of the researchers from Japan’s Ochanomizu University, told Digital Trends. “Toward such a goal, we demonstrated that our algorithm can model and read out perceptual contents in the form of sentences from human brain activity. To do this, we modified an existing network model that could generate sentences from images using a deep neural network, a model of visual system, followed by an RNN (recurrent neural network), a model that can generate sentences. Specifically, using our dataset of movies and movie-evoked brain activity, we trained a new model that could infer activation patterns of DNN from brain activity.”

Before you get worried about some dystopian future in which this technology is used as a supercharged lie detector, though, Kobayashi points out that it still a long way away from real-world deployment. “So far, there are not any real-world applications for this,” Kobayashi continued. “However, in the future, this technology might be a quantitative basis of a brain-machine interface.”

As a next step, Shinji Nishimoto, another researcher on the project, told Digital Trends that the team wants to use it to better understand how the brain processes information.

“We would like to understand how the brain works under naturalistic conditions,” Nishimoto said. “Toward such a goal, we are planning to investigate how various forms of information — vision, semantics, languages, impressions, etcetera — are encoded in the brain by modeling the relationship between our experiences and brain activity. We also aim to investigate how multimodal information is related to achieve semantic activities in the brain. In particular, we will work on generating descriptions about what a person thinks.”

Emerging Tech

It’s no flying car, but the e-scooter had a huge impact on city streets in 2018

Within just a year, electric scooters have fundamentally changed how we navigate cities. From San Francisco to Paris, commuters have a new option that’s more fun than mass transit, easier than a bike, and definitely not a car.
Mobile

The Galaxy S10 may be announced before MWC, sell for up to $1,750

While we still may be months away from an announcement, there's no doubt about it: Samsung is working hard on its successor to the Galaxy S9. Here's everything we know about the upcoming Samsung Galaxy S10.
Digital Trends Live

Jobbatical’s Lauren Proctor discusses the future of jobs for tech experts

Today on Digital Trends Live we had Jobbatical's Lauren Proctor to talk about the future trends for finding tech jobs abroad, including a Digital Nomad Visa, which allows tech experts to travel from country to country much easier.
Emerging Tech

An A.I. cracks the internet’s squiggly letter bot test in 0.5 seconds

How do you prove that you’re a human when communicating on the internet? The answer used to be by solving a CAPTCHA puzzle. But maybe not for too much longer. Here is the reason why.
Movies & TV

Ice meets fire in HBO's latest 'Game of Thrones' season 8 teaser

With the eighth and final season looming, Game of Thrones fever has officially become a pandemic. Our list of all the relevant news and rumors will help make the wait more bearable, if you don't mind spoilers.
Emerging Tech

Intel wants its fleet of drones to monitor America’s aging, unsafe bridges

Intel has signed a deal to use its Falcon 8+ drones to carry out bridge inspections. The hope is that these drones will be useful in spotting potential problems before they become serious.
Giveaways

Print your heart’s desire: Enter our giveaway to win a free Monoprice 3D printer

We’re giving away a $400 Monoprice MP Voxel 3D Printer. It's easy to use, especially for beginners, with its simple menu system and touchscreen display. It comes fully assembled so you can spend more time printing instead of setting up.
Emerging Tech

Transplanted pig hearts show promise in baboon trials. Are humans next?

Researchers in Germany have successfully transplanted modified pig hearts into baboons. The results take us one step closer to ending organ transplant waiting lists for good. Here's why.
Emerging Tech

Makerbot is back with a new 3D printer that’s faster and more precise than ever

MakerBot's new Method 3D printer aims to bridge the gap between home 3D printers and more industrial 3D printing tech. Here are a few of the tantalizing things you can expect from it.
Emerging Tech

Warm ski beanie instantly hardens into a head-protecting helmet upon impact

Wool hats are way more comfortable than hard helmets. You know what they're not? Safer. That could soon change, thanks to an innovative new ski beanie which instantly hardens upon impact.
Deals

Take to the skies with these 5 drones on sale for under $50

On the hunt for some cool tech for under $50? We've rounded up 5 drones under $50 that you can still get before Christmas. These models are great for kids, adults, and anyone just getting started with drones.
Emerging Tech

With this robotic garage, retrieving your car is like using a vending machine

Remembering where we parked our cars can be a real pain. But what if our cars came to find us, rather than the other way around? A new automated robot parking valet system aims to help.
Cars

Best Products of 2018

Our reception desk has so many brown boxes stacked up, it looks like a loading dock. We’re on a first-name basis with the UPS guy. We get new dishwashers more frequently than most people get new shoes. What we’re trying to say is: We…
Emerging Tech

A lidar-equipped truck knows exactly how much de-icer to apply on roads

Lidar is best known as the laser-based technology that helps self-driving cars sense their surroundings. But the city of Knoxville has another, more seasonal use for it: De-icing roads.