Skip to main content

Put down the controllers! Players navigate this VR game using only their minds

HTC Vive Modified With Neurable Reads Your Mind At SIGGRAPH
From allowing people to pilot drones using only their mind to medical applications involving the control of smart prostheses, the ability to use brain activity to directly control technology is a field that’s advanced significantly in recent years. At the recent 2017 SIGGRAPH conference, tech company Neurable and VR graphics company Estudiofuture teamed up to show off something new: brain-controlled virtual reality.

In a tech demo, the companies demonstrated how a VR game created by Estudiofuture could be intuitively controlled by swapping out the regular hand controls from an HTC Vive headset for technology developed by Neurable that monitors a user’s brain activity to determine their intent.

Image used with permission by copyright holder

“[In] The Awakening, you are a child held prisoner in a government science laboratory,” Dr. Ramses Alcaide, CEO of Neurable, told Digital Trends. “You discover that experiments have endowed you with telekinetic powers. You must use those powers to escape your cell, defeat the robotic prison guards, and free yourself from the lab. The game allows you to manipulate objects and battle foes with your mind, and is played entirely without handheld controllers.”

Neurable’s technology uses head-mounted electrodes to noninvasively read brain waves. It then employs machine learning to turn these inputs into instructions. There are some things it’s not ideal for — such as allowing users to type or navigate menus. However, when it comes to creating more immersive virtual environments for fields like gaming, it is an extremely promising technology.

Image used with permission by copyright holder

“The demo showed that you can make decisions in VR with the sole use of your brain; you don’t need gamepads or a controller, or even to move your head,” Joaquín Ruipérez, CEO of Estudiofuture, told DT. “You can select and pick up objects, and throw them to a selected target, only by thinking on them. The most amazing thing is that it really works!”

According to Neurable, the next step is a brain-controlled VR arcade game, scheduled for 2018. This will reportedly offer an expanded version of The Awakening. A Stranger Things-esque game, in which we play a character similar to the telekinetic Eleven, using our brain powers to escape a high-tech facility? Yep, we’re on board for that!

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
This quirky humanoid robot can be teleoperated using a VR headset
Pollen robot

The inventors of Reachy, a humanoid, open-source robot created by the French startup Pollen Robotics, have come up with a way to teleoperate the robo-creation through virtual reality. This opens up the possibility of users controlling the robot to carry out potentially complex tasks from anywhere in the world, so long as they're able to slip on a VR headset to do it.

"Using a VR device -- [a] headset and controllers -- a human can take full control of Reachy," Matthieu Lapeyre, CEO and co-founder of Pollen Robotics, told Digital Trends. "You see exactly what Reachy sees in 3D through its dual camera, and Reachy replicates your head and hands motions. You can control the gripper with the controllers’ triggers, and get haptic feedback from the controller vibrations. It's really like you were ‘in’ the robot to do the job. It works through the network, you can be either close or far away from Reachy, as long as you have a proper internet connection it will work the same."

Read more
Holotron is a robotic exosuit that could transform the way we use VR
holotron robot exosuit 1

Life-like VR and Robot Teleoperation - Holotron Demo, 1 min, no narration

There was once a time, in the early 1990s to be precise, when the biggest impediment to achieving high-end virtual reality was the fact that the images were too fuzzy and slow-moving. Today, we’ve moved way beyond these early teething challenges. With impressive visuals and three-dimensional sound, VR has no problem creating a compellingly immersive experience -- from an audio-visual perspective, at least.

Read more
VR lets scientists shrink down and ‘walk around’ inside their own cells
VR look inside cells.

In the 1966 movie Fantastic Voyage, a U.S. submarine and its crew are shrunk down to microscopic size and injected into the body of a comatose Soviet doctor who has defected to the U.S., in an effort to destroy a blood clot in his brain that threatens his life. Since then, the idea of being able to shrink people down to microscale, often to solve some kind of medical challenge, has made its way into various parts of popular culture. But not, as of yet, into reality.

Sadly, scientists and engineers still have yet to develop a real-life shrink ray. But investigators from the U.K.’s University of Cambridge and 3D image analysis software company Lume VR have come up with a method that uses virtual reality to allow researchers to “walk around” inside individual cells in order to better understand some fundamental problems in biology and, in the process, learn to develop better treatments.

Read more