Skip to main content

How Hollywood techniques and VR are changing the field of neuroscience

ibm-chip-human-brain-robot-overlord
Image used with permission by copyright holder
We’re all familiar with the CGI used in big-budget Hollywood movies. When used properly, this technology can help bring even the most fantastical of worlds to life, but Scientific American reports that such technology is making its way into the world of neuroscience where it is being used to study the human brain.

At the 2017 Society for Neuroscience annual meeting in Washington D.C., a team of researchers showed off two projects that highlight what this technology can do when applied to the realm of neuroscience.

Tyler Ard, a researcher at the University of Southern California in Los Angeles, showed how computer rending techniques can be applied to the results of MRI scans to produce images from large amounts of data. Ard and his team have developed software that will make it easy to import this data. He also said they plan on making it freely available to other scientists.

The team isn’t content to solely make use of CGI for MRI scans, however. They are also combining it with virtual reality to create 3D images of the human brain, allowing researchers to more easily study the brain and perform virtual dissections. Ard believes that this will be a more effective means of learning neuroanatomy than traditional means.

“This can be useful when learning neuroanatomy,” Ard told Scientific American. “The way that I learned it, we had to look at slices, and that’s real hard. This is a way that allows you to understand 3-D structure better.”

Ard is hopeful that the Neuro Imaging in Virtual Reality program will be available next year.

Tracing Neurons with VR

Right now, most of the interest around VR is confined to gaming circles, but a team of researchers at the University of Utah in Salt Lake City have developed a program that will allow scientists to use VR to more easily trace neurons.

The current techniques require scientists to create 2D images of their neuron scans and rotate the image to see what’s behind the neuron’s branches. Considering that a single cubic millimeter of the human brain contains 50,000 neurons and each of those has roughly 6,000 connections to their neighbors, it can be a slow process.

The team from the University of Utah has found a way to create 3D VR images of neuron pathways, allowing scientists to walk around their images and use handheld controllers to rotate them.

In order to show off the program, the team had four professional neuroscientists map a series of neuron images using the new VR technology and standard desktop computer. The VR proved just as accurate as the desktop method, but was 1.7 times faster.

Will Usher, who helped demonstrate the technology, said that his team hopes to release the program for commercial VR devices within a year.

Editors' Recommendations

Eric Brackett
Former Digital Trends Contributor
Leak reveals how Apple VR headset’s hand tracking may work
A rendering of an Apple mixed-reality headset (Reality Pro) in a gold color seen from the front.

Apple’s secret mixed-reality headset -- dubbed Reality Pro -- is due to launch imminently, but the way you’ll use the device is something of a mystery. Sure, rumors have pointed to some form of gesture control, but that’s a pretty vague description. Fortunately, we might now have a better idea of how it will work.

That’s because Apple has just been granted a patent outlining how you might be able to use a special ring to control objects while using the Reality Pro headset. The idea is that, with this ring on your finger, you’ll be able to perform various gestures that will let you open apps, scroll webpages, and more.

Read more
Apple’s Reality Pro headset is the VR industry’s ‘last hope’
A rendering of an Apple mixed-reality headset (Reality Pro) in a gray color seen from the front.

Apple’s upcoming mixed reality headset hasn’t even launched, yet it’s already being touted as the “last hope” for the virtual reality (VR) headset industry. It shows what a dire situation the market is in, at least according to some estimates.

The grim appraisal comes from respected industry analyst Ming-Chi Kuo. In a post on Medium, Kuo explained that other headset makers have cut their production plans and are shipping far fewer units than previously expected. The malaise affects augmented reality (AR) and mixed reality (MR) headsets as well as their VR counterparts, says Kuo.

Read more
Apple just patented a new VR headset controller — but there’s a catch
Apple VR Headset Concept by Antonio De Rosa

Apple’s mixed-reality headset is due to launch this June at the company’s Worldwide Developers Conference (WWDC), and a freshly published patent hints at some of the controllers Apple might offer with the device. But some major caveats could prevent these accessories from ever seeing the light of day.

The patent (number 20230096068) describes how Apple could create a handheld controller with a “torque feedback mechanism” to provide immersive physical responses while using a mixed-reality headset. That might help offset the drawbacks of virtual input methods (like touchscreens), which can “detract from the realism” of the experience and leave a user unsure if their input has properly registered, according to Apple.

Read more