Skip to main content

Augmented reality comes to neurosurgery with tech developed by Leica

Virtual Reality Technology in the Operating Room
Augmented reality isn’t just for catching Pokémon anymore. A new technology from Leica Microsystems uses “image injection” to display virtual overlays within a surgical microscope to help guide a neurosurgeon’s hands. It was recently used by Dr. Joshua Bederson of Mount Sinai Health System in New York to treat a patient with an aneurysm.

Bederson worked closely with Leica and Brainlab, the company that makes the software, to develop the tool. He is now using it all of his cases, according to a statement released by Mount Sinai. Called CaptiView, the system links image-guided surgery (IGS) software to the microscope hardware itself, laying down critical visual information (such as images from a brain scan) directly on top of a patient’s brain. Both two- and three-dimensional images can be injected.

The software is smart enough to track both the position of the microscope as well as the focal point of the eyepieces, updating in real time as the surgeon works. “That means the microscope knows where I am looking,” Bederson says in the above video from Mount Sinai. “You operate with far greater confidence and visual and spatial awareness.”

Bederson likens CaptiView to using a GPS when driving. It provides real-time navigational assistance that can make a procedure more efficient and and even safer. Like switching from satellite to map view, operators can also toggle between the live feed and preoperative images.

While IGS software isn’t new, the ability to see all pertinent information in a heads-up display directly through the microscope could be a game changer for neurosurgery. “The brain has a very complicated anatomy,” Bederson explains. “The more we can bring technology into that very critical environment, I think the better we’ll be.”

Editors' Recommendations

Daven Mathies
Former Digital Trends Contributor
Daven is a contributing writer to the photography section. He has been with Digital Trends since 2016 and has been writing…
Microsoft and Samsung could team up on new AR headset
microsoft hololens 2

Samsung and Microsoft might be teaming up on a new augmented reality headset, with a possible release coming in 2024, according to a new rumor.

Digital Trends can not verify the original report behind the rumor, but according to The Elec, Microsoft and Samsung have reportedly started working on this project that's scheduled to last two years. Samsung apparently started its task force for the project in March and Microsoft in the summer. Multiple divisions of Samsung's business are also involved in the product, including Samsung Display, Electro-Mechanics, and SDI.

Read more
As others hype up VR and the metaverse, Valve may be backing away
Valve Index HMD release date store page leak june 2019 controller base station

As interest in the metaverse heats up, many companies are pouring more resources into virtual and augmented reality -- except one. Valve may be shifting its focus from VR to its already sold-out Steam Deck, according to recent rumors.

Valve insider Tyler McVicker put out a YouTube video detailing Valve's plans (or lack there of) for virtual reality. McVicker points out that most of the company has lost interest in VR completely. This is mostly due to the massive success of Meta (formerly Facebook) putting out relatively low-cost headsets under the former Oculus brand and buying out many big VR developers. Instead, Valve is focusing its efforts on showcasing the versatility and power of its upcoming Steam Deck portable gaming PC.

Read more
Meta believes VR haptic gloves could unlock the future of the metaverse
Meta researcher holding prototype haptic glove.

The metaverse seems to be coming, as is the futuristic hardware that will increase immersion in virtual worlds. Meta, the company formerly known as Facebook, has shared how its efforts to usher in that new reality are focusing on how people will actually feel sensations in a virtual world.

The engineers at Meta have developed a number of early prototypes that tackle this goal and they include both haptic suits and gloves that could enable real-time sensations.

Read more