Skip to main content

Augmented reality comes to neurosurgery with tech developed by Leica

Virtual Reality Technology in the Operating Room
Augmented reality isn’t just for catching Pokémon anymore. A new technology from Leica Microsystems uses “image injection” to display virtual overlays within a surgical microscope to help guide a neurosurgeon’s hands. It was recently used by Dr. Joshua Bederson of Mount Sinai Health System in New York to treat a patient with an aneurysm.

Bederson worked closely with Leica and Brainlab, the company that makes the software, to develop the tool. He is now using it all of his cases, according to a statement released by Mount Sinai. Called CaptiView, the system links image-guided surgery (IGS) software to the microscope hardware itself, laying down critical visual information (such as images from a brain scan) directly on top of a patient’s brain. Both two- and three-dimensional images can be injected.

Recommended Videos

The software is smart enough to track both the position of the microscope as well as the focal point of the eyepieces, updating in real time as the surgeon works. “That means the microscope knows where I am looking,” Bederson says in the above video from Mount Sinai. “You operate with far greater confidence and visual and spatial awareness.”

Please enable Javascript to view this content

Bederson likens CaptiView to using a GPS when driving. It provides real-time navigational assistance that can make a procedure more efficient and and even safer. Like switching from satellite to map view, operators can also toggle between the live feed and preoperative images.

While IGS software isn’t new, the ability to see all pertinent information in a heads-up display directly through the microscope could be a game changer for neurosurgery. “The brain has a very complicated anatomy,” Bederson explains. “The more we can bring technology into that very critical environment, I think the better we’ll be.”

Daven Mathies
Former Digital Trends Contributor
Daven is a contributing writer to the photography section. He has been with Digital Trends since 2016 and has been writing…
As others hype up VR and the metaverse, Valve may be backing away
Valve Index HMD release date store page leak june 2019 controller base station

As interest in the metaverse heats up, many companies are pouring more resources into virtual and augmented reality -- except one. Valve may be shifting its focus from VR to its already sold-out Steam Deck, according to recent rumors.

Valve insider Tyler McVicker put out a YouTube video detailing Valve's plans (or lack there of) for virtual reality. McVicker points out that most of the company has lost interest in VR completely. This is mostly due to the massive success of Meta (formerly Facebook) putting out relatively low-cost headsets under the former Oculus brand and buying out many big VR developers. Instead, Valve is focusing its efforts on showcasing the versatility and power of its upcoming Steam Deck portable gaming PC.

Read more
Meta believes VR haptic gloves could unlock the future of the metaverse
Meta researcher holding prototype haptic glove.

The metaverse seems to be coming, as is the futuristic hardware that will increase immersion in virtual worlds. Meta, the company formerly known as Facebook, has shared how its efforts to usher in that new reality are focusing on how people will actually feel sensations in a virtual world.

The engineers at Meta have developed a number of early prototypes that tackle this goal and they include both haptic suits and gloves that could enable real-time sensations.

Read more
Apple’s smart glasses could feature futuristic projection tech
biometric sensors security scanners in vehicles 49818131  close up of woman eye process scanning

Apple could one day release a pair of smart glasses that does away with small displays and instead projects images directly onto the wearer’s retina.

The so-called “retinal projector” technology is discussed in an Apple patent granted to the tech giant by the United States Trademark and Patent Office on Tuesday, October 26, Apple Insider reported.

Read more