Augmented reality comes to neurosurgery with tech developed by Leica

Augmented reality isn’t just for catching Pokémon anymore. A new technology from Leica Microsystems uses “image injection” to display virtual overlays within a surgical microscope to help guide a neurosurgeon’s hands. It was recently used by Dr. Joshua Bederson of Mount Sinai Health System in New York to treat a patient with an aneurysm.

Bederson worked closely with Leica and Brainlab, the company that makes the software, to develop the tool. He is now using it all of his cases, according to a statement released by Mount Sinai. Called CaptiView, the system links image-guided surgery (IGS) software to the microscope hardware itself, laying down critical visual information (such as images from a brain scan) directly on top of a patient’s brain. Both two- and three-dimensional images can be injected.

The software is smart enough to track both the position of the microscope as well as the focal point of the eyepieces, updating in real time as the surgeon works. “That means the microscope knows where I am looking,” Bederson says in the above video from Mount Sinai. “You operate with far greater confidence and visual and spatial awareness.”

Bederson likens CaptiView to using a GPS when driving. It provides real-time navigational assistance that can make a procedure more efficient and and even safer. Like switching from satellite to map view, operators can also toggle between the live feed and preoperative images.

While IGS software isn’t new, the ability to see all pertinent information in a heads-up display directly through the microscope could be a game changer for neurosurgery. “The brain has a very complicated anatomy,” Bederson explains. “The more we can bring technology into that very critical environment, I think the better we’ll be.”

Emerging Tech

Awesome Tech You Can’t Buy Yet: Booze-filled ski poles and crypto piggy banks

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Product Review

Hue who? Nanoleaf Canvas brings a riot of color and vibrancy to the smart home

Fun and festive, Nanoleaf Canvas feature lighting adds personality and vibrancy to any room. Nanoleaf Canvas features squares that you can connect in any configuration you’d like. Sync to music, play games, or relax in soothing light.
Computing

Here's why 64-bit (not 32-bit) dominates modern computing

Today's computing world isn't the same as it once was. With 64-bit processors and operating systems replacing the older 32-bit designs, we look at what 32-bit vs. 64-bit really means for you.
Photography

These are the best action cameras money can buy

Action cameras are great tools for capturing videos of your everyday activities, whether it's a birthday party or the steepest slope you've ever descended on your snowboard. These are the best money can buy.
Emerging Tech

Bright ‘hyperactive’ comet should be visible in the sky this weekend

An unusual green comet, 46P/Wirtanen, will be visible in the night sky this month as it makes its closest approach to Earth in 20 years. It may even be possible to see the comet without a telescope.
Emerging Tech

Gorgeous images show storms and cloud formations in the atmosphere of Jupiter

NASA's Juno mission arrived at Jupiter in 2016 and has been collecting data since then. NASA has shared an update on the progress of the mission as it reaches its halfway point, releasing stunning images of the planet as seen from orbit.
Emerging Tech

Meet the MIT scientist who’s growing semi-sentient cyborg houseplants

Elowan is a cybernetic plant that can respond to its surroundings. Tethered by a few wires and silver electrodes, the plant-robot hybrid can move in response to bioelectrochemical signals that reflect the plant’s light demands.
Emerging Tech

Beautiful image of young planets sheds new light on planet formation

Researchers examining protoplanetary disks -- the belts of dust that eventually form planets -- have shared fascinating images of the planets from their survey, showing the various stages of planet formation.
Emerging Tech

Delivery robot goes up in flames while out and about in California

A small meal-delivery robot suddenly caught fire in Berkeley, California, on Friday. The blaze was quickly tackled and no one was hurt, but the incident is nevertheless a troubling one for the fledgling robot delivery industry.
Emerging Tech

High-tech dancing robot turns out to be a guy in a costume

A Russian TV audience was impressed recently by an adult-sized "robot" that could dance and talk. But when some people began pointing out that its actions were a bit odd, the truth emerged ... it was a fella in a robot suit.
Emerging Tech

MIT’s smart capsule could be used to release drugs in response to a fever

Researchers have developed a 3D-printed capsule which can monitor patients' vital signs, transmit this information to a connected device, and release drugs in response to symptoms.
Emerging Tech

‘Crop duster’ robot is helping reseed the Great Barrier Reef with coral

In a world first, an undersea robot has delivered microscopic coral larvae to the Great Barrier Reef. Meet Larvalbot: the robot "crop duster" which dispenses coral babies on troubled reefs.
Emerging Tech

Self-driving dirt rally vehicle offers crash course in autonomous car safety

Georgia Tech's AutoRally initiative pushes self-driving cars to their limit by getting scaled-down autonomous vehicles to drive really, really fast and aggressively on dirt roads. Here's why.
Features

Cities looking to get smart take a lesson from an iconic shopping mall

From Disney World to the Mall of America, public venues are becoming microcosms for smart city projects. We dove into both, to show what government officials can learn – and what you can expect from your city.