Experimental AR projection system lets surgeons see ‘through’ a patient’s skin

Imagine if surgeons or other clinicians were able to more easily see their patients’ internal anatomy without having to cut into them. That’s the basis for an intriguing project, developed by researchers at the University of Alberta. Called ProjectDR, it’s an augmented reality system that allows medical images such as CT scans, ultrasound, X-rays, and MRI data to be displayed on an individual so that it moves along with them.

“The ability to project medical images directly onto a patient’s body helps those viewing these images to recover patient-specific anatomical information in context for more accurate interpretation and action,” Pierre Boulanger, professor in the Department of Computing Science, told Digital Trends. “Using this system, patients can be digitized before the procedure, and these images can then be used as guides to perform surgeries — including the real-time location of the tools used by the surgeon relative to the projected information. The real-time aspect of the system allows this alignment to adapt to patient motion and to display video images like the one used in endoscopic surgeries.”

surgeons projectdr alberta image
University of Alberta
University of Alberta

As Boulanger points out, the required computer hardware for the ProjectDR system is actually relatively simple. It includes a 3D-optical tracking system for global positioning, a range sensor — like a Microsoft Kinect — to digitize the curved surface of the patient’s skin, and a special laser scanning projector to display the images without losing focus.

The computer tracks, processes, and renders the augmented images using specialized real-time algorithms developed by the researchers. Clinicians in the room don’t require any individual hardware, like a smartphone or tablet, to view the images. It’s also compatible with the strict aseptic requirements of an operating room since it involves nothing more nefarious than projecting laser light onto a patient’s body.

“We are now in the process of doing pilot testing with surgeons — first into simulated operating conditions and then in real-world operating room conditions for simpler procedures,” he said. “In many ways, this technology is disruptive and requires rethinking how surgical procedures are performed. We are also testing the system for teaching anatomy and surgical procedures. As for commercialization, a few companies are interested in the concept, and licensing negotiations are currently on the way.”

Emerging Tech

Intel’s new ‘neural network on a stick’ aims to unchain A.I. from the internet

To kick off its first developer conference in Beijing, Intel unveiled the second generation of its Neural Compute Stick -- a device that promises to democratize the development of computer vision A.I. applications.
Emerging Tech

Believe it or not, this fire-proof exoskeleton isn’t designed for space marines

A company called Levitate Technologies has developed a fire-resistant upper body exoskeleton that’s capable of lowering exertion levels by up to 80 percent when you carry out manual work.
Digital Trends Live

Indiegogo’s CEO on how crowdfunding is going beyond fundraising

David Mandelbrot, CEO of Indiegogo, joins us on DT Daily to talk about how Indiegogo is changing its crowdfunding business to offer support and resources, which in turn would lead to more successful campaigns.
Gaming

Everything we know about 'Anthem', including new details on Javelin classes

BioWare announced an upcoming action role-playing game called 'Anthem' at EA Play 2017. Here's everything we know about the game so far, including gameplay, DLC, and when you'll be able to play it.
Emerging Tech

In a weighty decision, scientists prepare to redefine the kilogram

Metrologists are meeting at the General Conference on Weights and Measures in Versailles to vote on whether to redefine the kilogram as a constant that can be observed in the natural world.
Photography

See the National Forests like never before in these awe-inspiring drone videos

What's the difference between a National Park and a National Forest? Drones. With no ban on drones in National Forests -- at least, not yet -- filmmakers have a way to capture the immensity of these locations with stunning results.
Emerging Tech

Google’s balloon internet is coming to Kenya in 2019

In order to bring the internet to those who lack it, a company called Loon is launching balloons into the stratosphere. From more than 12 miles up, these balloons beam connectivity over a large area on the ground.
Emerging Tech

Hikers missing on Mount Fuji could soon find a drone buzzing above their heads

Hikers who go missing while climbing Japan's highest mountain could soon find a drone buzzing above their head. A new system using the flying machines has been set up on Mount Fuji for future search-and-rescue missions.
Emerging Tech

Elon Musk receives FCC approval to launch over 7,500 satellites into space

Not surprisingly, SpaceX is thinking big with Starlink, its space-based global broadband network. This week, the company received FCC approval to launch 7,518 satellites into a low-Earth orbit for its satellite internet service.
Cars

The world’s first 3D-printed titanium wheels are so intricate they look fake

HRE Performance Wheels and GE Additive have teamed up to create the world's first 3D-printed titanium wheels. They are not only impressively durable, but extremely lightweight as well.
Emerging Tech

Of all the vape pens in the world, these 5 are the best

Vaping concentrates has become significantly more popular, especially among those that use cannabis for medicinal purposes. But don’t use just any vape pen: we found these five devices to be our favorites in 2018.
Emerging Tech

DJI Mavic 2 Pro vs Mavic 2 Zoom: What’s the real difference?

DJI's Mavic 2 series drones are ready to fly -- but which one is right for you? The Mavic 2 Pro and Mavic 2 Zoom are nearly identical save for their cameras. Here's what you need to know about these powerful new UAVs.
Emerging Tech

This startup will sequence your entire genome for free — but there’s a catch

Want to get your DNA sequenced but don’t want to shell out the hundred bucks or so to do so? A new startup called Nebula Genomics offers you the opportunity to have it done for free.
Emerging Tech

Here’s all the best tech gear and gadgetry that survived Shark Tank

The television show "Shark Tank" has churned out quite a few strange, interesting, and downright awesome products -- so we rounded up some of the best ones for your perusal. Enjoy!