Skip to main content

Catdiology? Cat pictures are helping AI get better at recognizing X-rays

cat photos xrays 19037264 l
Sergey Nivens/123RF
It’s easy to joke that the internet was invented to give people around the world the opportunity to share pictures of cats. However, according to a new report, those kitty pictures may one day turn out to save your life.

That is based on work being done by Dr. Alvin Rajkomar, an assistant professor at the University of California, San Francisco Medical Center. Rajkomar trained a deep learning neural network to be able to automatically detect life-threatening abnormalities in chest X-rays.

“When I was a medical resident, I ordered a stat X-ray of a patient who I suspected had a life-threatening pneumothorax — air outside of his lung compressing his heart — and happened to be standing next to the digital X-ray machine as it was being taken,” he told Digital Trends. “Seeing the finding in real-time, I was able to immediately thrust a needle into his chest to evacuate the air, saving his life. I wondered if we could create an algorithm that could identify emergent findings so that radiographs don’t sit dormant in a database, waiting for a doctor to finally read the study and contact someone to take action.”

So what does this have to do with pictures of cats? Because Rajkomar said that deep learning systems need to train themselves by looking at vast numbers of images, but that the right kind of X-ray pictures aren’t in great supply for a variety of reasons.

“It wasn’t easy to collect that many radiology images, and even when we did, we discovered that incorrect metadata about the images made it difficult to harness in algorithms,” he continued.

Instead, he decided to have a go at plugging the holes with other images. Working with four Titan X GPUs and the CUDA parallel computing platform, he trained a deep learning neural network on more than 1 million color images taken from the ImageNet public database. After that, he then retrained the network by showing it a portion of the photos in grayscale, before doing it once more using actual chest X-rays.

Crazily enough, it worked. “We were able to show that by mixing thousands of radiology images with millions of images of everyday objects, like cats and fungi, we could get excellent performance,” he said.

You can find out more details about Rajkomar’s work by checking out his co-authored recent paper, published in the Journal of Digital Imaging, here.

“Our hope is that we can generate algorithms that will go much further than just creating metadata,” he noted, concerning his plans for what’s next. “I envision a future where we can immediately and automatically flag radiographs with critical findings so that patients can get the care they need without delay.”

And all this time you thought cat pictures were just cute, wasted bandwidth!

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
The 5 best laptops for accountants in 2024
Samsung Galaxy Book3 Pro 360 top down tablet view with pen.

Accountants tend to have a lot on their shoulders, especially as a lot of folks can rely on them for financial health, which is very important in today's world where the economy isn't at its best. As such, it's important to have the right tools for the job, and while there are a ton of great laptops out there that might work well for accounting, some will excel at it more than others. As such, we've gone out and picked our favorite laptops that can easily handle everything from large and heavy-duty spreadsheets to accounting software. Also, if you haven't quite found what you're looking for here, be sure to check out some of or other favorite laptop deals as well.
The Best Laptops for Accountants in 2024

Buy the  if you want the best overall laptop for accountants
Buy the if you want the best MacBook laptop for accountants
Buy the  if you want the best portable laptop for accountants
Buy the if you want the best 14-inch laptop for accountants
Buy the  if you want the best budget laptop for accountants

Read more
It’s time to stop believing these PC building myths
Hyte's Thicc Q60 all-in-one liquid cooler.

As far as hobbies go, PC hardware is neither the cheapest nor the easiest one to get into. That's precisely why you may often run into various misconceptions and myths.

These myths have been circulating for so long now that many accept them as a universal truth, even though they're anything but. Below, I'll walk you through some PC beliefs that have been debunked over and over, and, yet, are still prevalent.
Liquid cooling is high-maintenance (and scary)

Read more
AMD’s next-gen CPUs are much closer than we thought
AMD Ryzen 7 7800X3D held between fingertips.

We already knew that AMD would launch its Zen 5 CPUs this year, but recent motherboard updates hint that a release is imminent. Both MSI and Asus have released updates for their 600-series motherboards that explicitly add support for "next-generation AMD Ryzen processors," setting the stage for AMD's next-gen CPUs.

This saga started a few days ago when hardware leaker 9550pro spotted an MSI BIOS update, which they shared on X (formerly Twitter). Since then, Asus has followed suit with BIOS updates of its own featuring a new AMD Generic Encapsulated Software Architecture (AGESA) -- the firmware responsible for starting the CPU -- that brings support for next-gen CPUs (spotted by VideoCardz).

Read more