Skip to main content

Catdiology? Cat pictures are helping AI get better at recognizing X-rays

cat photos xrays 19037264 l
Sergey Nivens/123RF
It’s easy to joke that the internet was invented to give people around the world the opportunity to share pictures of cats. However, according to a new report, those kitty pictures may one day turn out to save your life.

That is based on work being done by Dr. Alvin Rajkomar, an assistant professor at the University of California, San Francisco Medical Center. Rajkomar trained a deep learning neural network to be able to automatically detect life-threatening abnormalities in chest X-rays.

“When I was a medical resident, I ordered a stat X-ray of a patient who I suspected had a life-threatening pneumothorax — air outside of his lung compressing his heart — and happened to be standing next to the digital X-ray machine as it was being taken,” he told Digital Trends. “Seeing the finding in real-time, I was able to immediately thrust a needle into his chest to evacuate the air, saving his life. I wondered if we could create an algorithm that could identify emergent findings so that radiographs don’t sit dormant in a database, waiting for a doctor to finally read the study and contact someone to take action.”

So what does this have to do with pictures of cats? Because Rajkomar said that deep learning systems need to train themselves by looking at vast numbers of images, but that the right kind of X-ray pictures aren’t in great supply for a variety of reasons.

“It wasn’t easy to collect that many radiology images, and even when we did, we discovered that incorrect metadata about the images made it difficult to harness in algorithms,” he continued.

Instead, he decided to have a go at plugging the holes with other images. Working with four Titan X GPUs and the CUDA parallel computing platform, he trained a deep learning neural network on more than 1 million color images taken from the ImageNet public database. After that, he then retrained the network by showing it a portion of the photos in grayscale, before doing it once more using actual chest X-rays.

Crazily enough, it worked. “We were able to show that by mixing thousands of radiology images with millions of images of everyday objects, like cats and fungi, we could get excellent performance,” he said.

You can find out more details about Rajkomar’s work by checking out his co-authored recent paper, published in the Journal of Digital Imaging, here.

“Our hope is that we can generate algorithms that will go much further than just creating metadata,” he noted, concerning his plans for what’s next. “I envision a future where we can immediately and automatically flag radiographs with critical findings so that patients can get the care they need without delay.”

And all this time you thought cat pictures were just cute, wasted bandwidth!

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
How to delete your Spotify account on desktop and mobile
An iPhone with the Stats for Spotify screen on it being held in a hand.

Spotify is home to a bountiful trove of music. With over 615 million users connected to the platform, it’s no wonder it’s one of the biggest music-streaming platforms in town. Still, sometimes we need to put aside a little extra pocket change every month. And one of the first things to go are monthly subscriptions. We know it stinks, but this doesn’t mean your Spotify account needs to disappear forever.

Read more
The best tablets in 2024: top 11 tablets you can buy now
Disney+ app on the iPad Air 5.

As much as we love having the best smartphones in our pockets, there are times when those small screens don't cut it and we just need a larger display. That's when you turn to a tablet, which is great for being productive on the go and can be a awesome way to unwind and relax too. While the tablet market really took off after the iPad, it has grown to be quite diverse with a huge variety of products — from great budget options to powerhouses for professionals.

We've tried out a lot of tablets here at Digital Trends, from the workhorses for pros to tablets that are made for kids and even seniors -- there's a tablet for every person and every budget. For most people, though, we think Apple's iPad Air is the best overall tablet — especially if you're already invested in the Apple ecosystem. But if you're not an Apple user, that's fine too; there are plenty of other great options that you'll find in this roundup.

Read more
How to delete a file from Google Drive on desktop and mobile
Google Drive in Chrome on a MacBook.

Google Drive is an excellent cloud storage solution that can be accessed from numerous devices. Whether you do most of your Google Drive uploading or downloading from a PC, Chromebook, or mobile device, there’s going to come a time when you’ll need to delete a file (or two). Fortunately, the deletion process couldn’t be more straightforward. We’ve also put together this helpful guide to show you how to trash your Drive content a couple of different ways.

Read more