Skip to main content

Catdiology? Cat pictures are helping AI get better at recognizing X-rays

It’s easy to joke that the internet was invented to give people around the world the opportunity to share pictures of cats. However, according to a new report, those kitty pictures may one day turn out to save your life.

That is based on work being done by Dr. Alvin Rajkomar, an assistant professor at the University of California, San Francisco Medical Center. Rajkomar trained a deep learning neural network to be able to automatically detect life-threatening abnormalities in chest X-rays.

Recommended Videos

“When I was a medical resident, I ordered a stat X-ray of a patient who I suspected had a life-threatening pneumothorax — air outside of his lung compressing his heart — and happened to be standing next to the digital X-ray machine as it was being taken,” he told Digital Trends. “Seeing the finding in real-time, I was able to immediately thrust a needle into his chest to evacuate the air, saving his life. I wondered if we could create an algorithm that could identify emergent findings so that radiographs don’t sit dormant in a database, waiting for a doctor to finally read the study and contact someone to take action.”

So what does this have to do with pictures of cats? Because Rajkomar said that deep learning systems need to train themselves by looking at vast numbers of images, but that the right kind of X-ray pictures aren’t in great supply for a variety of reasons.

“It wasn’t easy to collect that many radiology images, and even when we did, we discovered that incorrect metadata about the images made it difficult to harness in algorithms,” he continued.

Instead, he decided to have a go at plugging the holes with other images. Working with four Titan X GPUs and the CUDA parallel computing platform, he trained a deep learning neural network on more than 1 million color images taken from the ImageNet public database. After that, he then retrained the network by showing it a portion of the photos in grayscale, before doing it once more using actual chest X-rays.

Crazily enough, it worked. “We were able to show that by mixing thousands of radiology images with millions of images of everyday objects, like cats and fungi, we could get excellent performance,” he said.

You can find out more details about Rajkomar’s work by checking out his co-authored recent paper, published in the Journal of Digital Imaging, here.

“Our hope is that we can generate algorithms that will go much further than just creating metadata,” he noted, concerning his plans for what’s next. “I envision a future where we can immediately and automatically flag radiographs with critical findings so that patients can get the care they need without delay.”

And all this time you thought cat pictures were just cute, wasted bandwidth!

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
AMD on AM4 socket longevity, AM5, and the future
AMD Ryzen 7 5800X3D socketed in a motherboard.

When AMD launched its Ryzen processors on a newly minted AM4 socket in 2017, it was a game changing moment. Finally, AMD was bringing back real competition to Intel. But while Ryzen was killing off the relevance of the venerable quad core, it was also introducing a new idea of socket longevity that would see gamers able to evolve their PCs over time, rather than ripping their guts out every few years.

AM4 went on to be AMD's flagship socket for more than half a decade. But while team red has since moved on to newer sockets and CPUs, AM4's sheer lifespan has become one of its most defining features. It's become something expectant from AMD fans for socket AM5 and beyond.

Read more
Every macOS version in order: from the first public beta to macOS 15
Apple MacBook Air 15 M4 front angled view showing display and keyboard.

Apple’s macOS operating system has changed a lot over the last 25 years, with new features and designs coming and going as the decades have passed. Even the name has been adjusted, starting out as Mac OS X before shortening to OS X and eventually settling on macOS. The world the original version inhabited back in 2000 is very different to today.

Including the initial public beta, Apple has released 22 versions of the Mac operating system so far, with new launches becoming an annual occurrence. But it wasn’t always this way, and there have been some fascinating updates and developments in the time since the first version appeared. Let’s see how macOS has changed over the years.

Read more
I tested Microsoft’s controversial Recall tool. It evolved Windows for me.
Running Windows 11 Recall on a Copilot+ PC.

Imagine a tool that takes an image of whatever appears on your computer’s screen, saves it locally, and lets you access it all like a time machine. A magical looking glass for the computing past. That’s essentially what Microsoft’s Recall is all about. Yet, when it was first introduced, it stirred up a security storm.

Microsoft pulled its release plans, fortified the security guardrails, and relaunched it a few weeks ago. This time around, Recall got a minor-but-amazingly practical upgrade. The best part? Instead of having you scrub through a long timeline of pictures, you can simply search through the entire activity history with words.

Read more