New algorithm helps turn low-resolution images into detailed photos, ‘CSI’-style

algorithm low res high fromsmallton
Image used with permission by copyright holder
Anyone who has ever worked with image files knows that, unlike the fictional world of shows like CSI, there’s no easy way to take a low-resolution image and magically transform it into a high-resolution picture using some fancy “enhance” tool. Fortunately, some brilliant computer scientists at the Max Planck Institute for Intelligent Systems in Germany are working on the problem — and they’ve come up with a pretty nifty algorithm to address it.

What they have developed is a tool called EnhanceNet-PAT, which uses artificial intelligence to create high-definition versions of low-res images. While the solution is not a miracle fix, it does produce a noticeably better result than previous attempts, thanks to some smart machine-learning algorithms.

Recommended Videos

“The task of super-resolution has been studied for decades,” Mehdi M.S. Sajjadi, one of the researchers on the project, told Digital Trends. “Before this work, even the state of the art has been producing very blurry images, especially at textured regions. The reason for this is that they asked their neural networks the impossible — to reconstruct the original image with pixel-perfect accuracy. Since this is impossible, the neural networks produce blurry results. We take a different approach [by instead asking] the neural network to produce realistic textures. To do this, the neural network takes a look at the whole image, detects regions, and uses this semantic information to produce realistic textures and sharper images.”

To train their algorithm, the researchers fed their neural network a large data set of images to build up its knowledge of different textures. The neural network only gets to see downsampled versions of the images, and is given the task of upsampling these pictures. Once the network produces an output image, the researchers then compare it with the original high-resolution image and tweak the algorithm to correct any errors, such as making it produce sharper edges or more realistic grass textures where it has not done so. After a while, the algorithm is able to do this on its own with no human intervention necessary.

“There are a lot of applications for this,” Sajjadi continued. “From upsampling old movies to 4K quality, restoring old family photographs that are too blurry when you want to get a large print, over to more general applications such as improving object detection. [It also] turns out that using our algorithm on images makes it easier for other neural networks to detect objects in images, which has wide applications, from Google image search to detecting pedestrians in self-driving cars.”

You can check out a paper describing the work here.

Editors' Recommendations

I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
This AI cloned my voice using just three minutes of audio

There's a scene in Mission Impossible 3 that you might recall. In it, our hero Ethan Hunt (Tom Cruise) tackles the movie's villain, holds him at gunpoint, and forces him to read a bizarre series of sentences aloud.

"The pleasure of Busby's company is what I most enjoy," he reluctantly reads. "He put a tack on Miss Yancy's chair, and she called him a horrible boy. At the end of the month, he was flinging two kittens across the width of the room ..."

Read more
Digital Trends’ Top Tech of CES 2023 Awards

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more