Skip to main content

Google Brain brings ‘zoom and enhance’ method one step closer to reality

google brain zoom enhance pixel recursive super resolution
Image used with permission by copyright holder
The concept of enhancing a pixelated image isn’t new — “zoom and enhance” is responsible for dozens of criminals being put behind bars in shows like Criminal Minds, but that kind of technology has so far evaded the real world. Well, the boffins over at Google Brain have come up with what may be the next best thing.

The new technology essentially uses a pair of neural networks, which are fed an 8 x 8-pixel image and are then able to create an approximation of what it thinks the original image would look like. The results? Well, they aren’t perfect, but they are pretty close.

To be clear, the neural networks don’t magically enhance the original image — rather, they use machine learning to figure out what they think the original could have looked like. So, using the example of a face, the generated image may not look exactly like the real person but instead, a fictional character that represents the computer’s best guess. In other words, law enforcement may not be able to use this technology to produce an image of a suspect using a blurry reflection from a photo of a number plate yet, but it may help the police get a pretty good guess at what a suspect may look like.

As mentioned, two neural networks are involved in the process. The first is called a “conditioning network,” and it basically maps out the pixels of the 8 x 8-pixel image into a similar looking but higher resolution image. That image serves as the rough skeleton for the second neural network, or the “prior network,” which takes the image and adds more details by using other, already existing images that have similar pixel maps. The two networks then combine their images into one final image, which is pretty impressive.

It is likely we will see more and more tech related to image processing in the future — in fact, artificial intelligence is getting pretty good at generating images, and Google and Twitter have both put a lot of research into image enhancing. At this rate, maybe crime-show tech will one day become reality.

Editors' Recommendations

Christian de Looper
Christian’s interest in technology began as a child in Australia, when he stumbled upon a computer at a garage sale that he…
Google’s ChatGPT rival just launched in search. Here’s how to try it
Generative AI in Google Search.

Ever since Microsoft started integrating ChatGPT into Bing search, alarm bells have been ringing at Google. Now, though, the tech giant has started rolling out its own generative artificial intelligence (AI) tool for users as part of its bid to retain its search crown.

In a blog post, the company explains that the new feature (called Search Generative Experience, or SGE) is part of Google’s Search Labs, which lets you test out experimental ideas in Google search and provide feedback to the company. Google says its generative AI will “help you take some of the work out of searching, so you can understand a topic faster, uncover new viewpoints and insights and get things done more easily.”

Read more
Google’s AI image-detection tool feels like it could work
An AI image of the Pope in a puffy coat.

Google announced during its I/O developers conference on Wednesday its plans to launch a tool that will distinguish whether images that show up in its search results are AI-generated images.

With the increasing popularity of AI-generated content, there is a need to confirm whether the content is authentic -- as in created by humans -- or if it has been developed by AI.

Read more
Forget ChatGPT — Siri and Google Assistant do these 4 things better
AI assistants compared with ChatGPT.

“Hey Google, Arbab!” I utter these lines to Google Assistant, which automatically takes me to my Twitter DMs with my friend Arbab. That chain of actions happens because I customized one such shortcut for Google Assistant on my phone. Putting the same prompt before ChatGPT, I get the predictably disappointing response: "I'm sorry, but as an AI language model, I do not have access to personal contact information such as phone numbers or email addresses.”

That’s just one of the dozen walls that you will run into if you seek to embrace ChatGPT while simultaneously ditching mainstream options like Google Assistant. One wonders why ChatGPT – considered by evangelists as the pinnacle of a consumer-facing AI in 2023 – fails miserably at something as fundamental as sending a message.

Read more