Preserving details while enlarging images is one of the hardest tasks to achieve for any Photoshop wizard, but Google may have a new, automated technique which utilizes machine learning to make it a reality. The firm’s new Rapid and Accurate Image Super-Resolution (RAISR) system, is capable of upscaling images without aliasing, achieving increased detail, all in real time on mobile devices.
Google freely admits that it isn’t the first to try and tackle this field of image enhancement. The company is aware of traditional super-resolution and upsampling systems, but feels they can often leave ‘enhanced’ images blurry or aliased, and that the techniques are very slow and cumbersome. With its new RAISR system, it has a technique that actively improves the quality of an image while resizing it, and that does so as much as 100 times faster than competitive systems.
The RAISR system is able to achieve this effect by ‘teaching’ its algorithm what higher quality images look like. The system then learns which filters can take a lower quality image to a higher quality one without losing clarity or detail. It analyses brightness, color, strength, and other factors to find the “edge” of parts of the image, in order to enhance them using appropriate filters.
The system even analyses the type of image file and the compression that was used during its creation, and uses this information to try and reverse engineer the original structure of the image. This should make it possible for RAISR to undo artifacts produced by a number of different image formats, making it much more versatile, as detailed by Google on its blog (via AndroidPolice).
The end result is larger images which do away with pixelation and blurring to deliver a picture that is more detailed than the original. This will enable all sorts of exciting functions — even beyond making CSI like zooming a reality. We could have further improved pinch-zoom features on phones, and images could be captured or sent at lower resolutions, and then super-sampled only when needed to bring them up to par.