Skip to main content

A.I. upscaling makes this film from 1896 look like it was shot in dazzling 4K

[4k, 60 fps] Arrival of a Train at La Ciotat (The Lumière Brothers, 1896)

Watching old documentary footage lets us get a glimpse of how life was in an earlier era. The effect isn’t totally convincing, though. Whether it’s incorrect projection speeds, decrepit film stock, or just the distinctly non-4K quality of old-fashioned cameras, watching this footage today still feels like, well, you’re watching old footage.

Recommended Videos

Cutting-edge artificial intelligence (A.I.) could help change that, however. This week, YouTube user Denis Shiryaev uploaded a 4K, 60fps version of the 1896 Lumière Brothers film “Arrival of a Train at La Ciotat.” Using A.I. upscaling technology (and an added soundtrack), the 1-minute film has been cleaned up to the point that, black-and-white color scheme aside, it could have been shot yesterday. Or tomorrow.

Please enable Javascript to view this content

To create the updated film, Shiryaev used two publicly available enhancement programs, DAIN and Topaz Labs’ Gigapixel A.I. The first of these tools inserts new frames into a video clip to smooth the viewing experience. The second identifies details and structures within images and then “completes” them.

“We usually think of upscaling as scaling-up an image, creating more pixels by averaging out the existing ones, but this makes the result look extremely blurry,” Harry Robins, a film production student who works with A.I. upscaling tech, told Digital Trends. “With machine learning algorithms, the program has been given millions of images, all low resolution. Then it’s given a higher-resolution version of the same image [and] has to try and learn how to turn the first one into the second. After each iteration, it [learns to improve] upon itself.”

In the instance of the Lumière Brothers film, for instance, the ground has a texture that the A.I. picks up on. It then pastes on a higher-resolution texture from what it has learned. The same is true for other textures in the short film. While it’s not the perfect replacement for rescanning an original film negative in all cases, it’s nonetheless a super-impressive demo.

“There are stunning advances in deep learning, deep fake, 4K upscaling, and a host or incredibly exciting tools at the disposal of artists and restorers,” said Stuart Humphryes, a film colorizer and editor currently collaborating on a project involving A.I. upscaling. “Used in the right context, by a skilled hand, it can completely revolutionize the way people perceive archive film. It can bring immediacy and, with that, a closer emotional connection to the past.”

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Google execs say we need a plan to stop A.I. algorithms from amplifying racism
Facial Recognition

 

Two Google executives said Friday that bias in artificial intelligence is hurting already marginalized communities in America, and that more needs to be done to ensure that this does not happen. X. Eyeé, outreach lead for responsible innovation at Google, and Angela Williams, policy manager at Google, spoke at (Not IRL) Pride Summit, an event organized by Lesbians Who Tech & Allies, the world’s largest technology-focused LGBTQ organization for women, non-binary and trans people around the world.

Read more
Sony wants to make cameras smarter with an onboard A.I. chip
sony a6400 review mem2

Over the last few years, tech companies such as Google have turned to machine learning to push the limits of what a camera can do without bulky hardware. Now, Sony, that dominates more than half of the image processing market, is throwing its hat in the ring with two new sensors that come equipped with an onboard A.I. chip.

https://youtu.be/20rXEtG4CjQ

Read more
Because 2020’s not crazy enough, a robot mouth is singing A.I. prayers in Paris
The Prayer

Diemut Strebe: The Prayer

In these troubling, confusing times, it can be tough to know who to turn to for help. One possible answer? A disembodied robot mouth chanting algorithmically generated Gregorian-style prayers in the voice of Amazon’s Kendra.

Read more