Skip to main content

A.I. upscaling makes this film from 1896 look like it was shot in dazzling 4K

[4k, 60 fps] Arrival of a Train at La Ciotat (The Lumière Brothers, 1896)

Watching old documentary footage lets us get a glimpse of how life was in an earlier era. The effect isn’t totally convincing, though. Whether it’s incorrect projection speeds, decrepit film stock, or just the distinctly non-4K quality of old-fashioned cameras, watching this footage today still feels like, well, you’re watching old footage.

Cutting-edge artificial intelligence (A.I.) could help change that, however. This week, YouTube user Denis Shiryaev uploaded a 4K, 60fps version of the 1896 Lumière Brothers film “Arrival of a Train at La Ciotat.” Using A.I. upscaling technology (and an added soundtrack), the 1-minute film has been cleaned up to the point that, black-and-white color scheme aside, it could have been shot yesterday. Or tomorrow.

Related Videos

To create the updated film, Shiryaev used two publicly available enhancement programs, DAIN and Topaz Labs’ Gigapixel A.I. The first of these tools inserts new frames into a video clip to smooth the viewing experience. The second identifies details and structures within images and then “completes” them.

“We usually think of upscaling as scaling-up an image, creating more pixels by averaging out the existing ones, but this makes the result look extremely blurry,” Harry Robins, a film production student who works with A.I. upscaling tech, told Digital Trends. “With machine learning algorithms, the program has been given millions of images, all low resolution. Then it’s given a higher-resolution version of the same image [and] has to try and learn how to turn the first one into the second. After each iteration, it [learns to improve] upon itself.”

In the instance of the Lumière Brothers film, for instance, the ground has a texture that the A.I. picks up on. It then pastes on a higher-resolution texture from what it has learned. The same is true for other textures in the short film. While it’s not the perfect replacement for rescanning an original film negative in all cases, it’s nonetheless a super-impressive demo.

“There are stunning advances in deep learning, deep fake, 4K upscaling, and a host or incredibly exciting tools at the disposal of artists and restorers,” said Stuart Humphryes, a film colorizer and editor currently collaborating on a project involving A.I. upscaling. “Used in the right context, by a skilled hand, it can completely revolutionize the way people perceive archive film. It can bring immediacy and, with that, a closer emotional connection to the past.”

Editors' Recommendations

New VESA display standard makes it easier to pick a monitor
Person using a gaming monitor.

Good news for those who want to buy a new monitor sometime soon -- a new specification has just come out that should make the whole process just a little bit easier.

The Video Electronics Standards Association (VESA) has just introduced a new motion blur spec, dubbed ClearMR. The standard will show at a glance whether or not a monitor excels in eliminating motion blur.

Read more
How do you film what isn’t real? Joe Hunting on his documentary We Met in Virtual Reality
Jenny dances in We Met in Virtual Reality.

When the COVID-19 pandemic forced everyone to stay in their homes two years ago, a few people sought to maintain their social lives by any means necessary. Armed with their VR headsets and custom-made avatars, these people joined a virtual world unaffected not by COVID, but by gender norms, language barriers, and location, among others.

Among this virtual community was Joe Hunting, a documentarian who sought to record this unique social interaction in VR with his new documentary We Met in Virtual Reality. In an interview with Digital Trends, Hunting talks about the appeal of virtual reality during a pandemic, how the LGBTQ community helped pioneer the space, and how one goes about documenting something that isn't real.

Read more
How the Thanos VFX team brought The Quarry’s characters to life (and then killed them)
Ted Raimi wears a head-mounted camera and stares while filming a scene for The Quarry game.

Game developer Supermassive Games earned heaps of praise for its interactive, cinematic horror adventure Until Dawn, and followed it up with this year's "spiritual successor" to that 2015 hit, The Quarry. The game puts players in control of a group of camp counselors who find themselves besieged by a variety of deadly threats -- both human and supernatural -- after getting stranded at the remote campground where they spent their summer.

Like Until Dawn, The Quarry features a cast of familiar actors portraying the game's characters, with a blend of cutting-edge, performance-capture systems and Hollywood-level visual effects technology allowing the cast to bring their in-game counterparts to life and put those characters' fates in the hands of players. In order to bring the actors' work on a performance-capture set into the game's terrifying world, Supermassive recruited Oscar-winning visual effects studio Digital Domain, best known for its work in turning Josh Brolin into Thanos in Avengers: Infinity War.

Read more