Skip to main content

Watch an algorithm try to make sense of ‘The Wolf of Wall Street’ trailer

Object Masking - The Wolf of Wall Street
Whether it’s HAL 9000 in Stanley Kubrick’s 2001: A Space Odyssey or the computer that learned to recognize cats by watching YouTube videos, artificial intelligence has a long and storied history of crossing over with movies.

A new project, created by Copenhagen-based creative coding studio Støj, represents the next step of that process with an AI designed to watch — and try and make sense of — Hollywood movie trailers.

“We are two interaction designers with a big interest in machine learning and computer vision,” creators Lasse Korsgaard and Andreas Refsgaard told Digital Trends. “Real time object detection has the potential to become a really powerful tool in the type of work we do, and to test out its capabilities we thought it would be fun to run some movies through the algorithms.”

The main component of the project involves YOLO-2, a system for real-time object detection that is able to recognize everyday objects like persons, ties, cars, and chairs as they appear. Short for “You Only Look Once,” YOLO is extremely fast, with a degree of accuracy, and the ability to detect and classify multiple objects in the same image.

“We chose movie trailers [for our project] because they generally are fast-paced with lots of cuts between scenes, and therefore typically containing a wide variety of objects for potential detection,” Korsgaard and Refsgaard continued. “Also it was interesting to see the trailers through the lens of an object detection algorithm, and show people a few takes on what movie trailers actually look like in the logic of such a system.”

That’s a heckuva beard you’ve got there. Or is it a cellphone? Image used with permission by copyright holder

As a creative project, it’s pretty darn fascinating to watch — although it highlights some of the challenges that remain with current object classification systems. For example, in the above trailer for The Wolf of Wall Street, the algorithm mistook cast member Jon Bernthal’s goatee for a cellphone — an error no human would likely make.

To heighten this surreal effect, Korsgaard and Refsgaard said they purposely lowered the threshold of certainty so that the algorithm would be more likely to make guesses — incorrect or otherwise.

Next up, he said that Støj hopes to make available an interactive version of the project, where users can take control of the system to possibly use their own (or their own choice of) trailers. “We also plan on using image recognition algorithms in interactive installation work, where people and objects in physical space are detected and projections or soundscapes react accordingly,” Korsgaard and Refsgaard concluded.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
A war begins in the new trailer for Dune: Part Two
Timothée Chalamet in Dune: Part Two.

By splitting Frank Herbert's classic sci-fi novel Dune into two parts, director Denis Villeneuve delayed the introduction of the story's primary villain: The Emperor of the Universe, Shaddam IV (Christopher Walken). But in the newly released trailer for Dune: Part Two, viewers finally get their first glimpse at the man who plotted the downfall of House Atreides. House Harkonnen may have struck the blow against their rival house, but Shaddam IV allowed it because he feared that the late Duke Leto Atreides (Oscar Isaac) would unseat him. But the Emperor has badly miscalculated, because Leto's son, Paul Atreides (Timothée Chalamet), is now poised to make Shaddam IV's fears into a reality.

Dune: Part Two | Official Trailer 2

Read more
Dumb Money trailer reveals the people behind the GameStop stock squeeze
Paul Dano in Dumb Money.

Have you ever wanted to stick it to the rich and make a lot of money at the same time? In 2021, a number of armchair investors and gamers did exactly that during the infamous GameStop stock squeeze. For a brief period, it looked like the proverbial little guy had taken on the hedge fund managers and mega stockbrokers -- and won. Or at least until the stock bubble burst. This fall, Sony is dramatizing the entire experience in Dumb Money, and the first trailer has been released. Fair warning, this is a Red Band R-rated trailer, and there's some very NSFW language ahead.

DUMB MONEY - Official Red Band Trailer (HD)

Read more
Gal Gadot races to save the world in Heart of Stone trailer
Gal Gadot in Heart of Stone.

While Wonder Woman 3 may or may not happen with Gal Gadot, the actress potentially has a new action franchise from Greg Rucka, a comic book scribe who has frequently written the Wonder Woman comic book for DC. Fittingly, their new Netflix original film, Heart of Stone, seems to have some elements of superhero comics mixed in with Mission: Impossible intrigue. During today's Tudum event, Netflix debuted the first trailer for Heart of Stone, which establishes the double life of Gadot's character, Rachel Stone.

Heart of Stone | Gal Gadot | Official Trailer | Netflix

Read more