Skip to main content

AI re-creates ‘Super Mario Bros.’ game engine by watching gameplay footage

Box art for super mario bros shows fire Mario running.
Nintendo
Over the past few years, we have seen various attempts to teach an artificial intelligence how to play a video game. Now, researchers at the Georgia Institute of Technology’s School of Interactive Computing published a paper outlining a method of teaching AI how to learn a game engine.

In previous projects, the AI has only been instructed on how to excel at a particular game. This study goes one step further, aiming to instill a deeper understanding of the mechanics at play, rather than just the fastest route to success.

Recommended Videos

The researchers decided to use Super Mario Bros. for the study, describing it in the paper as a “classic platformer.” The same game was at the core of previous researchers performed by the study’s authors, which developed an AI that was capable of creating new stages in the vein of those seen in the original.

Please enable Javascript to view this content

For the purposes of this research, the AI was not given access to the game’s code, which would make it very easy for it to understand things like the height that the character could achieve with a jump or the effect various enemies had on the protagonist. Instead, it was fed video footage that it used to make assumptions how the game engine worked.

The footage was analyzed via a three-step process, starting with a scan that determines which objects were present in a given frame. A greedy matching algorithm was then run over a pair of adjacent frames to gauge changes made to those objects before each frame was parsed — if the second frame differed beyond a set amount from what the system expected to see in the next frame, an engine search would be performed.

“We anticipate this technique to aid in applications for automated game playing, explainable AI, gameplay transfer, and game design tasks such as automated game design,” the team states in the paper.

However, there are some limitations to the AI in its current form. For one, the technique that is currently in place doesn’t take player death or level transitions into account, but the team hopes to address this issue in a future study.

Brad Jones
Former Digital Trends Contributor
Brad is an English-born writer currently splitting his time between Edinburgh and Pennsylvania. You can find him on Twitter…
All Super Mario Bros. Wonder power-ups, ranked
Mario turning into Super Mario.

Super Mario Bros. Wonder is perhaps the Mario franchise's most colorful and unusual game to date, featuring all manner of dream-like themes and near-endless amounts of creativity. Like any new Mario game, though, it also comes packing some brand-new power-ups alongside a handful of returning classics that everyone knows and loves. All of the power-ups have their unique uses that can help you fend off baddies, reach new areas, or simply create hilarious hijinks, but some are notably more exciting than others.

Here are all of the Super Mario Bros. Wonder power-ups ranked. They'll all come in handy when you're tracking down all of the badges, medals, and Special World entrances.
All Super Mario Bros. Wonder power-ups, ranked
6. Super Mushroom

Read more
Super Mario Bros. Wonder is getting a very red Nintendo Switch OLED
An image of the Nintendo Switch - OLED Model Mario Red Edition.

Nintendo is launching a Nintendo Switch - OLED Model Mario Red Edition in October. The news capped off the company's Super Mario Bros. Wonder Direct today, which shared new details on the upcoming platformer.

This new themed version of the latest Nintendo Switch iteration is completely red across the system and Joy-Cons. On the back of it, players can find a silhouette of Mario and hidden coins. It's not as detailed as The Legend of Zelda: Tears of the Kingdom's OLED model, but it does look very sleek. This Mario Red Edition system will come out on October 6, two weeks ahead of Super Mario Bros. Wonder's release.

Read more
Super Mario Bros. Wonder Direct: how to watch and what to expect
Mario as an elephant in Super Mario Bros. Wonder.

Nintendo will reveal more about Super Mario Bros. Wonder during a Nintendo Direct dedicated to the game that's set for later this week. Nintendo announced this new 2D Mario game during a Direct in June, but we haven't learned much more about it since then outside of the fact that Charles Martinet won't voice Mario in it. As such, this is a presentation Mario fans will definitely want to tune into ahead of the game's release in October. If you're planning to watch the Super Mario Bros. Wonder Direct live, this is everything you need to know about watching it.

When is the Super Mario Bros. Wonder Direct
Nintendo confirmed that the Super Mario Bros. Wonder Direct will take place at 7 a.m. PT on August 31. It says the showcase will last "roughly 15 minutes," so you'll only need to set aside a little bit of time on Thursday morning for it.
How to watch the Super Mario Bros. Wonder Direct
Like most Nintendo Directs, this Super Mario Bros. Wonder Direct will be live-streamed on Nintendo's YouTube channel. The premiere for it is already live on YouTube, and you can watch it from this article with the embedded video below. 
Super Mario Bros. Wonder Direct 8.31.2023
What to expect from the Super Mario Bros. Wonder Direct
Super Mario Bros. Wonder launches for Nintendo Switch on October 20, but there's still a lot we don't know about it. Nintendo simply says the Direct will serve as "an in-depth look at Mario's latest 2D side-scrolling adventure," so expect a deep dive into the different characters, gimmicks, and abilities players will encounter during the game. 
I personally hope we learn more about some of the new power-ups we can use in the adventure, like the Wonder Flower that makes levels weird and the strange-looking power-up that turns Mario into an elephant. One thing you shouldn't expect from this Direct: other Nintendo games. This is a livestream to tune into if you want to learn more about Super Mario Bros. Wonder and Super Mario Bros. Wonder alone. That's not such a bad thing, though.

Read more