AI re-creates ‘Super Mario Bros.’ game engine by watching gameplay footage

super mario bros
Over the past few years, we have seen various attempts to teach an artificial intelligence how to play a video game. Now, researchers at the Georgia Institute of Technology’s School of Interactive Computing published a paper outlining a method of teaching AI how to learn a game engine.

In previous projects, the AI has only been instructed on how to excel at a particular game. This study goes one step further, aiming to instill a deeper understanding of the mechanics at play, rather than just the fastest route to success.

The researchers decided to use Super Mario Bros. for the study, describing it in the paper as a “classic platformer.” The same game was at the core of previous researchers performed by the study’s authors, which developed an AI that was capable of creating new stages in the vein of those seen in the original.

For the purposes of this research, the AI was not given access to the game’s code, which would make it very easy for it to understand things like the height that the character could achieve with a jump or the effect various enemies had on the protagonist. Instead, it was fed video footage that it used to make assumptions how the game engine worked.

The footage was analyzed via a three-step process, starting with a scan that determines which objects were present in a given frame. A greedy matching algorithm was then run over a pair of adjacent frames to gauge changes made to those objects before each frame was parsed — if the second frame differed beyond a set amount from what the system expected to see in the next frame, an engine search would be performed.

“We anticipate this technique to aid in applications for automated game playing, explainable AI, gameplay transfer, and game design tasks such as automated game design,” the team states in the paper.

However, there are some limitations to the AI in its current form. For one, the technique that is currently in place doesn’t take player death or level transitions into account, but the team hopes to address this issue in a future study.


Your PlayStation 4 game library isn't complete without these games

Looking for the best PS4 games out there? Out of the massive crop of titles available, we selected the best you should buy. No matter what your genre of choice may be, there's something here for you.

The best HTC Vive games available today

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.

Feeling nostalgic? Here are the 25 best Sega Genesis games

Although the company has since fallen into obscurity, Sega was an indisputable titan throughout the '90s. That said, here are 25 best Sega Genesis games that helped define its fabled decade.

Get your gaming on the go with this list of the 25 best Android games

The Google Play Store is loaded with both terrific and terrible gaming titles. We vetted the store to bring you some of the best Android games available, whether you're into puzzles, shooters, racing games, or something else.

Style up your MacBook Air with one of these great cases or sleeves

Whether you’re looking for added protection or a stylish flourish, you’re in the right place for the best MacBook Air cases. We have form-hugging cases, luxurious covers and padded sleeves priced from $7 to $130. Happy shopping!

How to easily record your laptop screen with apps you already have

Learning how to record your computer screen shouldn't be a challenge. Lucky for you, our comprehensive guide lays out how to do so using a host of methods, including both free and premium utilities, in both MacOS and Windows 10.
Emerging Tech

Microsoft’s friendly new A.I wants to figure out what you want — before you ask

Move over Siri and Alexa! Microsoft wants to build a new type of virtual assistant that wants to be your friend. Already making waves in Asia, could this be the future of A.I. BFFs?

Want to gift a Steam game so you can play with a friend? Here's how to do it

The holidays may have passed, but it's always a good time to give the gift of gaming (especially when there's a Steam sale)! Here's our quick guide on how to give a Steam game as a gift.

Multi-monitor issues? Here's how to resolve them

If you're running into multi-monitor problems, you're not alone. Two screens are very useful, but they can present some difficulties. Here are some common multi-monitor problems and how to fix them.

Capture screenshots with print screen and a few alternative methods

Capturing a screenshot of your desktop is easier than you might think, but it's the kind of thing you'll probably need to know. Here's how to perform the important function in just a few, easy steps.
Emerging Tech

Awesome Tech You Can’t Buy Yet: A.I. selfie drones, ‘invisible’ wireless chargers

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!

The best MacBook deals for November 2018

If you’re in the market for a new Apple laptop, let us make your work a little easier: We hunted down the best up-to-date MacBook deals available online right now from various retailers.

Cyber Monday 2018: When it takes place and where to find the best deals

Cyber Monday is still a ways off, but it's never too early to start planning ahead. With so many different deals to choose from during one of the biggest shopping holidays of the year, going in with a little know-how makes all the…

All the best deals on Surface products for Black Friday

A number of retailers are discounting Surface devices for Black Friday. Be it the Surface Pro 2017, Surface Pro 6, or the Surface Go, here's a look at how (and where) you can save big on Surface this holiday season.