Skip to main content

Artificial intelligence beats 'Ms. Pac-Man' with a perfect score of 990,990

Divide and conquer: How Microsoft researchers used AI to master Ms. Pac-Man
A team of researchers have managed to develop an artificial intelligence capable of mastering the arcade classic Ms. Pac-Man. Maluuba — a Canadian deep learning startup that was acquired by Microsoft in January 2017 — used a divide-and-conquer technique to empower its system to complete the Atari 2600 version of the game with a perfect score of 999,990.

Maluuba’s approach is interesting, because it breaks down the strategies and maneuvers required to beat the game into their component parts. Various different agents focus on one job and one job alone, while an agent put in charge of managing from the top makes high-level decisions about what actions should be prioritized.

For instance, some agents might be tasked with chasing down pellets, while others focused on avoiding enemies. The decision-making agent would then choose the best option based on weighted logic — if a hundred agents wanted to move left to grab a pellet, but only three wanted to move right to avoid a ghost, it would elect to move right because colliding with the enemy would end the run.

Ms. Pac-Man is relatively widely used in AI research because of the unpredictable nature of its gameplay, according to a post on the official Microsoft blog. Steve Golson, who is credited as co-creator of the original arcade version of the game, notes that this was intentional, as the game was reliant on players spending quarter after quarter on extra lives for it to be a financial success.

Maluuba used reinforcement learning, a process by which an AI receives positive or negative feedback for each attempt it makes at a problem, to address this unpredictability. It’s hoped that reinforcement learning could help foster systems that are better equipped to make decisions on their own, compared to those that are trained via supervised learning, where the system is simply fed good and bad examples to establish a base of experience.

Editors' Recommendations

Brad Jones
Brad is an English-born writer currently splitting his time between Edinburgh and Pennsylvania. You can find him on Twitter…
MIT’s latest artificial intelligence can rewrite outdated Wikipedia pages
wikipedia asiacell iraq mwc2017 politics

Writers, editors, and researchers: Hold on to your red pens. Because MIT-powered A.I. may be coming for your jobs. 

A new “text-generating system” created by the brains behind Massachusetts Institute of Technology may be the beginning of the end for all human editing jobs. The system, announced in a press release Wednesday, is able to rummage through the millions of Wikipedia pages, sniff around for outdated data, and replace it with the most recent information available on the internet in a “human-like” style -- thus making the need for real, hot-blooded editors basically obsolete. 

Read more
Revisiting the rise of A.I.: How far has artificial intelligence come since 2010?
christie's auction house obvious art ai

2010 doesn’t seem all that long ago. Facebook was already a giant, time-consuming leviathan; smartphones and the iPad were a daily part of people’s lives; The Walking Dead was a big hit on televisions across America; and the most talked-about popular musical artists were the likes of Taylor Swift and Justin Bieber. So pretty much like life as we enter 2020, then? Perhaps in some ways.

One place that things most definitely have moved on in leaps and bounds, however, is on the artificial intelligence front. Over the past decade, A.I. has made some huge advances, both technically and in the public consciousness, that mark this out as one of the most important ten year stretches in the field’s history. What have been the biggest advances? Funny you should ask; I’ve just written a list on exactly that topic.

Read more
Artificial intelligence can now identify a bird just by looking at a photo
Artificial intelligence can now identify a bird just by looking at a photo

Artificial intelligence technology has proven itself useful in many different areas, and now birdwatching has gotten the A.I. treatment. A new A.I. tool can identify up to 200 different species of birds just by looking at one photo. 

The technology comes from a team at Duke University that used over 11,000 photos of 200 bird species to teach a machine to differentiate them. The tool was shown birds from ducks to hummingbirds and was able to pick out specific patterns that match a particular species of bird. 

Read more