Skip to main content

Artificial intelligence beats 'Ms. Pac-Man' with a perfect score of 990,990

Divide and conquer: How Microsoft researchers used AI to master Ms. Pac-Man
A team of researchers have managed to develop an artificial intelligence capable of mastering the arcade classic Ms. Pac-Man. Maluuba — a Canadian deep learning startup that was acquired by Microsoft in January 2017 — used a divide-and-conquer technique to empower its system to complete the Atari 2600 version of the game with a perfect score of 999,990.

Maluuba’s approach is interesting, because it breaks down the strategies and maneuvers required to beat the game into their component parts. Various different agents focus on one job and one job alone, while an agent put in charge of managing from the top makes high-level decisions about what actions should be prioritized.

Related Videos

For instance, some agents might be tasked with chasing down pellets, while others focused on avoiding enemies. The decision-making agent would then choose the best option based on weighted logic — if a hundred agents wanted to move left to grab a pellet, but only three wanted to move right to avoid a ghost, it would elect to move right because colliding with the enemy would end the run.

Ms. Pac-Man is relatively widely used in AI research because of the unpredictable nature of its gameplay, according to a post on the official Microsoft blog. Steve Golson, who is credited as co-creator of the original arcade version of the game, notes that this was intentional, as the game was reliant on players spending quarter after quarter on extra lives for it to be a financial success.

Maluuba used reinforcement learning, a process by which an AI receives positive or negative feedback for each attempt it makes at a problem, to address this unpredictability. It’s hoped that reinforcement learning could help foster systems that are better equipped to make decisions on their own, compared to those that are trained via supervised learning, where the system is simply fed good and bad examples to establish a base of experience.

Editors' Recommendations

Here’s why Bing Chat conversation lengths are now limited
A sad robot holds a kitchen timer that's in the red.

Bing Chat seems to now limit the length of conversations, in an attempt to avoid the AI's occasional, unfortunate divergence from what you might expect from a helpful assistant.

Bing Chat has only been live for a little over a week, and Microsoft is already restricting the usage of this powerful tool that should be able to help you get through a busy day.  Microsoft has analyzed the results of this initial public outing and made a few observations about the circumstances that can lead Bing Chat to become less helpful.

Read more
Windows 11 may soon replace all your annoying RGB apps
a PC case with RGB lighting inside.

Microsoft may be adding a new feature to Windows 11, and if you're a fan of making your PC all shiny and fancy with RGB accessories, you're going to like this one.

A leaked screenshot shows that Windows 11 might soon allow you to control all of your RGB lighting in one place instead of having to rely on using different apps for various components.

Read more
U.K. wants Call of Duty removed from Microsoft’s Activision acquisition
Call of Duty Modern Warfare 2.

Microsoft has hit a major roadblock in its attempt to acquire Activision Blizzard, as the UK's Competition and Markets Authority (CMA) has determined that the deal "could harm U.K. gamers." For the deal to go through, the CWA is suggesting some major concessions, like Activision Blizzard divesting in the Call of Duty or Activision segments of its business ahead of the acquisition.
A notice of possible remedies document asks Activision Blizzard to do one of the following three things if it doesn't want the acquisition to be potentially prohibited. 

"Divestiture of the business associated with Call of Duty."
"Divestiture of the Activision segment of Activision Blizzard, Inc., which would include the business associated with Call of Duty."
"Divestiture of the Activision segment and the Blizzard segment of Activision Blizzard Inc., which would include the business associated with Call of Duty and World of Warcraft, among other titles."

Read more