Skip to main content

Facebook's CherryPi suffered defeat in 'StarCraft,' but a win for its AI team

Image used with permission by copyright holder
Even the brilliant scientists at Facebook can’t seem to defeat the mighty ZZZKBot. The company participated in a recent StarCraft tournament that pits artificial intelligent “bots” against each other instead of humans. Facebook’s “CherryPi” AI bot walked away with a lower lip, having ranked a mere sixth place in the overall tournament with 2,049 wins out of 2,966 games.

The StarCraft AI competition took place during AIIDE (Artificial Intelligence and Interactive Digital Entertainment) 2017 at the Snowbird Ski Resort in Utah from October 5 to October 9. The annual conference focuses on artificial intelligence and interactive entertainment, pooling talents from the commercial and research communities. The highlighted topic covered artificial intelligence beyond its use in gaming.

The StarCraft AI competition specifically used the original StarCraft PC game and its expansion, Brood War. Its purpose was to evaluate the state of artificial intelligence, and how it handles real-time strategy games. This genre poses a challenge because the player must scan the field, manage resources, investigate unknown environments, and respond quickly to threats. Chess doesn’t offer that strategic depth.

Although StarCraft: Brood War has an integrated artificial opponent, it has access to the game’s back end. It doesn’t view the screen as a human does — it’s not a detached entity that must think on its own. Thus, for an external “bot” to experience the game like a human, a special interface called BWAPI was created for bots to interact with the PC game.

“BWAPI only reveals the visible parts of the game state to AI modules by default,” the Github notes state. “Information on units that have gone back into the fog of war is denied to the AI. This enables programmers to write competitive non-cheating AIs that must plan and operate under partial information conditions.”

In Facebook’s defense, the ZZZKBot is a mean opponent. It just participated in the 2017 IEEE SIG StarCraft AI competition in August and came out winning 1,790 games out of 2,374. At the end of the local tournament in Utah, the ZZZKBot came out on top again with 2,465 wins out of 2,966 games. Written by Chris Coxe, it first made an appearance during the AIIDE 2015 conference.

But given that Facebook’s CherryPi bot managed sixth place out of 28 opponents in its first swing, the company did not exactly suffer total defeat. Facebook’s AI team behind CherryPi are composed of eight individuals who published a dataset last week drawing on early data collected from CherryPi’s gameplay. The data includes 496 million player actions and millions of captured frames.

All bots were ranked by their final winning percentage of one-on-one games. They could not cheat and could not take advantage of in-game glitches. Each session lasted up to 60 minutes with fog of war enabled, which covers unexplored areas of the field. Bots were penalized for slow computations.

Out of the 28 competing bots, 15 were created and submitted by independent developers. Even more, all five bots ranking higher than CherryPI were created by independent developers. The only other non-independent AI developer to reach the top 10 was Stanford University and its Arrakhammer bot.

Editors' Recommendations

Kevin Parrish
Former Digital Trends Contributor
Kevin started taking PCs apart in the 90s when Quake was on the way and his PC lacked the required components. Since then…
How to recall an email in Gmail if you accidentally sent it
A person sitting at a desk, in front of a computer monitor with their head in their hands.

The instantaneous delivery of email comes with consequences. Once you send an email, it’s gone and out of your hands. We all make mistakes, though, and Google gets it. To help out, Gmail includes a feature called Undo Send that allows you to cancel your send request. In the past, you had to manually enable it, but now it’s on by default.

Here’s how to make the most of it.

Read more
Does Dell or HP make the best 16-inch laptop? You might be surprised
Photo of an HP Envy 16 laptop.

You can spend a lot of money on 16-inch laptops with fast components for video editing and photo editing. We're talking $2,500 and a lot more. But there's a class of midrange 16-inch machines that offer much of the same performance for less money.

Dell's Inspiron 16 Plus and HP's Envy 16 are two such laptops with prices that start well under $2,000. Both can be equipped with some fast components, but they're not identical by any means. Which of these more affordable 16-inch powerhouses is the best?
Specs and configurations

Read more
Vision Pro 2: everything we expect from the future of Apple’s headsets
The Apple Vision Pro reveals the wearer's eyes on a front-facing display.

Apple’s Vision Pro headset has just made a huge splash in the tech world, but Apple is already planning to follow it up with two new models that could take the headset to new heights -- and put it into the hands of more people. That includes a second-generation Apple Vision Pro, as well as a pared-back headset with a lower price.

What exactly should we expect from these devices? What kind of features will they offer, and when will they launch? If you’re seeking the answers to all those questions and more, you’re in the right place, as our rumor roundup will guide you through everything you need to know. Let’s get started.
Vision Pro 2: price and release date

Read more