Facebook's CherryPi suffered defeat in 'StarCraft,' but a win for its AI team

By Kevin Parrish October 9, 2017

CherryPi

Even the brilliant scientists at Facebook can’t seem to defeat the mighty ZZZKBot. The company participated in a recent StarCraft tournament that pits artificial intelligent “bots” against each other instead of humans. Facebook’s “CherryPi” AI bot walked away with a lower lip, having ranked a mere sixth place in the overall tournament with 2,049 wins out of 2,966 games.

The StarCraft AI competition took place during AIIDE (Artificial Intelligence and Interactive Digital Entertainment) 2017 at the Snowbird Ski Resort in Utah from October 5 to October 9. The annual conference focuses on artificial intelligence and interactive entertainment, pooling talents from the commercial and research communities. The highlighted topic covered artificial intelligence beyond its use in gaming.

Related Videos

The StarCraft AI competition specifically used the original StarCraft PC game and its expansion, Brood War. Its purpose was to evaluate the state of artificial intelligence, and how it handles real-time strategy games. This genre poses a challenge because the player must scan the field, manage resources, investigate unknown environments, and respond quickly to threats. Chess doesn’t offer that strategic depth.

Although StarCraft: Brood War has an integrated artificial opponent, it has access to the game’s back end. It doesn’t view the screen as a human does — it’s not a detached entity that must think on its own. Thus, for an external “bot” to experience the game like a human, a special interface called BWAPI was created for bots to interact with the PC game.

“BWAPI only reveals the visible parts of the game state to AI modules by default,” the Github notes state. “Information on units that have gone back into the fog of war is denied to the AI. This enables programmers to write competitive non-cheating AIs that must plan and operate under partial information conditions.”

In Facebook’s defense, the ZZZKBot is a mean opponent. It just participated in the 2017 IEEE SIG StarCraft AI competition in August and came out winning 1,790 games out of 2,374. At the end of the local tournament in Utah, the ZZZKBot came out on top again with 2,465 wins out of 2,966 games. Written by Chris Coxe, it first made an appearance during the AIIDE 2015 conference.

But given that Facebook’s CherryPi bot managed sixth place out of 28 opponents in its first swing, the company did not exactly suffer total defeat. Facebook’s AI team behind CherryPi are composed of eight individuals who published a dataset last week drawing on early data collected from CherryPi’s gameplay. The data includes 496 million player actions and millions of captured frames.

All bots were ranked by their final winning percentage of one-on-one games. They could not cheat and could not take advantage of in-game glitches. Each session lasted up to 60 minutes with fog of war enabled, which covers unexplored areas of the field. Bots were penalized for slow computations.

Out of the 28 competing bots, 15 were created and submitted by independent developers. Even more, all five bots ranking higher than CherryPI were created by independent developers. The only other non-independent AI developer to reach the top 10 was Stanford University and its Arrakhammer bot.

Editors' Recommendations

Topics

Social Media

Facebook increasingly using AI to scan for offensive content

facebook ai screen offensive computer male facing dark background

"Content moderation" might sound like a commonplace academic or editorial task, but the reality is far darker. Internationally, there are more than 100,000 people, many in the Philippines but also in the U.S., whose job each day is to scan online content to screen for obscene, hateful, threatening, abusive, or otherwise disgusting content, according to Wired. The toll this work takes on moderators can be likened to post-traumatic stress disorder, leaving emotional and psychological scars that can remain for life if untreated. That's a grim reality seldom publicized in the rush to have everyone engaged online at all times.

Twitter, Facebook, Google, Netflix, YouTube, and other companies may not publicize content moderation issues, but that doesn't mean the companies aren't working hard to stop the further harm caused to those who screen visual and written content. The objective isn't only to control the information that shows up on their sites, but also to build AI systems capable of taking over the most tawdry, harmful aspects of the work. Engineers at Facebook recently stated that AI systems are now flagging more offensive content than humans, according to TechCrunch.

Photography

Facebook uses AI to help the blind ‘see’ images

facebook ai image reader for blind on blue

Facebook is ready to help blind people 'see' images via artificial intelligence. The new feature, called automatic alternate text, works with existing screen reader apps used by blind and visually impaired people. The AI-generated descriptions identify objects and scenes but there is no facial recognition --although we can imagine it's on the way. So you if you share an image with A visually impaired friend it won't tell him or her who is in the picture or what everyone is wearing, but it might read "Image may contain: three people, smiling, birthday cake."

There are more than 246 million people around the world with severe visual impairments and 39 million who are blind, according to Facebook. More than 2 billion photos are shared daily on Facebook, Instagram, Messenger, and WhatsApp. Automatic alternate text can help social media be more inclusive.

Emerging Tech

Facebook’s AI is learning language by reading loads of children’s books

facebook housing catalyst front sign headquarters hq offices home fb

Reading is the key to any successful language learning experience -- just ask Dr. Seuss: "The more that you read, the more things you will know. The more that you learn, the more places you'll go." This correlation isn't just for human intelligence; it also applies to artificial intelligence. To boosts its fledgling AI system, Facebook is using a data set chock full of children's literary classics such as Alice in Wonderland, The Jungle Book, and more, reports New Scientist.

Facebook is more than just a social network where people share their pictures of their kids. The company is exploring a variety of cutting-edge technologies. It is involved virtual reality through its acquisition of Oculus Rift and even is designing a way to provide Internet service using drones, A few years ago, the company formed an artificial intelligence research team, hiring Yann LeCun, the expert who helped created the modern convolutional neural networks (CNNs). LeCun at the time was tasked with recruiting the top AI scientists and assembling the world's best AI research lab.