Want to teach an AI to Zerg Rush? Blizzard and DeepMind have the tool for you

StarCraft II
On Wednesday, DeepMind released a set of tools for researching and building artificial intelligence (AI) using StarCraft II as a learning environment. Blizzard first revealed DeepMind’s plans to use the popular sci-fi strategy game at the end of 2016, and said it was currently creating a rich application programming interface (API) just for training AI “agents” within the game.

The new StarCraft II-based toolset includes Blizzard’s Machine Learning API, a data set containing game replays performed by up to 500,000 anonymous users, and an open-source version of DeepMind’s PySC2 toolset. The kit also includes mini-games for developers to test their AI for specific tasks, and a joint paper listing baseline results along with an outline of the environment.

The lure of StarCraft II is that the game makes players really think. It’s all about strategy and defeating a single opponent by managing troops, resources, building equipment and bases, and conquering territories. It’s a war between two minds, starting from selecting a race to dominating the map and defeating the opponent.

AI “agents” (or bots) will approach StarCraft II just like any human. The Ai won’t have access to the back-end, it won’t be able to view the entire playing field from the start, and it won’t have any kind of software-based advantage that in the human world would be considered as cheating. AI agents will be required to make the same decisions in race selection, resource gathering, defense management, and in exploring unseen areas.

“The game also has other qualities that appeal to researchers, such as the large pool of avid players that compete online every day,” DeepMind said. “This ensures that there is a large quantity of replay data to learn from – as well as a large quantity of extremely talented opponents for AI agents.”

Another StarCraft II lure is the number of actions an AI agent can take. For instance, old Atari games only have around 10 different actions, such as up, down. left, right, and so on. In StarCraft II, the game provides more than 300 basic actions an AI agent can take. But according to DeepMind, there are around 100 million possible actions available on a screen measuring just 84 x 84.

As for the mini-games, these can be used by trained and untrained agents. They are essentially “assignments” inside StarCraft II used to see how an agent performs a specific task using a specific technique, such as selecting units, collecting minerals, and managing the camera.

Right now, there’s still progress to be made in terms of agents beating the game. DeepMind said that the strongest of baseline agents, A3C, can’t seem to beat the game’s built-in artificial opponent. According to DeepMind, in order for agents to be competitive, there needs to be a breakthrough in deep trial-and-error learning, and “other areas.”

“Our hope is that the release of these new tools will build on the work that the AI community has already done in StarCraft,” DeepMind said, “encouraging more DeepRL research and making it easier for researchers to focus on the frontiers of our field.”


These are the must-have games that every Xbox One owner needs

More than four years into its life span, Microsoft's latest console is finally coming into its own. From Cuphead to Halo 5, the best Xbox One games offer something for players of every type.

Your PlayStation 4 game library isn't complete without these games

Looking for the best PS4 games out there? Out of the massive crop of titles available, we selected the best you should buy. No matter what your genre of choice may be, there's something here for you.

Take some time to reminisce with the 25 best Sega Genesis games of all time

Although the company has since fallen into obscurity, Sega was an indisputable titan throughout the '90s. That said, here are 25 best Sega Genesis games that helped define its fabled decade.

You can play these classic Xbox 360 games on your Xbox One

The Xbox One supports backward compatibility with a growing library of Xbox 360 games. These are the best Xbox 360 games that are backward compatible with Xbox One, including action games, shooters, and more.

Enjoy Windows on a Chromebook with these great tips and tricks

If you want to push the functionality of your new Chromebook to another level, and Linux isn't really your deal, you can try installing Windows on a Chromebook. Here's how to do so in case you're looking to nab some Windows-only software.

Switch your WMA files for MP3s with our quick conversion tips

The WMA codec may be great when it comes to multi-channel surround sound, but unfortunately, it falters in terms of compatibility. Check out our guide on how to convert WMA files to MP3 via web-based or desktop methods.

Looking for a new laptop? These 5 notebooks are on sale through Presidents’ Day

If you're ready to ditch your aging notebook, you can score some fantastic Presidents' Day savings right now on Microsoft's Surface Pro 6, Dell's XPS 13, HP's Spectre x360, Lenovo's Yoga C930, and Dell's G5 15 Gaming laptops.
Virtual Reality

Getting into VR is spendy. Which headset is truly worth your hard-earned cash?

Virtual reality has finally gone mainstream, but how do you find the best VR headset for you? Check out a few of our favorites, whether you want the best of the best or a budget alternative for your mobile device.

These Windows 10 keyboard shortcuts will take your skills to a new level

Windows 10 has many new features, and they come flanked with useful new keyboard shortcuts. Check out some of the new Windows 10 keyboard shortcuts to improve your user experience and save more time!

What is Wi-Fi 6? Here's a look at the next evolution of the wireless standard

We're exploring the new naming convention for wireless standards, how it affects the devices you buy, and what the upcoming Wi-Fi generation is changing for the better.

Windows is getting a face-lift in 2020, but you can get a sneak peek right now

Microsoft is increasing the lead time for an upcoming major update to Windows 10, giving Windows Insiders the ability to test it right now, even though it's not set for release until 2020.
Emerging Tech

A.I.-powered website creates freakishly lifelike faces of people who don’t exist

No, this isn't a picture of a missing person. It's a face generated by a new artificial intelligence on the website ThisPersonDoesNotExist.com. Here's how the impressive A.I. works.

The best Presidents’ Day sales 2019: Amazon, Walmart, Dell, and more

Presidents' Day sales are a great chance to score electronics, clothing, home and office stuff, and other goodies at a discount. We’ve smoked out a large handful of the best of these Presidents' Day deals, from tech to bedding, to help…

Keep your MacBook safe and dry with an Under Armour backpack for under $50

Under Armour is having a huge sale this weekend to help you on your quest for a better backpack. The UA Outlet Exclusive sale is going on now through Monday, February 18th, offering great discounts on stormproof backpacks.