Google's DeepMind division teaches a digital ant-like creature to play soccer

deepmind google ant soccer ai
The artificial intelligence from Google’s DeepMind Technologies division is impressively versatile, there’s no doubt. Late last year, it became the first neural network in history to defeat a professional player at Go, the Chinese board game whose human players had stumped computers for years, by besting world-ranked player Lee Sedol. It has demonstrated a prowess for video games, too — it taught itself to emerge victorious in 49 different games for the Atari 2600 console and navigate digital 3D-maze called Labyrinth. And now, Google’s human-like AI has learned how to play a sport of a different nature: soccer.

DeepMind’s latest experiment involves teaching an ant-like digital bug to maneuver a soccer ball into a goal. It’s simple enough task, in theory but exceedingly complex when you “go in blind” — that is to say, attempt to learn it without an inkling of the game’s rules or mechanics.

In getting a grasp on the basics, explained DeepMind researcher David Silver in a blog post, DeepMind takes a very human-like approach: “Humans excel at solving a wide variety of challenging problems, from low-level motor control through high-level cognitive tasks,” he wrote. DeepMind, similarly, uses learning techniques and self-reinforcement to not only teach itself the game’s physics and rules, but to use that newfound knowledge to win at it consistently.

The software’s newly developed soccer skills are thanks to what the DeepMind team calls “asynchronous reinforcement learning,” a technique designed to tackle “continuous control” problems which involve an unknown number of constantly shifting variables. The approach, in tandem with DeepMind’s many others, can assist it in figuring out complex problems and games “without any prior knowledge of [their] dynamics,” said Silver.

Other recent developments helped significantly speed up the learning process: DeepMind’s neural network now “exploits the multi-threading capabilities of standard CPUs,” Silver said, allowing it to “execute many instances” at once. And a large-scale, server-based system dubbed Gorilla speeds up computations “by an order of magnitude.” Beyond DeepMind’s quick mastery of soccer, the improvements saw gains of 300 percent in the artificial intelligence’s Atari game mean scores and nearly “human-level” performance, said Silver.

Soccer’s just the beginning, of course. DeepMind hopes to apply asynchronous reinforcement learning to tasks that involve “robotic manipulation” — i.e., unfamiliar objects and environments that machines currently require human oversight to navigate successfully. And in the long term, the AI division is working toward philanthropic efforts in other areas — DeepMind’s healthcare initiative, the eponymous DeepMind Health, seeks to leverage artificial intelligence in alerting health care workers of patients with potentially dangerous complications.


Leaked memo: If your MacBook keyboard dies, Apple will fix or replace in one day

If your Apple MacBook keyboard is problematic, getting it fixed at a Genius Bar just got a lot easier. Apple has now mandated that its Geniuses repair or replace MacBook keyboards by the next working day.

These awesome free-to-play games might be even better than the ones you paid for

Believe it or not, free-to-play games have evolved into engaging, enjoyable experiences. Here are a few of our favorites that you can play right now, including Warframe and the perennially popular League of Legends.

25 awesome indie games you should definitely be playing right now

These days, some of the best video games are made by independent studios. Here are 25 of the best indie games, whether you prefer grueling dungeon crawlers or otherworldly, meditative adventures.

Your PlayStation 4 game library isn't complete without these games

Looking for the best PS4 games out there? Out of the massive crop of titles available, we selected the best you should buy. No matter what your genre of choice may be, there's something here for you.

These are the must-have games that every Xbox One owner needs

More than four years into its life span, Microsoft's latest console is finally coming into its own. From Cuphead to Halo 5, the best Xbox One games offer something for players of every type.

In 2019, laptops are better than ever. Here are the best of the best

The best laptop should be one that checks all the boxes: Great battery life, beautiful design, and top-notch performance. Our picks for the best laptops you can buy do all that — and throw in some extra features while they're at it.
Product Review

Still waiting for a new Mac Pro? Corsair’s mini PC has all the power you'll need

With a modern 12-core Intel Core i9-9920X processor, Nvidia’s RTX 2080 Ti graphics, and 32GB of RAM, the Corsair One Pro is designed to woo creatives who demand more power from Apple’s Mac Pro. Like the Mac Pro, the best part of this PC…

USB drive issue blocks some PCs from receiving Windows 10 May 2019 update

A USB drive error resulted in some PCs being blocked from receiving the Windows 10 May 2019 update. Microsoft decided to block eligible PCs with USB drives or SD cards attached from getting the update until the error is fixed.

Free your digital memories, and frame them, with the best photo printers

Printed photos are experiencing a revival at the moment, but you don’t need to go to a special lab. Here’s our favorite options for making quality prints, from pocket-sized printers to wide-format photo printers capable of spitting out…

Nvidia agrees with Tesla’s take on self-driving cars, but corrects specifics

Nvidia vice president Rob Csongor agreed with broad statements by Elon Musk at Tesla's April 22 Autonomy Investor Day. Csongor then took exception to what he termed were inaccuracies about Nvidia's self-driving car chip.

Tablet or notebook? Our favorite 2-in-1 PCs give you the best of both worlds

If you can’t decide if you need a tablet or a notebook, then don’t bother. The best 2-in-1 laptops are both, and they can provide all the power you need. Check out our list for the best 2-in-1s for any user.

Amal and George Clooney want to change the world. Can Microsoft help?

Microsoft and The Clooney Foundation for Justice (CFJ) unveiled the TrialWatch app Thursday morning, a new tool in CFJ’s ongoing TrialWatch effort to shine a light on injustice in courts around the globe – which too often are simply…

These are the best 13-inch laptops you can buy right now

With so much choice out there, how do you know which are the best 13-inch laptops? They should have beautiful screens, long battery life, and remain light and portable. This is a list of our favorites.

These gaming monitors will transport you to another dimension

What are the best gaming monitors you can buy right now? We select five that are all priced under $900 packing premium technologies like G-SYNC and FreeSync, high resolutions, and fast refresh rates.