Google's DeepMind division teaches a digital ant-like creature to play soccer

deepmind google ant soccer ai
The artificial intelligence from Google’s DeepMind Technologies division is impressively versatile, there’s no doubt. Late last year, it became the first neural network in history to defeat a professional player at Go, the Chinese board game whose human players had stumped computers for years, by besting world-ranked player Lee Sedol. It has demonstrated a prowess for video games, too — it taught itself to emerge victorious in 49 different games for the Atari 2600 console and navigate digital 3D-maze called Labyrinth. And now, Google’s human-like AI has learned how to play a sport of a different nature: soccer.

DeepMind’s latest experiment involves teaching an ant-like digital bug to maneuver a soccer ball into a goal. It’s simple enough task, in theory but exceedingly complex when you “go in blind” — that is to say, attempt to learn it without an inkling of the game’s rules or mechanics.

In getting a grasp on the basics, explained DeepMind researcher David Silver in a blog post, DeepMind takes a very human-like approach: “Humans excel at solving a wide variety of challenging problems, from low-level motor control through high-level cognitive tasks,” he wrote. DeepMind, similarly, uses learning techniques and self-reinforcement to not only teach itself the game’s physics and rules, but to use that newfound knowledge to win at it consistently.

The software’s newly developed soccer skills are thanks to what the DeepMind team calls “asynchronous reinforcement learning,” a technique designed to tackle “continuous control” problems which involve an unknown number of constantly shifting variables. The approach, in tandem with DeepMind’s many others, can assist it in figuring out complex problems and games “without any prior knowledge of [their] dynamics,” said Silver.

Other recent developments helped significantly speed up the learning process: DeepMind’s neural network now “exploits the multi-threading capabilities of standard CPUs,” Silver said, allowing it to “execute many instances” at once. And a large-scale, server-based system dubbed Gorilla speeds up computations “by an order of magnitude.” Beyond DeepMind’s quick mastery of soccer, the improvements saw gains of 300 percent in the artificial intelligence’s Atari game mean scores and nearly “human-level” performance, said Silver.

Soccer’s just the beginning, of course. DeepMind hopes to apply asynchronous reinforcement learning to tasks that involve “robotic manipulation” — i.e., unfamiliar objects and environments that machines currently require human oversight to navigate successfully. And in the long term, the AI division is working toward philanthropic efforts in other areas — DeepMind’s healthcare initiative, the eponymous DeepMind Health, seeks to leverage artificial intelligence in alerting health care workers of patients with potentially dangerous complications.


Russian hackers are targeting U.S. emails with phishing malware

Named "Cannon," the malware has been around since October, collecting screenshots and other information from the PCs of unsuspecting victims and sending it back to Russian operatives. 

25 awesome indie games you should be playing right now

These days, some of the best video games are made by independent studios. Here our 20 of the best indie games, whether you prefer grueling dungeon crawlers or otherworldly, meditative adventures.
Home Theater

The best movies on Netflix in November, from 'Buster Scruggs’ to ‘Dracula’

Save yourself from hours wasted scrolling through Netflix's massive library by checking out our picks for the streamer's best movies available right now, whether you're into explosive action, witty humor, or anything else.

Black Friday 2018: The best deals so far

Black Friday 2018 is the biggest shopping holiday of the year, and some of the best deals have already arrived. We've scoured the web to find discounts from Amazon, Walmart, Best Buy, Target, and more. Don't miss out.

Amazon breach exposes an unknown number of email addresses

Amazon blamed a technical error for accidentally exposing your email address ahead of Black Friday. The company still has not revealed any details about this latest breach, but it did say that a fix has been implemented.

Tab Groups could be a dream for multitaskers working in browser tabs

Google's Chrome browser may be borrowing Apple's desktop Stacks feature from MacOS Mojave to help people keep their browser tabs organized. Called Tab Groups, this could be a dream come true for Chrome multitaskers.

Microsoft teases useful new feature for Windows 10 Sticky Notes app

According to a tweet from Microsoft software engineer Jen Gentleman, Microsoft could be considering testing a functionality which lets users embed images inside the Windows 10 Sticky notes app. 

Between Intel and AMD, these are the best gaming CPUs at every price

What are the best processors for gaming you can buy? You don't need to spend a fortune to get an amazing gaming CPU and now that AMD is competitive again, there are more choices than ever.

Watch out for these top-10 laptop buying mistakes

Buying a new laptop is exciting, but you need to watch your footing. There are a number of pitfalls you need to avoid and we're here to help. Check out these top-10 laptop buying mistakes and how to avoid them.

Lost without Print Screen? Here's how to take a screenshot on your Mac

Whether you prefer to use keyboard shortcuts or applications such as Grab and Preview, this guide will teach you how to take a screenshot on a Mac. Once you know how, you'll be able to capture images within seconds.

How to care for your laptop’s battery and extend its life

Learn how to care for your laptop's battery, how it works, and what you can do to make sure yours last for years and retains its charge. Check out our handy guide for valuable tips, no matter what type of laptop you have.

Should you buy the affordable MacBook Air, or is the MacBook Pro worth the price?

Though they both share Retina Displays and similar keyboards, there are still some specs differences and other changes that differentiate the new 2018 MacBook Air and MacBook Pro. In this guide, we stack the two up against each other.
Smart Home

All the best Amazon Black Friday deals for 2018

Amazon may be an online-only retailer, but that doesn’t mean its Black Friday sales are anything to sniff at. In fact, due to its online status, Amazon has huge flexibility with the range of products and deals it can offer. Here's our…