Google's DeepMind division teaches a digital ant-like creature to play soccer

deepmind google ant soccer ai
The artificial intelligence from Google’s DeepMind Technologies division is impressively versatile, there’s no doubt. Late last year, it became the first neural network in history to defeat a professional player at Go, the Chinese board game whose human players had stumped computers for years, by besting world-ranked player Lee Sedol. It has demonstrated a prowess for video games, too — it taught itself to emerge victorious in 49 different games for the Atari 2600 console and navigate digital 3D-maze called Labyrinth. And now, Google’s human-like AI has learned how to play a sport of a different nature: soccer.

DeepMind’s latest experiment involves teaching an ant-like digital bug to maneuver a soccer ball into a goal. It’s simple enough task, in theory but exceedingly complex when you “go in blind” — that is to say, attempt to learn it without an inkling of the game’s rules or mechanics.

In getting a grasp on the basics, explained DeepMind researcher David Silver in a blog post, DeepMind takes a very human-like approach: “Humans excel at solving a wide variety of challenging problems, from low-level motor control through high-level cognitive tasks,” he wrote. DeepMind, similarly, uses learning techniques and self-reinforcement to not only teach itself the game’s physics and rules, but to use that newfound knowledge to win at it consistently.

The software’s newly developed soccer skills are thanks to what the DeepMind team calls “asynchronous reinforcement learning,” a technique designed to tackle “continuous control” problems which involve an unknown number of constantly shifting variables. The approach, in tandem with DeepMind’s many others, can assist it in figuring out complex problems and games “without any prior knowledge of [their] dynamics,” said Silver.

Other recent developments helped significantly speed up the learning process: DeepMind’s neural network now “exploits the multi-threading capabilities of standard CPUs,” Silver said, allowing it to “execute many instances” at once. And a large-scale, server-based system dubbed Gorilla speeds up computations “by an order of magnitude.” Beyond DeepMind’s quick mastery of soccer, the improvements saw gains of 300 percent in the artificial intelligence’s Atari game mean scores and nearly “human-level” performance, said Silver.

Soccer’s just the beginning, of course. DeepMind hopes to apply asynchronous reinforcement learning to tasks that involve “robotic manipulation” — i.e., unfamiliar objects and environments that machines currently require human oversight to navigate successfully. And in the long term, the AI division is working toward philanthropic efforts in other areas — DeepMind’s healthcare initiative, the eponymous DeepMind Health, seeks to leverage artificial intelligence in alerting health care workers of patients with potentially dangerous complications.

Product Review

The Division 2 feels more like a revision, but fans will love it

If the private beta is any indication, The Division 2 is shaping up to be a better version of the original, rather than a brand-new experience. That said, the game is looking quite great.

Your PlayStation 4 game library isn't complete without these games

Looking for the best PS4 games out there? Out of the massive crop of titles available, we selected the best you should buy. No matter what your genre of choice may be, there's something here for you.

DLSS is finally arriving in games, but how does Nvidia's super-sampling actually work?

Nvidia's new DLSS technology is exciting, but what is it and how does it work? It's not quite anti-aliasing and it's not quite super sampling. It's a little bit of both and the end results can be impressive.

Latest ‘Battlefield V’ update brings better performance to Nvidia RTX PCs

DLSS support is finally coming to Battlefield V thanks to an update that will arrive on February 12. DLSS will help boost game performance when real-time ray-tracing is enabled, even when the game is played at higher resolutions.

These Windows 10 keyboard shortcuts will take your skills to a new level

Windows 10 has many new features, and they come flanked with useful new keyboard shortcuts. Check out some of the new Windows 10 keyboard shortcuts to improve your user experience and save more time!

What is Wi-Fi 6? Here's a look at the next evolution of the wireless standard

We're exploring the new naming convention for wireless standards, how it affects the devices you buy, and what the upcoming Wi-Fi generation is changing for the better.

Windows is getting a face-lift in 2020, but you can get a sneak peek right now

Microsoft is increasing the lead time for an upcoming major update to Windows 10, giving Windows Insiders the ability to test it right now, even though it's not set for release until 2020.
Emerging Tech

A.I.-powered website creates freakishly lifelike faces of people who don’t exist

No, this isn't a picture of a missing person. It's a face generated by a new artificial intelligence on the website Here's how the impressive A.I. works.

The best Presidents’ Day sales 2019: Amazon, Walmart, Dell, and more

Presidents' Day sales are a great chance to score electronics, clothing, home and office stuff, and other goodies at a discount. We’ve smoked out a large handful of the best of these Presidents' Day deals, from tech to bedding, to help…

Keep your MacBook safe and dry with an Under Armour backpack for under $50

Under Armour is having a huge sale this weekend to help you on your quest for a better backpack. The UA Outlet Exclusive sale is going on now through Monday, February 18th, offering great discounts on stormproof backpacks.

Walmart Presidents’ Day sale: Instant Pot, Google Home, and 4K TV deals

Presidents' Day weekend is one of the best times of the year to find deep discounts on 4K TVs, laptops, Instant Pots, clothes, mattresses, and furniture. And Walmart is offering deals on all of those things and more.

The HoloLens 2 will be announced at MWC. Here's what we know about it so far

The HoloLens 2 is ripe for an announcement. Here's what Microsoft has revealed so far, what's likely in store for the next generation HoloLens, and everything that we know about this mixed reality headset.

Don't know what to do with all your old DVDs? Here's how to convert them to MP4

Given today's rapid technological advancements, physical discs are quickly becoming a thing of the past. Check out our guide on how to convert a DVD to MP4, so you can ditch discs for digital files.

Wi-Fi helps connect all of our devices at high-speed, but what exactly is it?

What is Wi-Fi? It's a technology we all use everyday to connect all of our portable devices, but understanding how it works and how far it's come from its humble beginnings is another thing entirely.