Google’s AlphaGo Zero AI quickly masters ancient board game with no human help

alphago zero
Google shocked the world in 2016 when AlphaGo, an artificial intelligence program created specifically to play the ancient board game Go, defeated one of the game’s top competitors in a five-game match. Such a feat wasn’t predicted to occur for at least another decade, leaving tech types and laymen alike wondering just how intelligent AI has become.

A little over one year later, AlphaGo again competed in a high-profile match, this time against the world’s top Go player, a 19-year-old prodigy named Ke Jie. The machine shut the human out, three games to none. With these victories under its belt, Google announced in May that it would retire AlphaGo.

But Google’s AI group, DeepMind, has just unveiled a newer, shinier, smarter version of AlphaGo dubbed AlphaGo Zero, which has pushed beyond the capabilities of its predecessor by mastering the ancient board game without any help from humans. Equipped with just the rules of the game, AlphaGo Zero managed to learn Go from scratch, create its own knowledge along the way, and ultimately defeat its predecessor 100 games to zero.

Both the old and new AlphaGo learned through a process called reinforcement learning, which encourages good moves that are more likely to be rewarded with a win. However, the way DeepMind trained the systems differed, and that’s where AlphaGo Zero really shined.

To train the original AlphaGo, DeepMind researchers fed the system thousands of games that were played by amateur and professional human Go players. These games helped the system develop winning strategies and identify good and bad moves. AlphaGo Zero, on the other hand, only played by itself (albeit millions of time), making moves at random until it recognized strategies. The new system had no help from humans beyond its initial startup.

What’s truly astonishing about AlphaGo Zero’s self-schooling is that it went from chump to champ in just a few days. The system started off as a completely incompetent player. By the third day, after only playing against itself, the system was capable of defeating its predecessor. By day 40, DeepMind suggests the system became the greatest Go player ever.

Where the original AlphaGo was little more than an exceptionally talented board game player, the advances made by AlphaGo Zero — specifically it’s ability to teach itself from scratch — makes the system relevant to a wide range of real-world applications. The same principles that help AlphaGo Zero learn from just the rules could be applied to other rules-based task.

“For us, AlphaGo wasn’t just about winning the game of Go,” Demis Hassabis, CEO of DeepMind, told The Guardian. “It was also a big step for us towards building these general-purpose algorithms.”

DeepMind published a paper detailing the development of AlphaGo Zero in the journal Nature.

Product Review

DJI has always been the king of drones, and the new Mavics are almost perfect

After flying both the Mavic 2 Pro and Mavic 2 Zoom for over a week, we’re convinced that these are two of the best drones that DJI has ever made.
Computing

Want to game on your Chromebook? Here's where to start

Chromebooks aren't great for gaming, but there are a few titles that most machines can run. There's a surprisingly diverse crowd that includes role-playing games, action side-scrollers, and puzzlers.
Gaming

The best PS3 games of all time

Choosing the right PlayStation 3 game can be a conundrum, especially when there are nearly 1,500 titles to choose from. Thankfully, we've rounded up the best games to have ever made it to the platform.
Gaming

Your PlayStation 4 game library isn't complete without these games

Looking for the best PS4 games out there? Out of the massive crop of titles available, we selected the best you should buy. No matter what your genre of choice may be, there's something here for you.
Gaming

These are the best Xbox One games available right now

More than four years into its life span, Microsoft's latest console is finally coming into its own. From 'Cuphead' to 'Halo 5,' the best Xbox One games offer something for everyone.
Emerging Tech

OSIRIS-REx spacecraft successfully tests its asteroid-sampling arm

The OSIRIS-REx spacecraft, launched in September 2016, is closing in on its target of the Bennu asteroid. The craft has now unfurled its robotic arm, called the Touch-and-Go Sample Acquisition Mechanism (TAGSAM), and tested it successfully.
Emerging Tech

Microsoft’s friendly new A.I wants to figure out what you want — before you ask

Move over Siri and Alexa! Microsoft wants to build a new type of virtual assistant that wants to be your friend. Already making waves in Asia, could this be the future of A.I. BFFs?
Emerging Tech

Awesome Tech You Can’t Buy Yet: A.I. selfie drones, ‘invisible’ wireless chargers

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Deals

Cyber Monday 2018: When it takes place and where to find the best deals

Cyber Monday is still a ways off, but it's never too early to start planning ahead. With so many different deals to choose from during one of the biggest shopping holidays of the year, going in with a little know-how makes all the…
Emerging Tech

Smarter cities need smarter addresses. And you just need 3 words

To make really smart transportation choices, more precise location data will have to be integrated with citywide transportation data. Here’s how one company is mapping the world by using just three words.
Emerging Tech

Ghostly galaxy discovered lurking on the edge of the Milky Way

A team of astronomers from the University of Cambridge have discovered a strange galaxy next door to the Milky Way. The dwarf galaxy, named Antlia 2, is dark and dim and gives out much less light than expected.
Emerging Tech

Ancient crater the size of NYC discovered under the Greenland ice sheet

A huge crater has been discovered beneath the ice of Greenland, and is thought to be the result of a meteorite impact millions of years ago. The crater is one of the largest ever discovered, measuring 19 miles across.
Emerging Tech

Here’s how the InSight mission to Mars will confirm its landing to NASA

NASA's InSight mission has sent a lander to Mars. NASA researchers have now shared details on how they will monitor the touching down of the lander at the end of its 91 million mile journey.
Emerging Tech

Would you swap your keycard for a microchip implant? For many, the answer is yes

Put down your keycard! More people are turning to implanted RFID chips as their choice of workplace identification. Should we be worried about a world in which employees get microchipped?