Google outraces Facebook to AI breakthrough by beating a Go champ

Games have always been a preferred domain for artificial intelligence developers to test their mettle. The fixed, rule-bound systems of games allow for a clean environment in which a focused AI can take on a human counterpart with some objective measure of relative success. Now a team out of Google has passed another important milestone in the history of AI gaming, creating the first system to defeat a professional player of the ancient Chinese game, Go.

Starting with tic-tac-toe in 1954, and then checkers in 1994, computers have been steadily working their way through increasingly complex games, matching and then surpassing the best that humanity has to offer. Chess was long held as a bastion of human intellect that was too subtle for computers to master until 1997 when IBM’s Deep Blue notoriously defeated Garry Kasparov, one of the greatest players in chess history. More recently, IBM racked up another success when its Watson defeated two Jeopardy champions in 2011. Google made headlines last year with a generalized AI that was able to successfully teach itself over a dozen Atari games just based on pixel input.

Go has long been a holy grail for AI researchers due to its combination of relatively simple rules and immense strategic complexity. Originating in China over 2,500 years ago, Go has amassed millions of devoted players, and is considered a high intellectual pursuit, particularly in Japanese and Chinese culture. Players alternate placing black or white stones on a grid with the goal of capturing one another’s pieces or fully surrounding sections of the board for points. The rules are straight forward, but because players can place stones anywhere on the board, the game has 1 x 10^127 possible states. That’s more than the number of atoms in the known universe, and many orders of magnitude more than the number of possible chess positions.

Traditional AI solutions to games involve using search trees to run through possible ways that the game could play out, based on the current game state, in order to make the most informed decision. This brute force method, leveraging computing strength to run through more possibilities than an intuition-reliant human could, has always been completely insufficient in the face of Go‘s open-ended complexity.

AlphaGo went 5 and 0 against Hui, marking the first time that a computer program has ever bested a professional Go player.

Google’s team instead relied on neural networks, an approach to intelligent systems that runs inputs through layers of virtual neurons that loosely mimic animal brain function. The result is measured against a desired goal, and then connection strengths within the networks are tweaked. Through repetition this allows for systems that dynamically “learn,” arriving at solutions and strategies that were never directly programmed in. AlphaGo, Google’s system, comprised 12 neural network layers, including a “policy network” that selected a move after the board state was run through the other layers, and a “value network” that predicts the winner based on a given move.

30 million moves from human expert games were run through the network until it could successfully predict human moves 57 percent of the time (over the previous 44-percent record). Wanting to do more than just mimic human players, AlphaGo was then sent to play thousands of games against itself, developing its own, non-programmed strategies by adjusting connections and reinforcing decisions that led to victories, relying on the Google Cloud Platform for the necessary computing oomph. More technical nitty-gritty on how AlphaGo developed can be found in an article published by the team in Nature.

AlphaGo was then put to the test. First it took on the reigning top Go computer programs, winning all but one out of 500 games. Then came the real test, challenging three-time European Go champion Fan Hui. Behind closed doors last October, AlphaGo went 5 and 0 against Hui, marking the first time that a computer program has ever bested a professional Go player.

The ancient Chinese game of Go is one of the last games where the best human players can still beat the best artificial…

Posted by Mark Zuckerberg on Tuesday, January 26, 2016

Coincidentally, Facebook also just announced its efforts to tackle Go with artificial intelligence in a public post from founder Mark Zuckerberg. Although Facebook has apparently made substantial progress in the last year, Google appears to have beaten them to the punch by declaring AlphaGo’s victory over Fan Hui. It may be all fun and games for now, but tackling challenges like Go that were previously thought insurmountable has larger implications for the progress of connectionist AI and machine learning, which have the potential to become extremely powerful tools for analyzing messy, real world problems.


Check out 30 of the best iPhone games you need to be playing

The iPhone has some of our favorite games available for any mobile platform. Here are the best iPhone games for every big-name genre, whether you're into puzzles, strategy, or something else entirely.

The 100 best Android apps turn your phone into a jack-of-all-trades

Choosing which apps to download is tricky, especially given how enormous and cluttered the Google Play Store has become. We rounded up 100 of the best Android apps and divided them neatly, with each suited for a different occasion.

Feeling nostalgic? Here are the 25 best Sega Genesis games

Although the company has since fallen into obscurity, Sega was an indisputable titan throughout the '90s. That said, here are 25 best Sega Genesis games that helped define its fabled decade.

Immerse yourself in a new universe with these incredible PSVR games

The PSVR has surpassed expectations and along with it comes an incredible catalog of games. There's plenty of amazing experiences to be had so we've put together a list of the best PSVR games available today.

All the Best Target Black Friday deals for 2018

The mega-retailer opens its doors to the most competitive shoppers at 6 p.m. on Thursday, November 22, and signs indicate that the retailer means business this year. We've sifted through all of the deals, from consumer electronics to small…
Virtual Reality

Think virtual reality is just for games? These awesome apps will change your mind

Virtual reality isn't all about gaming. Swim with turtles, paint in 3D, and immerse yourself in some unique experiences the platform has to offer with our curated list of the best VR apps.

‘Gears of War’ designer Cliff Bleszinski says he’ll never make another game

Cliff Bleszinski, the game designer best known for his work on the Gears of War series, says he will never make another video game. His studio, Boss Key Productions, shut its doors earlier this year.

‘Fortnite’ gifts perfect for the video game fan in your life

Chances are someone on your holiday shopping list is a fan of Fortnite. As the most popular game on the planet, there are plenty of Fortnite-themed gift options available for purchase in stores and online. Here are the best ones we found.

The Best Black Friday Deals from Best Buy in 2018

We've been hard at work assembling all the best Black Friday deals Best Buy offers in 2018 and putting them in one place to save you time and money this holiday season. From laptops to TVs, game consoles to smart speakers and much more…

HDR monitors are beginning to have an impact. Here are the best you can buy

HDR isn't the most common of PC monitor features and is often charged at a premium, but the list of available options is growing. These are the best HDR monitors you can buy right now.

Every rumor about the PS5, including a new game from Luminous Productions

PlayStation 5 rumors have been circulating for over a year now but there's still plenty we don't know. Here's everything you need to know about the PS5, including rumors about its release, specs, and games.

Nintendo and Microsoft say they’re all-in on E3 after Sony bows out of 2019 event

Shortly after Sony announced it will not participate in E3 2019 for the first time, Microsoft and Sony announced the show will go on as usual for each software giant. E3 2019 now presents a unique opportunity for Sony's major competitors.

The best PS3 games of all time

Choosing the right PlayStation 3 game can be a conundrum, especially when there are nearly 1,500 titles to choose from. Thankfully, we've rounded up the best games to have ever made it to the platform.

Here's where Xur is and what he has for wares this week in 'Destiny 2: Forsaken'

The weekly vendor in Destiny 2: Forsaken always brings Exotic weapons and armor, some of the toughest loot to find in the game. Here's everything you need to know to track down Xur: Where he is, when he shows up, and what he's stocking.