Google outraces Facebook to AI breakthrough by beating a Go champ

Games have always been a preferred domain for artificial intelligence developers to test their mettle. The fixed, rule-bound systems of games allow for a clean environment in which a focused AI can take on a human counterpart with some objective measure of relative success. Now a team out of Google has passed another important milestone in the history of AI gaming, creating the first system to defeat a professional player of the ancient Chinese game, Go.

Starting with tic-tac-toe in 1954, and then checkers in 1994, computers have been steadily working their way through increasingly complex games, matching and then surpassing the best that humanity has to offer. Chess was long held as a bastion of human intellect that was too subtle for computers to master until 1997 when IBM’s Deep Blue notoriously defeated Garry Kasparov, one of the greatest players in chess history. More recently, IBM racked up another success when its Watson defeated two Jeopardy champions in 2011. Google made headlines last year with a generalized AI that was able to successfully teach itself over a dozen Atari games just based on pixel input.

Go has long been a holy grail for AI researchers due to its combination of relatively simple rules and immense strategic complexity. Originating in China over 2,500 years ago, Go has amassed millions of devoted players, and is considered a high intellectual pursuit, particularly in Japanese and Chinese culture. Players alternate placing black or white stones on a grid with the goal of capturing one another’s pieces or fully surrounding sections of the board for points. The rules are straight forward, but because players can place stones anywhere on the board, the game has 1 x 10^127 possible states. That’s more than the number of atoms in the known universe, and many orders of magnitude more than the number of possible chess positions.

Traditional AI solutions to games involve using search trees to run through possible ways that the game could play out, based on the current game state, in order to make the most informed decision. This brute force method, leveraging computing strength to run through more possibilities than an intuition-reliant human could, has always been completely insufficient in the face of Go‘s open-ended complexity.

AlphaGo went 5 and 0 against Hui, marking the first time that a computer program has ever bested a professional Go player.

Google’s team instead relied on neural networks, an approach to intelligent systems that runs inputs through layers of virtual neurons that loosely mimic animal brain function. The result is measured against a desired goal, and then connection strengths within the networks are tweaked. Through repetition this allows for systems that dynamically “learn,” arriving at solutions and strategies that were never directly programmed in. AlphaGo, Google’s system, comprised 12 neural network layers, including a “policy network” that selected a move after the board state was run through the other layers, and a “value network” that predicts the winner based on a given move.

30 million moves from human expert games were run through the network until it could successfully predict human moves 57 percent of the time (over the previous 44-percent record). Wanting to do more than just mimic human players, AlphaGo was then sent to play thousands of games against itself, developing its own, non-programmed strategies by adjusting connections and reinforcing decisions that led to victories, relying on the Google Cloud Platform for the necessary computing oomph. More technical nitty-gritty on how AlphaGo developed can be found in an article published by the team in Nature.

AlphaGo was then put to the test. First it took on the reigning top Go computer programs, winning all but one out of 500 games. Then came the real test, challenging three-time European Go champion Fan Hui. Behind closed doors last October, AlphaGo went 5 and 0 against Hui, marking the first time that a computer program has ever bested a professional Go player.

The ancient Chinese game of Go is one of the last games where the best human players can still beat the best artificial…

Posted by Mark Zuckerberg on Tuesday, January 26, 2016

Coincidentally, Facebook also just announced its efforts to tackle Go with artificial intelligence in a public post from founder Mark Zuckerberg. Although Facebook has apparently made substantial progress in the last year, Google appears to have beaten them to the punch by declaring AlphaGo’s victory over Fan Hui. It may be all fun and games for now, but tackling challenges like Go that were previously thought insurmountable has larger implications for the progress of connectionist AI and machine learning, which have the potential to become extremely powerful tools for analyzing messy, real world problems.


McLaren puts the pedal to the metal in special-edition OnePlus 6T

The OnePlus 6T is yet another flagship killer smartphone, bringing powerful specifications to a much lower price than the competition. Now, OnePlus has teamed up with McLaren for the OnePlus 6T McLaren Edition.
Home Theater

What’s new on Hulu and what’s leaving in January 2019

Our complete list of what's new on Hulu for January 2019, our personal favorites, and which titles will be removed will help you catch up on all the site has to offer -- and ensure you don't miss any titles heading into the streaming ether.

Microsoft patent filing shows wearable that mitigates involuntary movements

A patent application from Microsoft has shown the company is looking into using wearable technology to alleviate symptoms from various diseases and disorders that cause involuntary movements.

Intel's discrete graphics will be called 'Xe,' IGP gets Adapative Sync next year

Intel has officially dubbed its discrete graphics product Intel Xe, and the company also provided details about its Gen11 IGP. The latter will include adaptive sync support and will arrive in 2019.
Emerging Tech

Awesome Tech You Can’t Buy Yet: Booze-filled ski poles and crypto piggy banks

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!

Sharing your best gameplay moments is quick and easy on the Xbox One

The current generation of consoles make it easier than ever to share your gaming highlights with the world. Here's a quick guide on how you can record a gameplay video on Xbox One.

‘Kingdom Hearts III’ out in the wild, director asks for support to stop spoilers

Kingdom Hearts III has been leaked, with several copies of the game out in the wild. The game's director, Tetsuya Nomura, responded to the situation, calling for help from gamers to stop spoilers from spreading online.

The DualShock 4 is one of the best controllers ever, and you can use it with a PC

Sony's new DualShock 4 controller has become a fan favorite, and some people want to use it with a PC. Here's how to connect your DualShock 4 and start using it, either with an official adapter, or unofficial software.

Project Stream testers get to keep a free copy of ‘Assassin’s Creed Odyssey’

Those who participated in Google's technical test of Project Stream won't be able to access the service to play Assassin's Creed Odyssey after January 15, but they'll get to keep the game on PC anyway.

Newest ‘Destiny 2’ raid already completed by two-person team

The latest raid in Destiny 2: Forsaken is Scourge of the Past, and a two-person team has already managed to complete it. The task took 15 hours of trial-and-error effort before the duo managed to take down the final boss.

The 25 best SNES games

The Super Nintendo Entertainment System might be the greatest game console ever made, but what are the best titles for the system? Here are our picks for the best SNES games, including A Link to the Past and Chrono Trigger.

Need a discounted Xbox bundle by Christmas? Walmart has you covered

Black Friday and Cyber Monday have both come and gone, but you can still save some cash on a new Xbox One bundle at Walmart. Both the Xbox One S and the Xbox One X are on sale now.

The history of Battle Royale: From mod to worldwide phenomenon

Battle royale games like PlayerUnknown's Battlegrounds’ and Fortnite have become the biggest trend in video games. The genre is also pushing the envelope in streaming and eSports in a way that might hint at the future of the industry.

With our Steam guide, you can give the gift of gaming this holiday season

The holidays may have passed, but it's always a good time to give the gift of gaming (especially when there's a Steam sale)! Here's our quick guide on how to give a Steam game as a gift.