All hail our robot overlords: Google’s new AI will beat you at Atari

google ai atari wargames
Researchers at Google have created an artificial intelligence that teaches itself how to play video games. Representatives called it “the first significant rung of the ladder” to developing broad, flexible, intelligent systems, Bloomberg reports.

Google acquired the London-based AI startup DeepMind, which helmed the project, early in 2014.  The program was set to play 49 games on the Atari 2600 console with no instructions. Left to its own devices, the AI was able to best expert human players in 29 of the games, and outperformed the best known algorithms for 43.

Rather than programming in particular strategies for each game, the researchers paired a general AI with a memory and a reward system. After completing a level or achieving a high score the system is rewarded, encouraging it to replicate what worked. With clear, measurable goals and the ability to refer to its own memory and adjust behavior based on what happens, Google’s system is able to train itself without human supervision. That is a major leap ahead of other machine learning projects that generally require people to provide feedback. You can dig a little deeper into the tech and see the improvement in action for Breakout on the Google Research Blog.

Demis Hassabis, a DeepMind co-founder and now VP of engineering at Google, said that this is the “first time anyone has built a single learning system that can learn directly from experience and manage a wide range of challenging tasks.” Creating intelligent systems that can navigate unexpected circumstances, rather than simply performing prescribed tasks, is a holy grail for AI research, and this is a major step toward that goal.

Games provide a perfect framework for training these types of flexible AIs for the same reasons that they can serve as a useful pedagogical tool for humans. As simulations, games can recreate the noisy and dynamic environments that an intelligence may have to deal with, but structuring that complexity into manageable systems and discrete goals. The researchers described games’ utility to the journal Nature as a way to “derive efficient representations of the environment from high-dimensional sensory inputs, and use these to generalize past experience to new situations.”

Having mastered the 2D worlds of ’80s Atari games, Hassabis’ plan is to move up into the 3D games of the ’90s. He is particularly excited about driving games, because of Google’s vested interest in self-driving cars. “If this can drive the car in a racing game, then potentially, with a few real tweaks, it should be able to drive a real car. That’s the ultimate aim.”

Google is one of the leading hubs of artificial intelligence research in the world today. In addition to acquiring DeepMind, over the last few years the internet search giant has invested millions in other AI startups and a partnership with Oxford University. Hiring inventor, futurist, and chief Singularity proselytizer Ray Kurzweil as director of engineering in 2012 sent a clear signal about the company’s blue sky ambitions for the disruptive future of artificial intelligence.

The concept for DeepMind’s gaming program is remarkably similar to the 1983 film WarGames, in which an AI called WOPR (War Operation Plan Reponse), designed to provide strategic oversight to the American nuclear missile defense, was trained by playing games like chess and tic-tac-toe. WOPR almost turned the Cold War into World War 3 due to a misunderstanding, so let’s hope that Google and the government never decide to weaponize the project, or at least teach it about no-win scenarios first.

In any case, it is only a matter of time now before the King of Kong is dethroned by a machine in a Kasparov/Deep Blue kind of situation. Is nothing sacred?

Emerging Tech

Awesome Tech You Can’t Buy Yet: camera with A.I. director, robot arm assistant

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!

Lyft and Aptiv’s self-driving car program has come a long way (but not far enough)

Many companies talk about self-driving cars, but Lyft and Aptiv are already using a fleet of them to transport paying customers in Las Vegas. Hop in for a close look at the tech of autonomous cars, and the challenges they face.

Microsoft CEO says Project xCloud is the ‘Netflix for games’

Microsoft CEO Satya Nadella referred to the company's Project xCloud game streaming service as "Netflix for games." The service will let users play Xbox and PC games on a variety of devices.
Emerging Tech

Face-scanning A.I. can help doctors spot unusual genetic disorders

Facial recognition can unlock your phone. Could it also be used to identify whether a person has a rare genetic disorder, based on their facial features? New research suggests it can.

Find all of the secret exits and world skips in 'New Super Mario Bros. U Deluxe'

New Super Mario Bros. U Deluxe has two distinct Mario experiences in one package. In this guide, we'll show you how to find all of the secret exits in New Super Mario Bros. U, that lead to hidden levels and let you skip worlds.

Find all of the secret exits and world skips in 'New Super Luigi U Deluxe'

Just like all other 2D Mario games, New Super Mario Bros. Deluxe includes secret exits and world skips. In this guide, we'll show you how to get to all 12 secret exits in New Super Luigi U.

For Netflix, ‘Fortnite’ on YouTube is a bigger threat than HBO

In a letter to shareholders, Netflix explained that it views the video game Fortnite as bigger competition than HBO, with YouTube videos of the game drawing viewers away from the streaming platform.

Take a trip to a new virtual world with one of these awesome HTC Vive games

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.

Here's where Xur is and what he has for wares this week in 'Destiny 2: Forsaken'

The weekly vendor in Destiny 2: Forsaken always brings Exotic weapons and armor, some of the toughest loot to find in the game. Here's everything you need to know to track down Xur: Where he is, when he shows up, and what he's stocking.

You could be gaming on AMD’s Navi graphics card before the end of the summer

If you're waiting for a new graphics card from AMD that doesn't cost $700, you may have to wait for Navi. But that card may not be far away, with new rumors suggesting we could see a July launch.

Sharing your best gameplay moments is quick and easy on the Xbox One

The current generation of consoles make it easier than ever to share your gaming highlights with the world. Here's a quick guide on how you can record a gameplay video on Xbox One.

Blizzard’s latest hiring spree is likely for the unannounced ‘Diablo 4’

Activision Blizzard is hiring for more than a dozen positions on unannounced Diablo projects. Some of the roles are likely for the unannounced Diablo 4, the next mainline entry in the series.

Everything we know about 'Red Dead Online', including the new mode Gun Rush

Red Dead Online will gradually rolled out to Red Dead Redemption 2 players via a beta. We've got all the details about the beta's suite of competitive and cooperative modes, as well as what to expect going forward.

Xbox One X vs. PS4 Pro: Which console is more powerful?

Far from cooling down, the console wars are only getting more intense. We compare Microsoft's Xbox One X to Sony's PlayStation 4 Pro to help you decide which premium console is right for you.