Computer scientists develop AI that gets curious about its surroundings

Artificial intelligence is showing a greater range of abilities and use-cases than ever, but it’s still relatively short on desires and emotions. That could be changing, however, courtesy of research at the University of California, Berkeley, where computer scientists have developed an AI agent that’s naturally (or, well, as naturally as any artificial agent can be) curious.

In tests, they set the AI playing games such as Super Mario and a basic 3D shooting game called VizDoom, and in the games, it displayed a propensity for exploring its environment.

“Recent success in AI, specifically in reinforcement learning (RL), mostly relies on having explicit dense supervision — such as rewards from the environment that can be positive or negative,” Deepak Pathak, a researcher on the project, told Digital Trends. “For example, most RL algorithms need access to the dense score when learning to play computer games. It is easy to construct a dense reward structure in such games, but one cannot assume the availability of an explicit dense reward-based supervision in the real world with similar ease.”

But given that Super Mario is — last time we checked — a game, how does this differ from AI like the DeepMind artificial intelligence that learned to play Atari games? According to Pathak, the answer is in its approach to what it is doing. Rather than simply trying to complete a game, it sets out to find novel things to do.

“The major contribution of this work is showing that curiosity-driven intrinsic motivation allows the agent to learn even when rewards are absent,” he said.

This, he notes, is similar to the way we show curiosity as humans. “Babies entertain themselves by picking up random objects and playing with toys,” Pathak continued. “In doing so, they are driven by their innate curiosity, and not by external rewards or the desire to achieve a goal. Their intrinsic motivation to explore new, interesting spaces and objects not only helps them learn more about their immediate surroundings, but also learn more generalizable skills. Hence, reducing the dependence on dense supervision from the environment with an intrinsic motivation to drive progress is a fundamental problem.”

Although it’s still relatively early in the project, the team now wants to build on its research by applying the ideas to real robots.

“Curiosity signal would help the robots explore their environment efficiently by visiting novel states, and develop skills that could be transferred to different environments,” Pathak said. “For example, the VizDoom agent learns to navigate hallways, and avoid collisions or bumping into walls on its own, only by curiosity, and these skills generalize to different maps and textures.”

Emerging Tech

Awesome Tech You Can’t Buy Yet: camera with A.I. director, robot arm assistant

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!

The hottest Nintendo Switch games you can get right now

The Nintendo Switch's lineup started off small, but games have steadily released as the console continues through its second year. Here are the best Nintendo Switch games available now.

These are the best indie games you can get on PC right now

Though many indie games now come to consoles as well, there's still a much larger selection on PC. With that in mind, we've created a list of the best indie games for PC, with an emphasis on games that are only available on PC.

Take a trip to a new virtual world with one of these awesome HTC Vive games

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.
Emerging Tech

Google’s radar-sensing tech could make any object smart

Computer scientists have shown how Google’s Soli sensor can be used to make dumb objects smart. Here's why radar-powered computing could finally make the dream of smart homes a reality.
Emerging Tech

Tiny microbots fold like origami to travel through the human body

Tiny robots modeled after bacteria could be used to deliver drugs to hard to reach areas of the human body. Scientists have developed elastic microbots that can change their shape depending on their environment.
Emerging Tech

Dinosaurs never stood a chance after asteroid impacts doubled 290M years ago

The number of asteroids pummeling Earth jumped dramatically around 290 million years ago. By looking at Moon craters, scientists discovered that d the number of asteroid impacts on both Earth and the Moon increased by two to three times.
Emerging Tech

Saturn didn’t always have rings, according to new analysis of Cassini data

Saturn's rings are younger than previously believed, according to new data gathered from the Cassini mission. The rings are certainly less than 100 million years old and perhaps as young as 10 million years old.
Emerging Tech

Water-based fuel cell converts carbon emissions to electricity

Scientists from Korea's Ulsan National Institute of Science and Technology have developed a system which can continuously produce electrical energy and hydrogen by dissolving carbon dioxide in an aqueous solution.
Emerging Tech

Scientists investigate how massive stars die in dramatic hypernova events

Our Sun will gradually fade before expanding into a red giant at the end of its life. But larger mass stars undergo extreme explosive events called hypernovas when they die which outshine their entire galaxies.
Emerging Tech

Pilotless planes are on their way, but would you fly in one?

Airbus says advancements in artificial intelligence can help it toward its goal of building a plane capable of fully autonomous flight, though whether passengers can be persuaded to travel in one is another matter entirely.
Emerging Tech

‘Tech vest’ prevents Amazon workers from colliding with robot co-workers

Amazon workers at its fulfillment centers are using "tech vests" to help protect them from collisions with their robot co-workers. The robots already have obstacle avoidance sensors, but the belt offers another layer of safety.
Emerging Tech

3D printers are finally affordable. Here are the best models under $500

3D printer prices have dropped dramatically over the past few years, but just because something is cheap doesn’t mean it’s worth buying. Here, we’ve rounded up all the cheap 3D printers that are actually worth spending your money on.

T-Mobile 5G rollout: Here is everything you need to know

2019 will be a huge year for T-Mobile. Not only is a merger with Sprint likely, but T-Mobile is also in the midst of building out its next-generation mobile service. Here's everything you need to know about the T-Mobile 5G rollout.