Skip to main content

Virtual reality training ground helps robots prepare for the real world

AI2-THOR v1.0 demo

Robots are getting better at dealing with the complexity of the real world, but they still need a helping hand when taking their first tentative steps outside of easily defined lab conditions. That’s what a new open source virtual reality training ground called AI2-THOR, created by researchers at Seattle’s Allen Institute for Artificial Intelligence, aims to help with. It’s an interactive VR model of real-world scenes, such as the kitchen or living room in a regular home, that allows an A.I. agent to learn to cope with our world in a way that is not only less time-consuming, but a whole lot less risky, too — for both robots and the human folk they interact with.

At present, most commercial machine learning algorithms learn about the world from data sets made up of videos and still images. That approach certainly has its uses, as a quick glance at the number of robotics-related advances in recent years will prove. However, it’s not necessarily a substitute for the opportunity to physically interact with the real world, which is where AI2-THOR comes in.

The THOR project is an acronym standing for “The House Of inteRactions.” The realistic A.I. training ground, created using the graphical engine Unity, has been in development since the summer 2016. The first version of the software offered 120 different scenes, based around kitchens, living room, bedroom, and bathroom settings. Each one features location-appropriate items to interact with, such as an openable microwave in the kitchen, as well as realistic physics models. The detail even includes such minutiae as empty and full bathtubs and sliceable apples.

In the future, the team behind AI2-THOR plans to expand it further by adding objects with non-rigid physics, letting robots get valuable practice at making beds or moving items of clothing. (Hey, we’re not giving up on our Jetsons-style dream of a robot household helper yet!)

The open-source software is already available for users, and anyone is able to download it and customize the various scenes to their specifications. Hopefully, initiatives such as this will allow robots to get even smarter while opening up the toolsets to allow this in a way that reaches those outside of high-end research labs.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Holotron is a robotic exosuit that could transform the way we use VR
holotron robot exosuit 1

Life-like VR and Robot Teleoperation - Holotron Demo, 1 min, no narration

There was once a time, in the early 1990s to be precise, when the biggest impediment to achieving high-end virtual reality was the fact that the images were too fuzzy and slow-moving. Today, we’ve moved way beyond these early teething challenges. With impressive visuals and three-dimensional sound, VR has no problem creating a compellingly immersive experience -- from an audio-visual perspective, at least.

Read more
A disembodied robot mouth and 14 other 2020 stories we laughed at
The Prayer

Goodbye 2020, and good riddance! But before we slam the door shut on this tumultuous year, let’s try to raise a smile or two by revisiting some of the more amusing tech stories that landed on the pages of Digital Trends over the last 12 months. Here's a recap of the weirdest, wildest, and most hilariously strange stories we've run this year. Enjoy!
A.I. fail as robot TV camera follows bald head instead of soccer ball

While artificial intelligence (A.I.) has clearly made astonishing strides in recent years, the technology is still prone to the occasional fail.

Read more
Spatial is what would happen if Slack and Zoom had a virtual reality baby

Spatial is the New Virtual Office | Oculus for Business

When it comes to communication mediums that let you clearly express yourself, emails are generally better than text messages, phone calls are better than emails, and Zoom-style video calls are better than phone calls. Could virtual reality be better than a video call?

Read more