Skip to main content

Nvidia shows off virtual reality-taught robots at SIGGRAPH 2017

Nvidia has been teaching robots how to play games and perform more practical tasks using virtual reality and it is showing off what they can do at this year’s Special Interest Group on Computer Graphics and Interactive Techniques (SIGGRAPH) show. If you attend, you can play a game of dominoes against Isaac, or delve into his namesake platform to discover just how Nvidia uses VR to train robotics of the future.

Training robots is far from easy. Programming every one of their tasks for every eventual outcome is a time consuming and relatively fruitless task for programmers, so more recently artificial intelligences (AI) and their real-world physical robotics, have been taught through machine learning.

Recommended Videos

The Isaac Lab Robot Simulator is the core technology that Nvidia is demoing at SIGGRAPH 2017 and it is using a little, humanoid robot named after the program to do it. He features treaded tracks for locomotion, twin-grip hands for manipulation, and a pair of camera-equipped eyes for tracking the real world. He even has a mouth and pseudo nose, which adds just enough humanity to steer clear of the uncanny valley.

Like other game-playing AI, Isaac is an expert at them and visitors to this year’s SIGGRAPH show can test his skills in a game of dominoes. But that is only one plane of existent that you can interact with Isaac in. Putting on a virtual reality headset, you will be able to step into the world as Isaac sees it and interact with a digital version of him in VR.

That virtual realm is Nvidia’s Holodeck technology — a collaborative, virtual workspace that allows designers and developers to work together to create something in a virtual environment. It supports photorealistic models too, so all participants can have a view of a product or object as it would be in the real world, without it ever existing there.

Isaac exists in both, though, and that is what Nvidia wants to promote at SIGGRAPH 2017 — its VR robot training system. It is designed to take the cost and risk out of training a robot using machine learning. Instead of making mistakes and potentially damaging the robotics or their environment, AI can explore and learn through trial and error in a virtual space that offers the same parameters as the real world.

That lack of risk is important for human interaction and makes it possible for AI to have near-infinite interactions with humans without the potential problems that could arise through those same interactions in the real world. Nvidia Isaac offers real-time rendering and developmental tools to aid creation in VR environments to train AI.

Nvidia is not the only one showing a blending of realities with digital entities at SIGGRAPH 2017 though. Disney introduced a “Magic Bench” which lets sitters interact with all sorts of animated characters.

Jon Martindale
Jon Martindale is a freelance evergreen writer and occasional section coordinator, covering how to guides, best-of lists, and…
The robot takeover comes another step closer — at Amazon
An Amazon robot working inside one of the company's warehouses.

Amazon is close to having more robots operating inside its warehouses than humans after the e-commerce giant announced this week that it now has more than a million robots working at its facilities around the world.

Over the years, Amazon has spent billions of dollars on the development and deployment of warehouse-based robots, which handle an array of tasks once performed by human workers.

Read more
This Lenovo ThinkPad laptop is over $1,400 off — hurry while stocks last!
The Lenovo ThinkPad T14 Gen 5 Intel laptop on a white background.

Now's an excellent time to take advantage of laptop deals from Lenovo, which has slashed the prices of a wide range of devices for its Black Friday in July sale. Lenovo's ThinkPad laptops are up to 45% off, and here's one of the most interesting offers available with such a discount — the Lenovo ThinkPad T14 Gen 5 at $1,440 off its estimated value of $3,199, so you'll only have to pay $1,759. That's an excellent price for this fantastic productivity tool, but you're going to have to push forward with your purchase as soon as possible because stocks may run out at any moment.

BUY NOW

Read more
Early Prime Day deal: Samsung’s 27-inch Odyssey G3 at its annual low price
Samsung Odyssey G3 gaming monitor on desk with keyboard and headset.

If you're ready to upgrade your monitor, this Samsung deal over at Amazon just might be your best bet. The 27-inch version of Samsung's Odyssey G3 is $130 right now, a full $100 off its regular $230 price and its lowest price of the year. It's a part of early Prime Day deals and a good sampling of what we can expect for the shopping holiday, which officially lands on July 8th. Tap the button below to see it for yourself or keep reading to see why we like this deal and why this should be your next monitor.

Buy Now

Read more