Nvidia shows off virtual reality-taught robots at SIGGRAPH 2017

nvidia isaac vr training dominoes siggraph isaac01
Nvidia has been teaching robots how to play games and perform more practical tasks using virtual reality and it is showing off what they can do at this year’s Special Interest Group on Computer Graphics and Interactive Techniques (SIGGRAPH) show. If you attend, you can play a game of dominoes against Isaac, or delve into his namesake platform to discover just how Nvidia uses VR to train robotics of the future.

Training robots is far from easy. Programming every one of their tasks for every eventual outcome is a time consuming and relatively fruitless task for programmers, so more recently artificial intelligences (AI) and their real-world physical robotics, have been taught through machine learning.

The Isaac Lab Robot Simulator is the core technology that Nvidia is demoing at SIGGRAPH 2017 and it is using a little, humanoid robot named after the program to do it. He features treaded tracks for locomotion, twin-grip hands for manipulation, and a pair of camera-equipped eyes for tracking the real world. He even has a mouth and pseudo nose, which adds just enough humanity to steer clear of the uncanny valley.

Like other game-playing AI, Isaac is an expert at them and visitors to this year’s SIGGRAPH show can test his skills in a game of dominoes. But that is only one plane of existent that you can interact with Isaac in. Putting on a virtual reality headset, you will be able to step into the world as Isaac sees it and interact with a digital version of him in VR.

That virtual realm is Nvidia’s Holodeck technology — a collaborative, virtual workspace that allows designers and developers to work together to create something in a virtual environment. It supports photorealistic models too, so all participants can have a view of a product or object as it would be in the real world, without it ever existing there.

Isaac exists in both, though, and that is what Nvidia wants to promote at SIGGRAPH 2017 — its VR robot training system. It is designed to take the cost and risk out of training a robot using machine learning. Instead of making mistakes and potentially damaging the robotics or their environment, AI can explore and learn through trial and error in a virtual space that offers the same parameters as the real world.

That lack of risk is important for human interaction and makes it possible for AI to have near-infinite interactions with humans without the potential problems that could arise through those same interactions in the real world. Nvidia Isaac offers real-time rendering and developmental tools to aid creation in VR environments to train AI.

Nvidia is not the only one showing a blending of realities with digital entities at SIGGRAPH 2017 though. Disney introduced a “Magic Bench” which lets sitters interact with all sorts of animated characters.


5G is the swift kick VR and AR gaming needs to come to fruition

There's a lot of hype surrounding augmented reality and virtual reality, but is it really the next big thing? We take a look at where the new mediums stand, as well as how 5G is poised to help them break into the mainstream.
Movies & TV

How Avengers: Infinity War’s Oscar-nominated VFX team made Thanos a movie star

The purple-skinned Thanos proved to be a breakout character in Avengers: Infinity War, thanks to the work of actor Josh Brolin and visual effects studios Digital Domain and Weta. Here's how they brought him to life and earned the film an…

This list of PlayStation 4 exclusives puts its competitors to shame

The PlayStation 4's game library and incredible selection of exclusive games could make anyone with an Xbox One or Nintendo Switch think twice. Here's our list of the latest and greatest PS4 exclusives.

The HoloLens 2 will be announced at MWC. Here's what we know about it so far

The HoloLens 2 is ripe for an announcement. Here's what Microsoft has revealed so far, what's likely in store for the next generation HoloLens, and everything that we know about this mixed reality headset.

Intel expects Apple to transition Macs to ARM processors in 2020, report says

It has been rumored for some time that Apple could transition away from Intel to ARM processors, but a new report now claims that Intel is aware of the decision and that it could happen in 2020.

Still miss Windows 7? Here's how to make Windows 10 look more like it

There's no simple way of switching on a Windows 7 mode in Windows 10. Instead, you can install third-party software, manually tweak settings, and edit the registry. We provide instructions for using these tweaks and tools.

The rumors were true. Nvidia’s 1660 Ti GPU, a $280 powerhouse, has arrived

Nvidia has officially launched the GTX 1660 Ti, its next-generation, Turing-based GPU. It promises to deliver all the performance and efficiency for all modern games, but without stepping into the high price range of the RTX series. 

Dodge the biggest laptop-buying mistakes with these handy tips

Buying a new laptop is exciting, but you need to watch your footing. There are a number of pitfalls you need to avoid and we're here to help. Check out these top-10 laptop buying mistakes and how to avoid them.

Great PC speakers don't need to break the bank. These are our favorites

Not sure which PC speakers work best with your computer? Here are the best computer speakers on the market, whether you're working with a tight budget or looking to rattle your workstation with top-of-the-line audio components.

Confused about RSS? Don't be. Here's what it is and how to use it

What is an RSS feed, anyway? This traditional method of following online news is still plenty useful. Let's take a look at what RSS means, and what advantages it has in today's busy world.

Everything you need to know about routers, modems, combos, and mesh networks

Modem vs. router: what's the difference? We explain their functions so you can better diagnose any issues prior to contacting technical support. We also talk about a few variants you'll see offered by ISPs and retailers.

Metro Exodus update brings DLSS improvements to Nvidia RTX 20-series PCs

Having issues in Metro Exodus? A February 21 update for the title recently delivered enhancements to Nvidia’s deep learning supersampling feature and other fixes for low-specced PCs. 

Limited-time sale knocks $500 off the price of the Razer Blade Pro 17

Looking for an ultra-powerful laptop for yourself or someone else? You're in for some luck. Razer is running a sale on some of its best gaming laptops, cutting down pricing on the Razer Blade 15 and the Razer Blade Pro 17. 
Emerging Tech

Engineer turns his old Apple lle into an wheeled robot, and even gives it a sword

How do you give new life to a 30-year-old computer? Software engineer Mike Kohn found a way by transforming his old Apple IIe into a wheeled robot. Check it out in all its 1980s glory.