School’s in session — Nvidia’s driverless system learns by watching

nvidia gpu driverless car project 100658383 primary idge 900x599
Nvidia's GPU-based driverless system learns by watching human drivers Nvidia
How do you train a car to drive itself? Let it watch real drivers. Engineers from graphics processing unit (GPU) company Nvidia designed a system that learned how to drive after watching humans drive for a total of 72 hours, as reported by NetworkWorld. The likely conclusion of the system’s success is that driverless cars are coming faster than most of us expected.

The details of how Nvidia trained two test cars are in a file titled End to End Learning for Self-Driving Cars. The basics are as follows: Nvidia used three cameras and two Nvidia DRIVE PX computers to watch humans drive cars for 72 hours.  The car training was conducted in several states, in varied weather conditions, day and night, and on a wide variety of road types and conditions. The cameras captured massive amounts data in 3D, which was tracked and stored by the on-board GPUs. That data was then analyzed and broken into learning steps with Torch 7, a machine learning system. The output? A trained system for driving cars without driver intervention.

In subsequent tests using the trained system in cars on test roads and public roads (including highways), the system achieved 98 to 100 percent autonomy. When a driver intervenes, the system continues to learn.

Only one camera and one computer are needed in a car based on Nvidia’s GPU system. When the time comes that you can buy a car with this system, it will arrive ready to drive itself — you won’t need to give it more training runs, as told to Digital Trends. While the car can drive itself, when it detects (via the camera) something new (as in something it hasn’t “seen” before), it alerts the driver to take over and then goes into learning mode. Whatever it learns is later transmitted to the cloud and that information is incorporated into the next software update so the learning can benefit all cars using Nvidia’s self-driving system. You can watch Nvidia’s GPU-based car training and performance here.

When speaking with Digital Trends, a spokesperson from Nvidia used the example of encountering a moose. The moose example works because chancing upon a moose in the road is rare in most parts of the U.S. and apparently has never happened in their car training. So if I was driving a car with the Nvidia self-driving system and a moose was on or beside the road, the system would alert me to take over. The onboard system would watch what I did and record changes to steering and other systems like brakes and acceleration. My reactions would be transmitted to the cloud. After the next software update, if another person encountered a moose, that car would know how to react based on my reactions.

This learn-by-watching method of training driverless vehicles is both more realistic and inclusive than chains of rules written by programmers based on highly varied elements like road surface, lane markers, lights, and traffic conditions. The GPU-based system does the data-gathering and the machine learning system creates the rules.

Digital Trends was informed that Nvidia is now in conversations with more than 80 major OEMs (original equipment manufacturers) and research institutions. The one manufacturer Nvidia was able speak about publicly is Volvo. Next year Volvo’s Drive Me project in Gothenburg, Sweden will use 100 Volvo XC90s equipped with the Nvidia system to observe how the system works on “a defined set of roads” in the Swedish city.

Driverless cars are coming and Nvidia’s system looks to be on pace to speed up the transition.

Emerging Tech

‘There’s Waldo’ robot will find Waldo long before you can

There’s Waldo is the brain child of Matt Reed, a creative technologist at the creative agency Redpepper. Reed and his colleagues built the bot out of a uArm Swift Pro that’s controlled by a Raspberry Pi computer.
Mobile

Apple releases sixth public beta of iOS 12, sans Group FaceTime

At this year's Worldwide Developer Conference, Apple unveiled its latest operating system, iOS 12. From app updates to group FaceTime, ARKit 2.0, and more, here are all the new features in iOS 12.
Movies & TV

David Harbour is 'taking risks' with Jim Hopper in 'Stranger Things' season 3

With a sophomore season as strong as its first, Stranger Things is now moving on to season 3. Here's everything we've learned so far about the Netflix series' upcoming third season.
Movies & TV

Can't get enough lightsaber action? Here's how to get your Star Wars fix online

Few of us want to deal with DVDs or Blu-ray discs anymore. Unfortunately, the Star Wars movies are few and far between when it comes to streaming. If you want to watch Star Wars online, check out our guide on where to find them.
Cars

Danny Thompson just set a land speed record in a 50-year-old car

Danny Thompson, son of the late racing legend Mickey Thompson, has just taken his dad's Challenger 2 streamliner to a breathtaking speed of 450 mph. The feat makes it the fastest piston-powered vehicle in the world.
Cars

Porsche goes rallying, and it’s not with the model you’re thinking of

Porsche channeled its racing heritage to turn the 718 Cayman, not the Cayenne, into a rally car. The GT4-spec model was built as a fully functional concept, and it will participate in its first rally during August.
Product Review

You don't want a 360-degree dashcam, and this is why

What can 360° video do for your car? In the case of the new Waylens Secure360 dash camera, it watches for intruders and attempts to provide a complete picture of both the interior and exterior of your ride.
Cars

2019 Ford Ranger online configurator launched, pricing revealed

The 2019 Ford Ranger midsize pickup truck starts at $25,395, but a fully loaded version can top $40,000. The Ranger is making its return to the United States after a seven-year absence.
Product Review

The 2019 Audi RS 5 Sportback lets you have your 444-hp cake and eat it, too

Audi expanded the RS 5 family with a high-performance sedan named Sportback. It stands out from rivals like the BMW M3 with a shapely fastback-like silhouette, and it surfs the downsizing wave with a twin-turbocharged 2.9-liter V6 in lieu…
Cars

Tesla board waits for Musk’s plan to go private as Saudi Arabia stays silent

Tesla co-founder and CEO Elon Musk asked more questions than he answered when he declared he could take Tesla private. The money allegedly comes from Saudi Arabia, an oil-rich nation and Tesla investor, but officials have stayed silent.
Cars

Apple Car may make its debut in the middle of the next decade

Apple likely won't become a full-fledged manufacturer like General Motors or Ford, but the tech giant is diving into the auto industry pool. Here's everything we know about the company's automotive efforts.
Cars

Live out your Steve McQueen fantasies with this souped-up Ford Mustang Bullitt

Ford tuner Steeda teamed up with Chad McQueen, son of Steve McQueen to create the ultimate 'Bullitt' tribute car. It's an upgraded version of the recently launched 2019 Ford Mustang Bullitt.
Cars

Volvo leverages the power of software to build more dynamic cars

Volvo has asked sister company Polestar to make its cars more dynamic to drive through a software update. Offered at an extra cost, the AWD optimization upgrade sends more power to the rear wheels when the driver turns on dynamic mode.
Cars

From Rolls-Royce to Lamborghini, these are the most expensive cars in the world

If you recently discovered an oil reserve in your backyard, you probably have some extra cash to spend. Look no further, because we’ve rounded up the most expensive cars in the world.