Watch a self-driving artificial intelligence try to drive around ‘GTA V’

Grand Theft Auto V might be a fun anarchy simulator, but it’s proving to have some practical uses in the real world, too. Some AI developers are using it to prototype their self-driving car algorithms and now you can watch one of them learning as it goes, live on Twitch.

Last year, the Darmstadt University of Technology in Germany and Intel Labs collaborated on a method of pulling visual information from Grand Theft Auto V, according to a report from Bloomberg. The game has now been modified such that it can be used in research projects designed to perfect self-driving programs.

The AI currently trying its luck at driving around Los Santos is called Charles. It uses pixel-level-analysis of on-screen information to make decisions about how to drive around the fictional city. In essence, it uses the same visual data that a human driver would. For an idea of what Charles “sees,” the developer has put together a short image library to explain it.

Crafted in Python — hence the Stream name, “Python Plays” — Charles currently doesn’t have any short-term memory, so doesn’t have much of an ability to learn. That’s why its driving is so poor right now and doesn’t seem to get much better no matter how long you view the stream. It does occasionally make it a few blocks without hitting anything and long-term viewers claim it is getting better, but it is far from being a safe or capable self-driving system.

Despite its obvious problems though, for a homebrew project by a single developer, the fact that it’s able to get around without any specialized information is reasonably impressive. You can imagine with time and further development, how an AI could become more proficient at driving by using a virtual toolkit like GTA V.

This kind of testing will hopefully help teach automated driving systems how to respond to unexpected obstacles with the same alertness and awareness as a skilled human driver. Anything can happen when you’re on the road, and it’s essential that an AI is able to respond appropriately, no matter what the eventuality.

At some point, self-driving technology will be advanced enough to stand up to trials on the same roads as every other human motorist. However, until we reach a certain level of sophistication, it will be the pedestrians roaming the streets in Grand Theft Auto V who bear the brunt of any unexpected occurrences.

Updated on 05-19-2017 by Jon Martindale: Added Twitch stream and information on it.


Driving Daimler’s 40-ton eCascadia big rig isn’t just fun, it’s electrifying

Daimler Trucks brought its all-electric eCascadia semi-truck to the 2019 CES, and invited us to take the wheel. What does it feel like to drive one? Simply electrifying, of course.

Robomart’s self-driving grocery store is like Amazon Go on wheels

Robomart's driverless vehicle is like an Amazon Go store on wheels, with sensors tracking what you grab from the shelves. If you don't want to shop online or visit the grocery store yourself, Robomart will bring the store to you.

How to share an external hard drive between Mac and Windows

Compatibility issues between Microsoft Windows and Apple MacOS may have diminished sharply over the years, but that doesn't mean they've completely disappeared. Here's how to make an external drive work between both operating systems.

Self-driving, electric, and connected, the cars of CES 2019 hint at the future

Car companies remained surprisingly quiet during CES 2018. But they spoke up in 2019. From electric hatchbacks you can buy in 2019 to super-futuristic mood-detecting technology, here are the major announcements we covered during the event.

Nissan IMs concept teases a future long-range, autonomous electric car

Debuting at the 2019 Detroit Auto Show, the Nissan IMs is an electric car with a 380-mile range, autonomous-driving capability, and a backseat designed for being chauffeured. Too bad it's just a concept car.

The 2020 Lexus RC F goes on a diet to run faster and hit harder

The Lexus RC F has been one of the heavier cars in its competitive set since its introduction. The Japanese firm's engineers set out to shed weight as they gave the model a mid-cycle update.

Lexus LC convertible concept teases a new open-air flagship

Debuting at the 2019 Detroit Auto Show, the Lexus LC convertible concept adds open-air motoring to the sleek LC's resume. But Lexus won't commit to a production version of the car just yet.

Fast and Furious fans get revved up: Toyota’s Supra sports car is back

The 2020 Toyota Supra made its long-awaited debut at the 2019 Detroit Auto Show. The resurrected sports car, famous for a role in The Fast and the Furious, goes on sale in the U.S. this summer.

Muscle cars, trucks, and EVs roared into the subdued 2019 Detroit Auto Show

The 2019 Detroit Auto Show was the quietest edition of the event in recent memory, but that doesn't mean nothing significant happened inside the Cobo Center. Here are the new cars and concepts we saw at the show.

Big tech, bigger grille: BMW updates its 7 Series flagship for 2020

The BMW 7 Series will enter the 2020 model year with a host of updates inside, outside, and under the sheet metal. The new-look nose with a jumbo grille hides updated engines, while passengers benefit from smart tech features.
Emerging Tech

Ford’s sweaty robot bottom can simulate 10 years of seat use in mere days

Ford has developed 'Robutt,' a sweaty robot bottom that's designed to simulate the effects of having a pair of human buttocks sitting on its car seats for thousands of hours. Check it out.

In McLaren’s 600LT Spider, the engine is the only sound system you’ll need

The McLaren 600LT Spider is the inevitable convertible version of the 600LT coupe, itself a lighter, more powerful version of the McLaren 570S. The 600LT Spider boasts a 592-horsepower, twin-turbo V8, and a loud exhaust system to hear it…

Ford has a plan to future-proof the hot-selling F-150 pickup truck

Worried about the threat of rising gas prices, Ford will add the F-150 to its growing portfolio of electrified vehicles. It is currently developing a hybrid F-150, and it will release an electric version of the next-generation truck.

Ford’s Mustang-inspired electric crossover will spawn a Lincoln luxury version

Lincoln will get its own version of parent Ford's first mass-market, long-range electric vehicle. While Ford's version will have styling inspired by the Mustang, Lincoln will take a more traditional approach.