Synthia is a massive virtual city where autonomous vehicles can safely learn how to drive

The idea of training people using video games is nothing new. For instance, pilots and soldiers have long used virtual simulations to get to grips with different tasks and scenarios in a risk-free environment. But could the same idea also be applied to self-driving cars?

According to a new project by Barcelona’s Computer Vision Center, the answer is a resounding yes. Scientists at the Computer Vision Center have created a virtual city simulation, called SYNTHIA, which they are using to teach autonomous vehicle AIs to be better drivers.

To build the city simulation, researchers used the same Unity engine that has been previously utilized for a wide range of consumer video games. Employing this engine, the team was able to create a realistic cityscape — which they proceeded to populate with inattentive pedestrians, badly-parked buses, and even its own extreme weather system. On top of this they then added the self-driving car AI.

“Our research shows that the gap between virtual and real worlds is getting very small,” German Ros, a research assistant and Deep Learning PhD candidate who worked on the project, tells Digital Trends. “For many perception-related problems, such as semantic segmentation — basic scene understanding — and object recognition, it is now easy to take models trained on a virtual world [and have them] work well in real scenes.”

The advantage of teaching an autonomous car to drive using a virtual world is obvious. While self-driving vehicles are widely considered to be safer drivers than the vast majority of humans, they are still learning how to deal with certain environments. Simulations such as SYNTHIA allow researchers to throw a variety of obstacles at self-driving AIs — ranging from erratic bicyclists to traffic accidents or complex weather patterns — to see how they will cope. These may include statistically rare hazards that are important for a computer to be able to recognize, but which may not come up during even hundreds of hours of training on real roads.

“Virtual environments offer the opportunity of generating the data cases that are most suitable to perform good training,” Ros continues. “The simulator can ‘jump’ from a dark winter scene to a sunny summer scene automatically to maximize the ‘knowledge gain’ of the system. In other words, the system can be set up to give you those images and cases that are [best] suited for your current training state.” In addition, Ros points out that virtual environments are easy to extend by adding new information in the form of objects or situations.

The result, the team hopes, should be that when the self-driving cars eventually hit the road, they shouldn’t be phased by whatever scenario comes their way.

Emerging Tech

‘Bionic mushroom’ can generate electricity without using fossil fuels

Researchers have come up with a way to produce electricity without fossil fuels using mushrooms covered with bacteria. The mushroom provides a safe environment for special cyanobacteria that generate electricity when light is shone on them.

Bosch, Daimler team up to deploy autonomous Mercedes-Benz S-Classes in San Jose

In 1986, when Bosch and Daimler joined an autonomous car research project, the technology seemed overly futuristic. Now, the partners are aiming to make a production self-driving car by the early 2020s.

Safety driver in Waymo autonomous car causes collision with biker

Safety drivers are supposed to take control of a self-driving car when a potentially dangerous situation occurs during road tests. But a recent takeover by a Waymo driver resulted in an accident with a motorcyclist.

Uber wants to restart self-driving car tests in Pennsylvania

Uber is seeking to resume testing self-driving cars on the streets of Pittsburgh, Pennsylvania following a fatal crash in Arizona that shut down on-road testing for months. Uber claims to have made safety improvements.

This smart toothbrush will clean all your teeth in just 6 seconds

No more one-size-fits-all toothbrushes with bristles too soft for deep cleaning or too hard on your gums. The Unobrush ergonomic toothbrush is designed to fit every type of mouth - you just bite down and it forms to every tooth.
Emerging Tech

The 20 best tech toys for kids will make you wish you were 10 again

Looking for the perfect toy or gadget for your child? Thankfully, we've rounded up some of our personal favorite tech toys, including microscopes, computer kits, and a spherical droid from a galaxy far, far away.
Product Review

Airselfie 2 may as well be a GoPro stapled to a drunk hummingbird

On paper, the Airselfie 2 is marketed as flying photographer that fits in your pocket and snaps selfies from the sky. Unfortunately it’s more like a HandiCam controlled by a swarm of intoxicated bumblebees

Photography News: Flickr keeping Creative Commons photos, ONA gets colorful

Flickr has confirmed it's saving all Creative Commons images, ONA has released a new capsule collection in partnership with Passion Passport and 7Artisans has launched a new drone-specific 35mm f/5.6 lens.

Get your Sagan on with 60 awe-inspiring photos of the final frontier

Few things instill a sense of wonder quite like the final frontier. The best space photos show off the beauty of Earth, our solar system, and the far corners of the universe. Here are our current favorites.

Cyber Monday 2018: When it takes place and where to find the best deals

Cyber Monday is still a ways off, but it's never too early to start planning ahead. With so many different deals to choose from during one of the biggest shopping holidays of the year, going in with a little know-how makes all the…
Emerging Tech

Curiosity rover active and drilling again after computer issue

The Curiosity rover has succeeded in drilling a hole into the tough bedrock that previously defeated it, allowing imaging and collection of samples. The rover had been incapacitated for a few weeks due to problems with its computer.
Emerging Tech

Astronomers discover two rogue planets that do not orbit a star

Astronomers have identified two rogue planets in our galaxy which do not orbit around a star. Unlike the vast majority of discovered planets, these rogue planets drift through space alone with no sun to shine on them.
Emerging Tech

Awesome Tech You Can’t Buy Yet: 1-handed drone control, a pot that stirs itself

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Emerging Tech

Pairs of supermassive black holes spotted in colliding galaxies

Astronomers have discovered several pairs of supermassive black holes in galaxies that are colliding with each other. These black holes will spiral closer and closer together and eventually merge into one supermassive black hole.