Watch Nvidia’s powerful A.I. change day into night, and winter into summer

nvidia ai winter summer car nips research street scene
Artificial intelligence is so awesome these days that it can turn summer into winter, and day into night. Well, in a video at least. Presented at this week’s Conference on Neural Information Processing Systems (NIPS), researchers from Nvidia showcased some seriously smart machine-learning tools that are able to digitally alter a video of a winter scene so that it looks like it was shot on a sunny July 4 weekend.

We’re not referring to a simple palette swap, either; we’re talking about eliminating roadsides lined with snow and replacing them with grassy banks. The only thing that’s missing is a family out having a barbecue.

“The goal of our research is to give machines the ability to create or ‘imagine’ scenes on their own,” Ming-Yu Liu, a senior research scientist at Nvidia, told Digital Trends. “This is a difficult challenge, because most A.I. today require you to have images as training data that exactly correspond for both the input and target image. Let’s say you wanted an A.I. that could turn a driving video from night into day, or convert a sunny day into a rainy day. Today, you would need to record video of that street during both daytime and nighttime, shot from exactly the same location, with the objects — vehicles, trees, pedestrians — in exactly the same location. In contrast, our method just needs a set of daytime images and another set of nighttime images for training, and these images can be taken in different cities or countries. Without the requirement of corresponding images, collecting data for training our model is much easier.”

To create their image-altering tool, the Nvidia researchers developed a novel neural network design to achieve unsupervised image-to-image translation. The algorithm and its source code is described in a paper available here. While it’s certainly an impressive tech demo, Liu points out that it has numerous real-world applications. For example, it could be immensely useful in video editing work. However, Nvidia has a much more immediate application in mind: Training self-driving cars.

“We did this research to help train self-driving cars under different weather and lighting conditions,” he said. “You can shorten training time for self-driving cars by teaching them with simulation. Using our technique, we can convert daytime to nighttime video, add rain or snow, and use that to help train self-driving cars [to deal with a wide range of scenarios they might face].”

Next up, the team wants to work to improve the robustness of the technology, while finding even better ways of improving data efficiency — allowing them to train their neural network with less data.

Mobile

Midrange phones can’t do A.I., but MediaTek’s P90 chip aims to change that

MediaTek has announced the Helio P90 mobile processor, which it says will bring the best A.I. features we see on high-end smartphones, to the mid-range. We spoke to the company about the chip.
Emerging Tech

A lidar-equipped truck knows exactly how much de-icer to apply on roads

Lidar is best known as the laser-based technology that helps self-driving cars sense their surroundings. But the city of Knoxville has another, more seasonal use for it: De-icing roads.
Emerging Tech

An A.I. cracks the internet’s squiggly letter bot test in 0.5 seconds

How do you prove that you’re a human when communicating on the internet? The answer used to be by solving a CAPTCHA puzzle. But maybe not for too much longer. Here is the reason why.
Gaming

Not ready for the new 'Fortnite' winter wonderland? Here's our tourist guide

Fortnite season 7 has arrived with some chilly winter air and some pretty hefty changes to the Battle Royale map. We've got the full guide to all of the map changes, new locations, new terrain, and more, right here.
Emerging Tech

With this robotic garage, retrieving your car is like using a vending machine

Remembering where we parked our cars can be a real pain. But what if our cars came to find us, rather than the other way around? A new automated robot parking valet system aims to help.
Cars

Best Products of 2018

Our reception desk has so many brown boxes stacked up, it looks like a loading dock. We’re on a first-name basis with the UPS guy. We get new dishwashers more frequently than most people get new shoes. What we’re trying to say is: We…
Emerging Tech

This unusual nature-inspired robot is equally at home on land or in the water

This intriguing, nature-inspired robot may look unusual, but it's impressively capable of moving on both land and water without problem. Heck, it can even travel on ice if necessary.
Emerging Tech

This cryptocurrency wallet for kids isn’t nearly as stupid as it sounds

So you’ve taught your 6-year-old child to read, write, and play nice with others. What’s next? Give them a base understanding of cryptocurrency, of course. This Kickstarter aims to help.
Emerging Tech

Light, speed: Lighting kit for DJI Mavic 2 lets you fly and film in the dark

Lume Cube, maker of small battery-powered LED lights for mobile photography, has announced a new lighting kit built specifically for the DJI Mavic 2 -- the first of its kind. Already our favorite drone, this makes the Mavic 2 even better.
Emerging Tech

Prepare for liftoff: Here are all the important upcoming SpaceX rocket launches

From ISS resupply missions to a host of communication and scientific satellite launches, SpaceX has a busy year ahead. Here's a rundown of some of the company's most important missions slated for the next year.
Emerging Tech

Virgin Galactic’s latest test flight takes it to the edge of space

Sir Richard Branson's Virgin Galactic has successfully carried out its fourth powered flight in Mojave, California. It was the company's most ambitious test flight yet -- and bodes well for the future.
Emerging Tech

We’re going to the Red Planet! All the past, present, and future missions to Mars

SpaceX isn't the only organization pining to visit the Red Planet. Here's a detailed list of all operational and planned missions to Mars, along with explanations of their objectives, spacecraft details, and mission proposals.
Emerging Tech

There’s a giant EMP blaster in New Mexico. Don’t worry, it’s here to protect us

An electromagnetic pulse has the potential to disable virtually all electronics within a large area. To help protect against such a threat is a new, friendly EMP emitter. Here's how it works.
Emerging Tech

There’s a new lab-grown meat startup on the block — and it has a secret weapon

Aleph Farms is developing lab-grown steaks with the same flavor, shape, texture, and structure as the real thing using beef cells isolated from living cows. Coming soon to a store near you?