Audi’s VR-based in-car entertainment turns your car into a spaceship

Audi has harnessed the power of virtual reality (VR) to make a significant breakthrough in in-car entertainment. Working jointly with Disney, it synced the forward, backward, and lateral movements of a car with a VR-based video game to turn a run-of-the-mill ride to the grocery store into an immersive experience for the rear passengers. The company demonstrated a close-to-production version of its Audi Experience Ride technology on the sidelines of CES 2019, and Digital Trends was among the first to experience it first-hand.

The technology — which is marketed as a completely new form of entertainment — was developed by Holoride, a start-up that Audi co-founded and holds a stake in. It’s simple on paper, and yet it took four years to develop. At its core, Audi Experience Ride gathers basic, anonymous data about the car and its surroundings. It records the car’s steering angle, whether it’s accelerating or braking, the g forces going through the cabin, and GPS information.

Gathering this data requires no additional sensors; nearly every modern luxury car is already fitted with the required equipment. The data gets woven into the fabric of a VR-based video game to create an experience that’s both realistic and engaging.

Digital Trends participated in a demo of Audi Experience Drive at the Speed Vegas race track south of Las Vegas. We jumped in the back seat of an E-Tron, the firm’s newly-unveiled electric crossover, put on standard Oculus Rift VR glasses with integrated microphones, picked up a Nunchuck-like remote, and waited for our turn without the slightest idea of what to expect.

When our driver received the green light, the E-Tron took off with the silence and smoothness you expect from an electric car. He accelerated, braked, negotiated tight and wide turns, and hit speeds of up to 90 mph on the straight part of the track.

Audi Holoride experience

We may as well have been on a different planet.

We were immersed in outer space, where we helped Rocket Racoon and Iron Man blast asteroids into pieces while shooting lasers at attacking alien enemies. We ultimately destroyed their mothership. The three of us saved the galaxy, and we had a blast — if you’ll pardon our pun — doing it.

We were surprised at how accurately the car’s motions were mimicked by the game. It almost felt like being on a roller coaster that took us through a virtual world. When the E-Tron turned relatively slowly, our spaceship turned at the same angle, and with the same intensity. When the E-Tron made a sharp or sudden turn, the spaceship veered into a turn like a fighter jet on a critical mission. We felt the car’s braking and acceleration in the game, too. We didn’t get car-sick, but one of our colleagues admitted to feeling a little bit queasy after a five-minute ride.

Audi teamed up with Disney and Interactive Experiences to design the Marvel’s Avengers: Rocket’s Rescue Run game specifically for the CES demo we experienced. Holoride stresses it sees the technology as a blank canvas, a new platform that will hopefully inspire developers new and old to create more games. During the demonstration, we imagined how cool being immersed in a Mario-themed world would be. Audi Experience Ride would work exceptionally well with a game like Pokemon Go, too.

It’s not just about gaming. Nils Wollny, Audi’s head of digital business and the future CEO of Holoride, told Digital Trends the technology can be used for educational purposes. It can, for example, take students on a trip through the human body to learn about anatomy, or on a trip through time to see what living in Ancient Greece was like. Marine biologists can explore the murky depths of the ocean floor, botanists can take a trip through the jungle, and archaeologists can hang out with pharaohs. As of 2019 you have to be a passenger to experience Audi Experience Ride, but autonomous driving technology will create new possibilities in the coming years.

The more connected a car is, the more features Holoride can integrate into its VR technology. Wollny hinted he’d like to integrate traffic lights into the system. The technology would know the car is stopped at a light for 25 seconds, for example, and generate content accordingly.

Though Audi is playing a sizable role in bringing this technology to the market, Wollny told Digital Trends that Holoride plans to make the platform available to all carmakers and content developers. The technology is tentatively scheduled to hit the market in late 2020 or early 2021, he added. Pricing information hasn’t been announced yet.


Can electric motors finally make three-wheeled cars great?

Every few years, someone tries to sell a three-wheeled vehicle to Americans. Historically, it hasn’t gone very well. We’ve got our suspicions about why people don’t buy trikes, and they boil down to this: a trike is just not a real…

Lyft and Aptiv’s self-driving car program has come a long way (but not far enough)

Many companies talk about self-driving cars, but Lyft and Aptiv are already using a fleet of them to transport paying customers in Las Vegas. Hop in for a close look at the tech of autonomous cars, and the challenges they face.

Muscle cars, trucks, and EVs roared into the subdued 2019 Detroit Auto Show

The 2019 Detroit Auto Show was the quietest edition of the event in recent memory, but that doesn't mean nothing significant happened inside the Cobo Center. Here are the new cars and concepts we saw at the show.

Cadillac is finally ready to take on Tesla with its own electric car

At the 2019 Detroit Auto Show, Cadillac announced plans for its first electric car. The unnamed model will be a crossover, based on a new platform to be shared with other General Motors brands.

Ford has a plan to future-proof the hot-selling F-150 pickup truck

Worried about the threat of rising gas prices, Ford will add the F-150 to its growing portfolio of electrified vehicles. It is currently developing a hybrid F-150, and it will release an electric version of the next-generation truck.

Ford’s Mustang-inspired electric crossover will spawn a Lincoln luxury version

Lincoln will get its own version of parent Ford's first mass-market, long-range electric vehicle. While Ford's version will have styling inspired by the Mustang, Lincoln will take a more traditional approach.

Driving Daimler’s 40-ton eCascadia big rig isn’t just fun, it’s electrifying

Daimler Trucks brought its all-electric eCascadia semi-truck to the 2019 CES, and invited us to take the wheel. What does it feel like to drive one? Simply electrifying, of course.
Home Theater

Spotify adds simplified Car View mode for Android users

What was once just a test is now a reality: Spotify is rolling out a new, simplified in-car user interface for all Android users called Car View, which automatically engages when the app detects a car Bluetooth connection.

Boutique carmaker Karma Automotive, legendary design firm Pininfarina team up

Karma Automotive is partnering with legendary Italian design firm Pininfarina on future luxury cars. The first product of that partnership will appear later this year, Karma said, without offering other details.

Sibling rivalry: 2019 BMW Z4 takes on the 2020 Toyota Supra

BMW and Toyota forged an unlikely partnership when they set out to build a sports car platform together. Here, we examine the similarities and differences between the 2019 Z4 and the 2020 Supra.

Tesla cuts workforce by 7 percent, ends referral program to trim costs

Tesla has announced plans to trim its workforce by seven percent, and it will end the referral program that rewards customers who help it sell cars. These measures are ways to cut costs and boost profits.

Worried about commuting in winter weather? Nissan has the answer

The Nissan Altima midsize sedan is now available with all-wheel drive. To advertise that fact, Nissan's Canadian division slapped some tank-like tracks on an Altima to create a one-off show car.
Emerging Tech

Too buzzed to drive? Don’t worry — this autonomous car-bar will drive to you

It might just be the best or worst idea that we've ever heard: A self-driving robot bartender you can summon with an app, which promises to mix you the perfect drink wherever you happen to be.

Michigan OKs digital license plates with Rplate’s connected car platform

The state of Michigan approved the use of digital license plates on motor vehicles registered in the state. Reviver Auto, the manufacturer of the Rplate connected car platform, worked with Michigan's Department of State to pass the bill.