Skip to main content

Inside the lab that’s bringing Darth Vader, X-Wings, and C-3PO to life in VR

Anyone who owns an HTC Vive can get a short teaser of what the digital wizards at ILMxLab are up to at the Letterman Digital Arts Center in San Francisco.

Star Wars: Trials on Tatooine is a 5-minute long virtual reality experience that lets you star in an original Star Wars story alongside R2-D2, the Millennium Falcon (with Han Solo communicating with you from the cockpit), and your very own light saber from Luke Skywalker. It’s available for free download, and stands out as one of the most impressive VR experiences out there today.

Recommended Videos

“Most of the work that we’re doing at ILMxLab is really around looking at longer experiences now,” Rob Bredow, chief technology officer at Lucasfilm, told Digital Trends before his talk at the VIEW Conference in Turin, Italy. “Trials on Tatooine is really just a bite-sized experiment and it was designed to be three to five minutes. You can stay in there as long as seven or eight if you really take the time, but it’s a relatively short experience.”

“We’re doing a VR experience that’s going to feature Vader, and that’s not just a little bite-sized experience.”

Next up for ILMxLab is a longer experience that’ll include more storytelling, and star one of the best-known characters in the Star Wars universe. Darth Vader.

“We’re doing a VR experience that’s going to feature Vader, and that’s not just a little bite-sized experience,” Bredow said. “It’s designed to be very much more involved. And the ergonomics are getting better as time goes on, and we’re looking at an audience that’s getting more acclimated to experiencing things in VR. We’ll see as the year plays out how people adapt to those longer experiences, and how people enjoy those longer experiences, but we’re pretty optimistic.”

Bredow knows firsthand how easy it is to lose oneself in an immersive VR environment. He said he can easily spend half an hour in Tilt Brush on HTC Vive making something, without even realizing what time it is.

The future of storytelling

ILMxLab, which is comprised of talent from Lucasfilm, ILM, LucasArts, and Skywalker Sound, is focused on developing, creating, and releasing story-based immersive entertainment for virtual reality (VR), augmented reality (AR), and mixed reality platforms.

“We formed this development group at Lucasfilm to be able to maintain some of the amazing talent from LucasArts, who have made some of the most innovative games for many years — and games that I was a fan of for many years, and a whole bunch of new talent that’s come in to really help augment our creative and our engineering teams to work on virtual reality, mixed reality, and augmented reality at ILMxLab,” Bredow said.

In addition to developing the Vader VR experience, Bredow’s team has worked with Electronic Arts and developer DICE on the upcoming Star Wars Battlefront Rogue One: X-Wing VR Mission for PlayStation VR.

“We share assets back and forth,” Bredow said. “If you look at some of the stuff that DICE has shared at technical conferences like SIGGRAPH, you’ll notice a lot of familiar things. You’ll notice the materials are happening on the same kind of turntables that Industrial Light & Magic does their turntables on, and that’s not by accident. It was because of a very close collaboration and a real mutual interest. We love the work they’re doing.”

Star Wars is about conflict, but collaboration is key

Bredow said his team is most interested in creating high fidelity experiences that are going to put users in a world that they want to visit, whether that’s Star Wars, or a world from one of ILM’s partner studios. Given that ILM works with most big Hollywood projects, that provides plenty of chance for collaboration.

“There are all these fresh new challenges for us in virtual reality.”

“Everybody is in this field right now, and it’s really great. It feels like the early days of computer graphics, when everything was really tricky…like how are we going to calculate that shadow when we only have half a millisecond to get that done? There are all these fresh new challenges for us in virtual reality.”

With every new experiment comes new learnings, including hundreds, if not thousands, of things out of Trials of Tatooine. Skywalker Sound works hand-in-hand with ILMxLab, which means all the real sound effects from the Star Wars movies are used for the VR experience.

The next challenge for the ILMxLab team is bringing Vader’s pronounced breathing into the 360-degree sound environments that virtual reality platforms utilize. Even in Trials on Tatooine, which features lightsaber gameplay against squads of incoming storm troopers, audio plays an important role in directing the action within a VR story.

Using VR to see the future of film

ILMxLab technology is also helping filmmakers like Gareth Edwards bring Rogue One to life. He used virtual reality to set up shots and explore sets before they were built, and in some cases step into environments that would only exist virtually through the magic of computer effects. VR is now being used in production of all the Star Wars films.

In San Francisco, ILMxLab has created the xDeck, which can create immersive environments by projecting 3D pixels on multiple walls. Think of it as a modern-day HoloDeck. This allows multiple people to step into the room and see what a set, or new character, or ship looks like. A similar DISH technology is used by Walt Disney Imagineering at their Los Angeles headquarters and at Walt Disney World in Orlando that’s helping Imagineers build new Star Wars attractions, rides and restaurants for the upcoming Star Wars lands at Disneyland and Disney World. ILMxLab is collaborating with these teams on those projects, as well.

ILMxLab is looking to the future — approximately three years forward, says Bredow — so that Lucasfilm and other ILM client companies can immerse users in VR, AR and mixed reality experiences that blend the best of the video game world and traditional filmmaking. While Bredow can’t predict exactly what the world will look like in three years, he does believe that we’re at the dawn of a new type of storytelling. And the team at ILMxLab hopes to be ahead of the curve as the entertainment world evolves.

John Gaudiosi
Former Digital Trends Contributor
John Gaudiosi has been covering video games for over 25 years, dating back to his work for The Washington Post while in…
High-Tech, High-End: Must-Have Luxury Tech Gadgets to Gift This Holiday
Level Up Their Tech, But Make It Luxe
luxury tech gadgets best gifts

Luxury tech gifts are the ultimate way to impress. Combining innovation, practicality, and indulgence, they can also be thoughtful, if not showstopping. This year, we’ve curated an extraordinary selection of luxury tech gadgets and devices that deliver cutting-edge tech while adding a touch of luxe to everyday life. They're not just tools -- they're experiences designed to elevate and inspire your gift recipient’s life.

Whether you’re shopping for a coffee connoisseur, a fitness enthusiast, or the ultimate tech junkie, there’s a luxury tech gadget on our list for anyone you're shopping for. Imagine gifting the sleek Terra Kaffe for barista-quality drinks at home or the Meta Quest 3S for immersive virtual adventures. For the audiophile, Focal’s high-fidelity headphones redefine sound quality, while the Hydrow Core Rower offers an immersive fitness adventure like no other. Even cat parents and homebodies can indulge in next-level convenience with the Litter-Robot 4 or Shark PowerDetect vacuum.

Read more
The Lenovo Legion 5i with RTX 4060 is 37% off for Cyber Week
The Lenovo Legion 5i laptop with the Legion logo on the screen.

Often the home of great gaming laptop deals, Lenovo has a particularly great one for anyone keen to game in style this holiday season. Today, you can buy the Lenovo Legion 5i with a 16-inch screen for just $1,121, meaning you’re saving 37% or $669 off the regular price. It's a hefty price cut, but it’s worth remembering that Lenovo’s estimated value system means that sometimes the original price is optimistically high. But the discounted price is still great either way. One of the better laptop deals around, the Lenovo Legion 5i looks great and packs plenty of punch for the price. Here’s why you’ll want it.

Why you should buy the Lenovo Legion 5i
Lenovo is one of the best gaming laptop brands around and my personal favorite of the bunch. Having owned an older Lenovo Legion laptop for a number of years, I’d happily recommend the range for anyone seeking a reliable gaming laptop. With the Lenovo Legion 5i, you get a great upgrade to my four-year-old Lenovo Legion. It has a 14th-generation Intel Core i7-14650HX CPU and it’s teamed up with 16GB of RAM and 1TB of SSD storage. The highlight here is its Nvidia GeForce RTX 4060 graphics card with 8GB of dedicated VRAM. It’s the best graphics card in this price range dodging the downfall of the weaker 4050 GPU.

Read more
Experiment showcases 3D dental scanner capable of running Counter-Strike: Source
Counter Strike: Source running on a 3D dental scanner

One would assume that medical equipment is not as capable as a modern PC. However, in a surprising and creative tech experiment, Redditor u/AfternoonPutrid8558 demonstrated how Counter-Strike: Source could be played on a 3D dental scanner. The system, equipped with an old Intel processor and AMD GPU, proved surprisingly capable of running the popular first-person shooter at an impressive 600 to 700 frames per second (fps).

The post has gained a bit of attention on the r/pcmasterrace subreddit, highlighting the creative potential of reusing older hardware for gaming. The tech enthusiast repurposed the dental scanner’s hardware, which featured an older 5th-gen Intel Core i7-5720K and an MSI Raider X99 motherboard running at 3.3GHz with 32GB of DDR4-2999 RAM.

Read more