Skip to main content

Who will be the George Lucas of VR? Film schools just started teaching it

Special effects pioneer Dennis Muren proclaimed the 1980 classic Star Wars: The Empire Strikes Back the hardest film he ever worked on, because “we had to train people to do work that we barely knew how to do.”

That’s a conundrum creative types face: How do you do what’s never been done? Star Wars creator George Lucas and the Industrial Light & Magic (ILM) team Muren worked with on the film ended up making their own machines and their own programming. Along the way they wrote the rules of special effects — rules that have been the DNA of almost every blockbuster film over the last forty years.

Related Videos

That’s why VR companies like Jaunt and Oculus are taking virtual reality to New York University and the University of Southern California, starting Master Classes and creating workshops: to write the rules of this new revolution in filmmaking.

“The concept of a VR lab started last summer, as we began planning on how we could work together,” Jaunt Studios President Cliff Plumer told me in an exclusive interview with Digital Trends. The Jaunt Cinematic Virtual Reality Lab, which will launch later this year, is the product of a rich history between USC School of Cinematic Arts (SCA), Lucasfilm, and its founder, alumni George Lucas. “A number of us at Jaunt who came from Lucasfilm have worked with Dean Daley and the USC Cinema School for many years,” Plumer said. The lab will be a three-year incubator at SCA where students can learn how to film for virtual reality, and try it out for themselves.

Oculus too will reach out to students, recently announcing plans to host a number of workshops including a Master Class event at NYU. According to Jonathan Weinstein, Professor at the Maurice Kanbar Institute of Film & Television at NYU’s Tisch School of the Arts, the partnership began when Oculus approached Tisch Chairman Joe Pichirallo in November about “setting something up so they can expose our filmmakers to their technology.” The class will be made up of 60 undergraduate students: 30 from the game design program and 30 from the film department. Oculus is also in talks to begin a similar Master Class at SCA, said Yelena Rachitsky, Creative Producer/Head of Education at Oculus Story Studio. The Oculus workshops at NYU and SCA will kick off February 13, with masterclasses to begin in April.

Digital Trends spoke with Plumer, Rachitsky, and Weinstein about the challenges of teaching a completely foreign format and why it’s imperative to begin early. The paths they followed may have been different, but both VR companies share the same motivation: to expand virtual reality’s reach by teaching it. That’s easier said than filmed.

Class is in session

If you’re envisioning rows of students strapped into VR headsets like a Morpheus-taught class in The Matrix, then the reality of teaching virtual reality may seem somewhat mundane. As part of the NYU and Oculus Master Classes, Oculus will bring in guest speakers to explain to the budding filmmakers how they made their own VR films. The company will set up four Oculus Rift headsets in the space as well, so students can experiment with the tech. Weinstein, instrumental in forming the class, offered this general rundown of class time:

“The structure of it will explore the technology in terms of viewership but also explore how to film, shoot, and light for a virtual story.”

“The structure of it will explore the technology in terms of viewership: the headset and how it feels to be immersed in a virtual world. But also explore how to film, shoot, and light for a virtual story. Also, with guest speakers, how to construct storylines knowing the viewer is immersed in the story almost as a character. That’s pretty much the structure of the day.”

The Jaunt Cinematic Virtual Reality Lab sounds more collaborative. It will be a three-year incubator at SCA where the company plans to “collaborate with the staff on introducing Jaunt technology and production techniques to the students.” The goal is to develop techniques, rules, and best practices that the film industry at large can adopt. Jaunt did not reveal the names of guest speakers, but Plumer did imply it would involve members of the University of Southern California faculty that Jaunt has worked with in the past on feature films.

Mike Woods, founder of White Rabbit VR (his LinkedIn profile reads “Game changing shizzle, coming soon”), and Christine Cattano, producer at creative studio Framestore, are possible guest speakers at Oculus’s NYU class, Weinstein said. Cattano worked on the Game of Thrones Ascend the Wall VR experience, in which people climb a 700-foot tall virtual wall from the HBO hit series.

The hardware

The team at ILM learned quickly that they would have to create new machines to achieve some lofty ideas. A visual computer came from that realization that could mix computer-generated images with live action sequences. That computer sprouted a production company that bore the same name: Pixar.

Oculus came to a similar creative block on the company’s third film, the surrealistic Dear Angelica. Instead of illustrator Wesley Allsbrook drawing the film flat on a computer screen, Oculus created Quill, an “internal drawing tool, so [Allsbrook] can actually create the set in VR that is native to that space,” Rachitsky said. She did not specify whether NYU students would be able to use Quill, but Oculus’s guest speakers will likely shed light on one of its most revolutionary VR filmmaking tools. “There’s currently not a ‘right way’ to do things, and there are so many different kinds of projects,” says Rachitsky. “There’s so many different approaches [that] there’s not yet one way to do it.”

Meanwhile, Jaunt calls its Jaunt ONE camera “the first professional-grade stereographic cinematic VR camera built from the ground up” on the company’s official website. So loaning a number of these one-of-a-kind cameras to film students should be like dropping a kid in a Willy Wonka chocolate factory.

The future of VR

At this point in embryonic phase of virtual reality filmmaking’s life, the greatest success could be  simply if people are interested in using it. Weinstein said he measures success in experimental programs by student interest. “If we have a student population interested in learning the technology and wants to dive into it, I think we respond to that and give them access to that.”

It took 32 minutes for the 60 seats in the class to fill, he said.

Plumer did not specify what Jaunt or SCA would need to see from the partnership in order to continue it past its designated three years. But Plumer attests that USC is just the first foray into education for the virtual reality company. “Jaunt will continue to look for additional centers of education” to help promote virtual reality filmmaking, he told me.

Virtual reality filmmaking is even starting to interest the elite filmmakers in Hollywood. On a panel at the 2016 Sundance Film Festival titled “Power of Story: The Art of Film,” Christopher Nolan stated that he’s open to filming in virtual reality. He even compared VR’s relationship with traditional filmmaking to video games. “It’ll be its own medium. I never get asked anymore, ‘do you think video games will kill movies?’ 10 years ago I was asked that all the time. They’re two different mediums.”

Weinstein agrees with the Academy Award-winning director, claiming virtual reality could be “similar to the way 3D coexists or how some movies are released in multiple formats.” But practical integration of virtual reality with traditional theater-going? That’s what the students of virtual reality need to figure out. “We all could be experiencing those headsets as a pair of Ray Ban sunglasses that have a reflective inner screen, and they’re not cumbersome.”

With the home of LucasFilm entering the virtual reality realm, it may only be a matter of time before the George Lucas of virtual reality graduates.

Editors' Recommendations

One of Lenovo’s best Chromebooks is turning to Windows
Lenovo IdeaPad Duet 2-in-1 Chromebook.

Lenovo is updating it's popular IdeaPad Duet 3, which sits among the best Chromebooks on the market, at Mobile World Congress in Barcelona. This time around, the Duet 3i is coming with Windows 11 instead of ChromeOS, along with some updates to the case and components.

The IdeaPad Duet 3i is a lightweight, productivity-focused laptop featuring the Intel Processor N200 with Intel's integrated graphics, 4GB and 8GB memory options, and 128GB and 256GB M.2 PCIe SSD storage options. It runs the Windows 11 operating system. The touchscreen laptop is 10.68 x 6.77 x 0.35 inches overall; however, it is detachable from its keyboard, making it versatile as a smaller and more portable tablet. Software-wise, the device adapts quickly from laptop to tablet to pen mode to help not impede workflow. You can also purchase a Lenovo Digital Pen for writing purposes.

Read more
Lenovo’s latest ThinkPad Z13 includes a lid made entirely of flaxseeds
The side profile of the ThinkPad Z13.

Lenovo unveiled more ThinkPads at Mobile World Congress 2023 (MWC) than you can shake a stick at. From progressive updates to contemporary redesigns, it seems like there's something for everyone. One particular model stood out, though -- the updated ThinkPad Z13 with a lid covered in flaxseeds.

At MWC in Barcelona, Lenovo makes a big splash by announcing changes to pretty much its entire ThinkPad laptop portfolio, from the latest hardware upgrades to increased use of sustainable materials. Here's the lowdown.

Read more
This major Apple bug could let hackers steal your photos and wipe your device
A physical lock placed on a keyboard to represent a locked keyboard.

Apple’s macOS and iOS are often considered to be more secure than their rivals, but that doesn’t make them invulnerable. One security team recently proved that by showing how hackers could exploit Apple’s systems to access your messages, location data, and photos -- and even wipe your device entirely.

The discoveries were published on the blog of security research firm Trellix, and will be of major concern to iOS and macOS users alike, since the vulnerabilities can be exploited on both operating systems. Trellix explains that Apple patched the exploits in macOS 13.2 and iOS 16.3, which were released in January 2023, so you should update your devices as soon as you can.

Read more