Who will be the George Lucas of VR? Film schools just started teaching it

Special effects pioneer Dennis Muren proclaimed the 1980 classic Star Wars: The Empire Strikes Back the hardest film he ever worked on, because “we had to train people to do work that we barely knew how to do.”

That’s a conundrum creative types face: How do you do what’s never been done? Star Wars creator George Lucas and the Industrial Light & Magic (ILM) team Muren worked with on the film ended up making their own machines and their own programming. Along the way they wrote the rules of special effects — rules that have been the DNA of almost every blockbuster film over the last forty years.

That’s why VR companies like Jaunt and Oculus are taking virtual reality to New York University and the University of Southern California, starting Master Classes and creating workshops: to write the rules of this new revolution in filmmaking.

“The concept of a VR lab started last summer, as we began planning on how we could work together,” Jaunt Studios President Cliff Plumer told me in an exclusive interview with Digital Trends. The Jaunt Cinematic Virtual Reality Lab, which will launch later this year, is the product of a rich history between USC School of Cinematic Arts (SCA), Lucasfilm, and its founder, alumni George Lucas. “A number of us at Jaunt who came from Lucasfilm have worked with Dean Daley and the USC Cinema School for many years,” Plumer said. The lab will be a three-year incubator at SCA where students can learn how to film for virtual reality, and try it out for themselves.

Oculus too will reach out to students, recently announcing plans to host a number of workshops including a Master Class event at NYU. According to Jonathan Weinstein, Professor at the Maurice Kanbar Institute of Film & Television at NYU’s Tisch School of the Arts, the partnership began when Oculus approached Tisch Chairman Joe Pichirallo in November about “setting something up so they can expose our filmmakers to their technology.” The class will be made up of 60 undergraduate students: 30 from the game design program and 30 from the film department. Oculus is also in talks to begin a similar Master Class at SCA, said Yelena Rachitsky, Creative Producer/Head of Education at Oculus Story Studio. The Oculus workshops at NYU and SCA will kick off February 13, with masterclasses to begin in April.

Digital Trends spoke with Plumer, Rachitsky, and Weinstein about the challenges of teaching a completely foreign format and why it’s imperative to begin early. The paths they followed may have been different, but both VR companies share the same motivation: to expand virtual reality’s reach by teaching it. That’s easier said than filmed.

Class is in session

If you’re envisioning rows of students strapped into VR headsets like a Morpheus-taught class in The Matrix, then the reality of teaching virtual reality may seem somewhat mundane. As part of the NYU and Oculus Master Classes, Oculus will bring in guest speakers to explain to the budding filmmakers how they made their own VR films. The company will set up four Oculus Rift headsets in the space as well, so students can experiment with the tech. Weinstein, instrumental in forming the class, offered this general rundown of class time:

“The structure of it will explore the technology in terms of viewership but also explore how to film, shoot, and light for a virtual story.”

“The structure of it will explore the technology in terms of viewership: the headset and how it feels to be immersed in a virtual world. But also explore how to film, shoot, and light for a virtual story. Also, with guest speakers, how to construct storylines knowing the viewer is immersed in the story almost as a character. That’s pretty much the structure of the day.”

The Jaunt Cinematic Virtual Reality Lab sounds more collaborative. It will be a three-year incubator at SCA where the company plans to “collaborate with the staff on introducing Jaunt technology and production techniques to the students.” The goal is to develop techniques, rules, and best practices that the film industry at large can adopt. Jaunt did not reveal the names of guest speakers, but Plumer did imply it would involve members of the University of Southern California faculty that Jaunt has worked with in the past on feature films.

Mike Woods, founder of White Rabbit VR (his LinkedIn profile reads “Game changing shizzle, coming soon”), and Christine Cattano, producer at creative studio Framestore, are possible guest speakers at Oculus’s NYU class, Weinstein said. Cattano worked on the Game of Thrones Ascend the Wall VR experience, in which people climb a 700-foot tall virtual wall from the HBO hit series.

The hardware

The team at ILM learned quickly that they would have to create new machines to achieve some lofty ideas. A visual computer came from that realization that could mix computer-generated images with live action sequences. That computer sprouted a production company that bore the same name: Pixar.

Oculus came to a similar creative block on the company’s third film, the surrealistic Dear Angelica. Instead of illustrator Wesley Allsbrook drawing the film flat on a computer screen, Oculus created Quill, an “internal drawing tool, so [Allsbrook] can actually create the set in VR that is native to that space,” Rachitsky said. She did not specify whether NYU students would be able to use Quill, but Oculus’s guest speakers will likely shed light on one of its most revolutionary VR filmmaking tools. “There’s currently not a ‘right way’ to do things, and there are so many different kinds of projects,” says Rachitsky. “There’s so many different approaches [that] there’s not yet one way to do it.”

Meanwhile, Jaunt calls its Jaunt ONE camera “the first professional-grade stereographic cinematic VR camera built from the ground up” on the company’s official website. So loaning a number of these one-of-a-kind cameras to film students should be like dropping a kid in a Willy Wonka chocolate factory.

The future of VR

At this point in embryonic phase of virtual reality filmmaking’s life, the greatest success could be  simply if people are interested in using it. Weinstein said he measures success in experimental programs by student interest. “If we have a student population interested in learning the technology and wants to dive into it, I think we respond to that and give them access to that.”

It took 32 minutes for the 60 seats in the class to fill, he said.

Plumer did not specify what Jaunt or SCA would need to see from the partnership in order to continue it past its designated three years. But Plumer attests that USC is just the first foray into education for the virtual reality company. “Jaunt will continue to look for additional centers of education” to help promote virtual reality filmmaking, he told me.

Virtual reality filmmaking is even starting to interest the elite filmmakers in Hollywood. On a panel at the 2016 Sundance Film Festival titled “Power of Story: The Art of Film,” Christopher Nolan stated that he’s open to filming in virtual reality. He even compared VR’s relationship with traditional filmmaking to video games. “It’ll be its own medium. I never get asked anymore, ‘do you think video games will kill movies?’ 10 years ago I was asked that all the time. They’re two different mediums.”

Weinstein agrees with the Academy Award-winning director, claiming virtual reality could be “similar to the way 3D coexists or how some movies are released in multiple formats.” But practical integration of virtual reality with traditional theater-going? That’s what the students of virtual reality need to figure out. “We all could be experiencing those headsets as a pair of Ray Ban sunglasses that have a reflective inner screen, and they’re not cumbersome.”

With the home of LucasFilm entering the virtual reality realm, it may only be a matter of time before the George Lucas of virtual reality graduates.

Emerging Tech

Nonny de la Peña wants to put virtual reality within Reach

Telling a story in VR can sometimes pack a punch regular films can’t. As a pioneer in immersive journalism, Nonny de la Peña wants to open that experience to everyone with her Reach platform.

Step into Childish Gambino’s musical universe with the Pharos AR app

Childish Gambino seems to be on a mission to take over everyone's smartphones. Now you can experience his musical and visual universe through his new Pharos AR app, available on both Android and iOS right now.
Movies & TV

Watch the Captain Marvel, other MCU post-credits scenes before Avengers: Endgame

Catch up on the Marvel Cinematic Universe's ongoing storyline before Avengers: Endgame's big finale by watching the post-credits scenes for every Marvel film, including Captain Marvel, via Twitter.
Emerging Tech

The oldest type of molecule in the universe has been located at last

A milestone in the development of the early universe was the combination of helium and hydrogen atoms into a molecule called helium hydride. But strangely enough, this ancient molecule has never been detected in space before now.
Emerging Tech

Yale scientists restore cellular activity in a pig’s brain hours after its death

In what some may view as a porcine version of Frankenstein, Yale University scientists have restored circulation and cellular activity in a pig’s brain four hours after its death. The study is likely to be used to study brain function
Virtual Reality

Valve Index VR headset revealed, more info coming in May

The Valve Index was teased, confirming rumors that the gaming company is working on its own virtual reality headset. More information about the Valve Index will be coming in May, which could also be the device's release date.

Valve may have accidentally leaked the ship date for its VR headset

Due to a mishap, we may have learned that this year will be the summer of Index. Valve published three Index store pages early and, while they featured mostly placeholder text, they revealed the 2019 ship date for the VR headset.

Take a trip to a new virtual world with one of these awesome HTC Vive games

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.

Immerse yourself in a new universe with these incredible PSVR games

The PSVR has surpassed expectations and along with it comes an incredible catalog of games. There's plenty of amazing experiences to be had so we've put together a list of the best PSVR games available today.

A Google patent hints at a new attempt at an augmented reality headset

Google may be working on another augmented reality headset. The company was awarded a patent for an augmented reality headset. Unfortunately, the patent isn't specific as to what the headset will look like.

Nintendo is bringing the latest Zelda and Mario games to its VR headset

The Nintendo Labo VR Kit launches this month and two of the Switch's biggest games, Super Mario Odyssey and Breath of the Wild, will get free VR support via an update that goes live a couple of weeks after the VR Kit launch.

Army uses modified Microsoft HoloLens 2 for ‘real-life game of Call of Duty’

The U.S. Army gave CNBC an exclusive look at its modified Microsoft HoloLens 2 augmented reality headset. The Integrated Visual Augmentation System, or IVAS, provides various functions for training and combat.

Dive headfirst into the best VR experiences available now on the Oculus Rift

The Oculus Rift brought back virtual reality and put a modern twist on it. Grab your Touch Controllers, put on your VR headset, and jump into the fun with some of the best Oculus Rift games available now.

Sony patent describes glasses with eye tracking for VR headsets

A patent from Sony shows off prescription glasses that feature eye-tracking capabilities for a virtual reality headset but deactivates the already-existing eye-tracking feature in the headset when it senses that the glasses are in use.