Who will be the George Lucas of VR? Film schools just started teaching it

Special effects pioneer Dennis Muren proclaimed the 1980 classic Star Wars: The Empire Strikes Back the hardest film he ever worked on, because “we had to train people to do work that we barely knew how to do.”

That’s a conundrum creative types face: How do you do what’s never been done? Star Wars creator George Lucas and the Industrial Light & Magic (ILM) team Muren worked with on the film ended up making their own machines and their own programming. Along the way they wrote the rules of special effects — rules that have been the DNA of almost every blockbuster film over the last forty years.

That’s why VR companies like Jaunt and Oculus are taking virtual reality to New York University and the University of Southern California, starting Master Classes and creating workshops: to write the rules of this new revolution in filmmaking.

“The concept of a VR lab started last summer, as we began planning on how we could work together,” Jaunt Studios President Cliff Plumer told me in an exclusive interview with Digital Trends. The Jaunt Cinematic Virtual Reality Lab, which will launch later this year, is the product of a rich history between USC School of Cinematic Arts (SCA), Lucasfilm, and its founder, alumni George Lucas. “A number of us at Jaunt who came from Lucasfilm have worked with Dean Daley and the USC Cinema School for many years,” Plumer said. The lab will be a three-year incubator at SCA where students can learn how to film for virtual reality, and try it out for themselves.

Oculus too will reach out to students, recently announcing plans to host a number of workshops including a Master Class event at NYU. According to Jonathan Weinstein, Professor at the Maurice Kanbar Institute of Film & Television at NYU’s Tisch School of the Arts, the partnership began when Oculus approached Tisch Chairman Joe Pichirallo in November about “setting something up so they can expose our filmmakers to their technology.” The class will be made up of 60 undergraduate students: 30 from the game design program and 30 from the film department. Oculus is also in talks to begin a similar Master Class at SCA, said Yelena Rachitsky, Creative Producer/Head of Education at Oculus Story Studio. The Oculus workshops at NYU and SCA will kick off February 13, with masterclasses to begin in April.

Digital Trends spoke with Plumer, Rachitsky, and Weinstein about the challenges of teaching a completely foreign format and why it’s imperative to begin early. The paths they followed may have been different, but both VR companies share the same motivation: to expand virtual reality’s reach by teaching it. That’s easier said than filmed.

Class is in session

If you’re envisioning rows of students strapped into VR headsets like a Morpheus-taught class in The Matrix, then the reality of teaching virtual reality may seem somewhat mundane. As part of the NYU and Oculus Master Classes, Oculus will bring in guest speakers to explain to the budding filmmakers how they made their own VR films. The company will set up four Oculus Rift headsets in the space as well, so students can experiment with the tech. Weinstein, instrumental in forming the class, offered this general rundown of class time:

“The structure of it will explore the technology in terms of viewership but also explore how to film, shoot, and light for a virtual story.”

“The structure of it will explore the technology in terms of viewership: the headset and how it feels to be immersed in a virtual world. But also explore how to film, shoot, and light for a virtual story. Also, with guest speakers, how to construct storylines knowing the viewer is immersed in the story almost as a character. That’s pretty much the structure of the day.”

The Jaunt Cinematic Virtual Reality Lab sounds more collaborative. It will be a three-year incubator at SCA where the company plans to “collaborate with the staff on introducing Jaunt technology and production techniques to the students.” The goal is to develop techniques, rules, and best practices that the film industry at large can adopt. Jaunt did not reveal the names of guest speakers, but Plumer did imply it would involve members of the University of Southern California faculty that Jaunt has worked with in the past on feature films.

Mike Woods, founder of White Rabbit VR (his LinkedIn profile reads “Game changing shizzle, coming soon”), and Christine Cattano, producer at creative studio Framestore, are possible guest speakers at Oculus’s NYU class, Weinstein said. Cattano worked on the Game of Thrones Ascend the Wall VR experience, in which people climb a 700-foot tall virtual wall from the HBO hit series.

The hardware

The team at ILM learned quickly that they would have to create new machines to achieve some lofty ideas. A visual computer came from that realization that could mix computer-generated images with live action sequences. That computer sprouted a production company that bore the same name: Pixar.

Oculus came to a similar creative block on the company’s third film, the surrealistic Dear Angelica. Instead of illustrator Wesley Allsbrook drawing the film flat on a computer screen, Oculus created Quill, an “internal drawing tool, so [Allsbrook] can actually create the set in VR that is native to that space,” Rachitsky said. She did not specify whether NYU students would be able to use Quill, but Oculus’s guest speakers will likely shed light on one of its most revolutionary VR filmmaking tools. “There’s currently not a ‘right way’ to do things, and there are so many different kinds of projects,” says Rachitsky. “There’s so many different approaches [that] there’s not yet one way to do it.”

Meanwhile, Jaunt calls its Jaunt ONE camera “the first professional-grade stereographic cinematic VR camera built from the ground up” on the company’s official website. So loaning a number of these one-of-a-kind cameras to film students should be like dropping a kid in a Willy Wonka chocolate factory.

The future of VR

At this point in embryonic phase of virtual reality filmmaking’s life, the greatest success could be  simply if people are interested in using it. Weinstein said he measures success in experimental programs by student interest. “If we have a student population interested in learning the technology and wants to dive into it, I think we respond to that and give them access to that.”

It took 32 minutes for the 60 seats in the class to fill, he said.

Plumer did not specify what Jaunt or SCA would need to see from the partnership in order to continue it past its designated three years. But Plumer attests that USC is just the first foray into education for the virtual reality company. “Jaunt will continue to look for additional centers of education” to help promote virtual reality filmmaking, he told me.

Virtual reality filmmaking is even starting to interest the elite filmmakers in Hollywood. On a panel at the 2016 Sundance Film Festival titled “Power of Story: The Art of Film,” Christopher Nolan stated that he’s open to filming in virtual reality. He even compared VR’s relationship with traditional filmmaking to video games. “It’ll be its own medium. I never get asked anymore, ‘do you think video games will kill movies?’ 10 years ago I was asked that all the time. They’re two different mediums.”

Weinstein agrees with the Academy Award-winning director, claiming virtual reality could be “similar to the way 3D coexists or how some movies are released in multiple formats.” But practical integration of virtual reality with traditional theater-going? That’s what the students of virtual reality need to figure out. “We all could be experiencing those headsets as a pair of Ray Ban sunglasses that have a reflective inner screen, and they’re not cumbersome.”

With the home of LucasFilm entering the virtual reality realm, it may only be a matter of time before the George Lucas of virtual reality graduates.


These shoes let me stroll through ‘Skyrim,’ and I desperately want to go back

After being funded in just two hours on Kickstarter back in October 2018, Cybershoes has earned itself a place among the coolest VR walking and running tech. At CES 2019, we got to try them out and they live up to the hype.
Emerging Tech

DeepSqueak is a machine learning A.I. that reveals what rats are chatting about

Want to know what rats are squeaking about? You'd better check out DeepSqueak, the new deep learning artificial intelligence developed by researchers at the University of Washington.
Emerging Tech

NASA to launch SPHEREx mission to investigate the origins of our universe

NASA is launching an ambitious mission to map the entire sky to understand the origins of the universe. The Spectro-Photometer for the History of the Universe, Epoch of Reionization and Ices Explorer (SPHEREx) mission will launch in 2023.
Emerging Tech

China’s mind-controlled cyborg rats are proof we live in a cyberpunk dystopia

Neuroscience researchers from Zhejiang University, China, have created a method that allows humans to control the movements of rats using a technology called a brain-brain interface.
Emerging Tech

Photosynthesizing artificial leaf may be the air-cleaning tool we’ve dreamed of

Engineers from the University of Illinois at Chicago have invented an artificial leaf which could both clean up our air and provide a cost-effective type of fuel. Here's how it works.

These are the coolest virtual and augmented reality gadgets from CES 2019

CES 2019 had plenty of VR and AR gadgets on display, including headsets that completely change how you experience virtual reality, and some that don't even require a PC or a phone to run.

The Teslasuit could turn Black Mirror’s terrifying ‘Playtest’ into a reality

We spoke with Teslasuit co-founder Dimitri Mikhalchuk about VR gaming at CES 2019. With all its features, the future of the Teslasuit and virtual reality look bright. And it also sounds a bit like a Black Mirror episode.

Could the next Microsoft HoloLens be announced at MWC 2019?

After not having a presence at Mobile World Congress for three years, Microsoft is now sending out media invites for a press conference on February 24 during the annual event in Barcelona. Could a next-generation HoloLens be on the way?

Immerse yourself in a new universe with these incredible PSVR games

The PSVR has surpassed expectations and along with it comes an incredible catalog of games. There's plenty of amazing experiences to be had so we've put together a list of the best PSVR games available today.

Take a trip to a new virtual world with one of these awesome HTC Vive games

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.
Virtual Reality

Is the Vive Pro better than the original Vive? Our answer might surprise you

HTC Vive vs. Vive Pro, which comes out on top? That's the subject of our latest comparison, which looks at everything from tracking solutions, to controllers, and the brand new headset that could set a new standard for VR.

Samsung files a VR patent featuring a curved OLED display

Doubling down on its emphasis on curved displays, Samsung recently filed a design patent for a new virtual reality headset that could feature a curved OLED display, which would be an interesting development in VR.

Bringing realism to VR is complex, but these developers found a way in holograms

Making virtual reality feel real is the hardest job of all VR developers. For Awake: Episode One, StartVR used volumetric recording, rather than motion capture, to bring its characters to life like never before.