How HBO created a Westworld VR experience that lets you step into the show

HBO’s Westworld is averaging a gross audience of 11.7 million viewers, outperforming Game of Thrones and True Detective during similar points in their debut seasons.

So, it’s no surprise the network has greenlit a second season of the sci-fi Western, which was initially inspired by Michael Crichton’s original film.

For serious fans, however, there’s another way to experience the Westworld universe. HBO’s new internal virtual reality division spent the past year working with Westworld creators Jonah Nolan and Lisa Joy to create an exclusive HTC Vive virtual reality experience, one that transported fans at this year’s TechCrunch Disrupt and New York Comic Con conferences right into the virtual version of the park. And this is just the beginning of HBO’s focus on exploring virtual reality, augmented reality, and mixed reality experiences.

Ryan Wilkerson, vice president of experience design at HBO, said the company actually began its VR journey five years ago, long before the Vive was even announced.

“We recognized the role that technology was going to play for our service and how we tell stories,” Wilkerson told Digital Trends. “As a result, we made the decision to make a substantial human capital investment by assembling a best-in-class technology team. The members of this team come to us from the tech, gaming, and digital/streaming services industries. They not only have exceptional technical aptitude and talent, but also experience in working side-by-side with creatives to help empower their voice.”

“What better way to love our shows than to be immersed in them?”

The company’s first foray into virtual reality was through an external partnership with Framestore VR Studio and Relevant, which created the Game of Thrones: Ascend the Wall experience that debuted in 2014 and has toured the globe. Wilkerson explained how the “4D experience,” which included a rumble plate, was evidence of how a physical experience could play a critical role in the illusion of presence.

“It did a great job with pacing, and transporting people into a world that is familiar from the show, and inevitably leading you towards an emotional (and sometimes physical) reaction,” Wilkerson said. “The experience was well received, and judging from lines that people were willing to wait on, showed us that there is some real desire to experience stories this way.”

HBO has since invested heavily in its VR division, which is spread across multiple teams in three locales, comprising artists, sound designers, UX designers, and engineers with backgrounds in high-end gaming. The developers work closely with HBO creative and programming execs, as well as the social media and marketing teams.

“Virtual reality has the promise to really deliver on creating a special experience for storytelling, ones that the creative teams we work with can use in a unique and compelling way,” Wilkerson said. “It is early days in its evolution right now; for us it’s about experimenting and figuring out how creative and tech teams work together to utilize this medium in the best way possible.”

Admission to Westworld

When HBO’s VR team set out to develop this particular experience with the Westworld creative team, Wilkerson knew it was going to be a very special collaboration, bridging real-time CG, live-action 360 video, and location-based environmental design. The experience runs on Epic Games’ Unreal Engine 4, which also powers popular video games like The Coalition’s Gears of War 4 and virtual reality experiences like Phosphor Games’ The Brookhaven Experiment.

In the year leading up to this project, the team was focused on R&D for all aspects of VR technology, including runtime engines, real time character performance, 360 video cameras, and content pipelines.


“After meeting with Jonah and Lisa, it was clear that we had a chance to leverage a lot of that R&D experience for a really ambitious project,” Wilkerson said. “Our primary goal was to maximize the technology in order to enable Jonah and Lisa’s vision for the experience — they had new and challenging ideas that we really wanted to bring to life. Our second goal was to learn as much as possible and apply that knowledge to our further projects.”

The virtual reality production ran parallel to the series’ live action shoot, which allowed the tech team to shoot on set at Melody Ranch with Westworld and Breaking Bad director Michelle MacLaren directing the original VR story. Nolan and Fox were involved in the initial brainstorming sessions and the series’ writing team helped set the direction for the narrative arc.

“You can be a hero or a villain, but you’re also a part of our story, in a way that hasn’t been done before.”

“There was good back-and-forth during this phase, regarding what was possible on the platform, and how this could best support the narrative,” Wilkerson said. “Rough cuts of CG and footage were gradually integrated into the build, which allowed us to evaluate pacing and continuity.”

The end result is an experience that tells an original story, while allowing you to step into the Westworld theme park, complete with choosing a gun and ammo before being transported into the Wild West. Of course, this being Westworld, there are glitches that occur, but we won’t ruin the experience for fans who have yet to try it. Suffice it to say, key locations both in the park and behind-the-scenes play a role in the room-scale virtual reality experience that includes physical props. The player is also able to make choices that will impact the experience.

“Given that it’s meant to be viewed in conjunction with a physical environment, our focus was on making it a unique and compelling experience, regardless of replay value,” Wilkerson said. “In the end, we struck a balance that we’re really happy with; you can be a hero or a villain, but you’re also a part of our story in a way that hasn’t quite been done before.”

Just the beginning

“We think there are benefits to both 360 video and real-time CG virtual reality, and were happy to marry them together in the Westworld experience,” Wilkerson explained. “That said, the sense of personal agency and ability to affect the world were integral to the idea of fantasy fulfillment in Westworld. From our first days experiencing the proto-Vive demo at Valve Software’s offices, we knew we wanted to make use of room scale presence and controller input. The technology and our experience lined up perfectly to make this happen.”

Given the internal investment HBO has made in VR, the Westworld experience serves as a stepping stone for the company. Wilkerson said HBO will always explore the art of the possible, and VR is a natural part of that journey.“VR and mixed reality development is moving so incredibly fast, it’s exciting to see the medium gaining more and more mainstream adoption,” Wilkerson said. “We recently announced, at Google IO 2016, HBO’s presence on the Google Daydream platform, and are hard at work to bring our apps and content to audiences this winter. Of course these are early days, but we have long-term plans for VR so HBO fans should definitely stay tuned to see how this evolves over time to become more and more immersive.”

HBO, and companies like it, will increasingly have a growing new audience to connect with. In addition to Google Daydream, Sony has launched its own PlayStation VR, while Oculus Rift and Vive continue to target the more hardcore PC enthusiasts.

“VR can be such a powerful tool in a creative’s hands, enabling a different axis of storytelling”

The VR experiences will continue to go hand-in-hand with HBO’s overall programming vision, which strives not to “make shows that everybody likes, but rather to make shows that somebody loves,” as Wilkerson put it.

“This resonates with us as we explore VR, as it has the potential to add another dimension to our original programming,” Wilkerson added. “What better way to love our shows than to be immersed in them? Certainly it’s not a fit for every show, but for those in which it works, it adds a compelling layer to story and world-building.”

In addition, Wilkerson said, VR allows producers, writers, and directors to explore stories in a special way. “VR can be such a powerful tool in a creative’s hands, enabling a different axis of storytelling that’s great fun to explore and experience, for both creator and audience.”

With a growing base of VR headsets across mobile, PC, and gaming consoles, it shouldn’t be long before fans will be able to step inside HBO’s many universes in brand new ways.

Product Review

Step aside, Sonos: Riva's Concert is the best smart speaker you can buy

The Riva Concert series speaker is a fantastic, small-profile smart speaker with Alexa integration, truly excellent sound, and great looks, making it the perfect addition to your kitchen, living room, or bedroom.
Home Theater

Kill your cable and switch to streaming with our painless guide

If you're going to quit cable or satellite for a streaming TV solution, you're going to want to get it right the first time. We've outlined exactly how to get started, step by step. Follow our lead, and you'll never look back.

Tesla could show the electric pickup Elon Musk is dying to build in 2019

Tesla has started designing its long-promised pickup truck. The yet-unnamed model will come with dual-motor all-wheel drive and lots of torque, plus it will be able to park itself.
Product Review

The iPad Pro is the best tablet ever. But don't sell your laptop just yet

Apple has unveiled a big redesign for the iPad Pro, slimming down the bezels, adding Face ID, and the ability to attach and charge the Apple Pencil. All of this comes at a high cost however, as the iPad Pro starts at $799.
Home Theater

‘Star Trek: Discovery’ season 2 gets a new, Spock-heavy trailer

CBS has released a new trailer for Star Trek: Discovery season 2, which premieres January 17 on CBS All Access. The new trailer features series newcomers Spock and Christopher Pike prominently.
Movies & TV

Netflix is testing an instant scene-replay feature, but would you use it?

Ever felt like Netflix was missing a scene-replay button? The company is currently trialing a feature that lets you skip back to the start of the scene you just watched, though early tests appear to be annoying some viewers.
Movies & TV

'Spider-Man: Into the Spider-Verse' is one of the hero's best movies ever

One of Spider-Man's most memorable big-screen adventures, animated feature Spider-Man: Into the Spider-Verse simultaneously feels like nothing we've ever seen before and a tale that feels familiar in all the best ways.
Home Theater

From the Roku Ultra to the Fire TV Cube, these are the best streaming devices

There are more options for media streamers than ever, so it’s more difficult to pick the best option. But that’s why we're here. Our curated list of the best streaming devices will get you online in no time.
Movies & TV

Celebrate the 25th anniversary of ‘The X-Files’ with the show’s 10 best episodes

The X-Files premiered 25 years ago, so here are the 10 best episodes of the award-winning sci-fi series. From alien-abduction drama to hilarious satires, these are the best episodes from all 11 seasons of the hit series.
Movies & TV

Can't get enough lightsaber action? Here's how to get your Star Wars fix online

Few of us want to deal with DVDs or Blu-ray discs anymore. Unfortunately, the Star Wars movies are few and far between when it comes to streaming. If you want to watch Star Wars online, check out our guide on where to find the films online.

Psychedelic 'Spider-Man,' Superman goes evil, 'Star Trek: Discovery' trailer

This week on Between the Streams, we'll talk about the wondrous, psychedelic adventure that is Spider-Man: Into the Spider-Verse. We'll also discuss Dr. Strange 2, the freaky trailer for Brightburn (Superman goes evil?), and more.
Home Theater

Streaming services blast past networks for the most scripted TV shows in 2018

For the first time in history, streaming services like Netflix, Hulu, and Amazon, produced more original scripted series than broadcast or cable channels, setting a new record for the number of TV shows on the air.
Home Theater

The best Dolby Atmos movies for your home theater sound as good as they look

If you've got your hands on some sweet Dolby Atmos gear, the next step is to find films that take advantage of it. These are our picks in every genre for the best Dolby Atmos movies currently available on Blu-ray and streaming services.
Movies & TV

Do you have questions about Hulu? We’ve got answers

Not sure which Hulu subscription is right for you? We're here to help. This is your complete guide to Hulu and Hulu with Live TV, including content offerings for each service, pricing, internet requirements, and more.