Magic Leap announces partnership with Lucasfilm to produce ‘Star Wars’ content

lucasfilm magic leap partnership capture
Magic Leap, the secretive Hollywood, Florida-based augmented reality startup, just landed a literal blockbuster of a partnership. At Wired’s Business Conference in New York City on Thursday, Magic Leap chief Rony Abovitz announced a multiyear collaboration with Lucasfilm’s xLab, the movie house’s division focused on virtual reality platforms, to produce Star Wars content for Magic Leap’s as yet unrevealed hardware.

The partnership is hardly a token effort. It will see the creation of a joint lab at the San Francisco headquarters of Industrial Light and Magic, Lucasfilm’s special effects division, which host “researchers,” “programmers,” and a handful of members of Lucasfilm’s Story Group writers.

“I’ve never seen anything where we’ll be innovating on both a creative and technological level in such close proximity,” xLab executive Vicki Dobbs Beck told Wired. “I’ve spent 24 years at ILM, but I cannot recall anything that looks or feels like this.”

Magic Leap published a video of what form the collaboration might take: computer-generated representations of Star Wars’ C3PO and R2D2 projected onto the floor of an apartment living room. It’s an interactive story, of sorts: The wearer’s tasked with avoiding storm troopers commanded by space gangster Jabba the Hutt, who isn’t pleased about the (presumably unpaid) status of “Captain Solo’s debt.”

At one point, R2D2 projects a hologram onto a real-life table: a miniature Millennium Falcon taking flight from the table’s surface life table and evading an army of TIE Fighters before making a light-speed getaway.

Magic Leap describes the experience and others like it as “Mixed Reality Lightfields” — seamless, immersive blends of real-life and virtual objects. “[They’re the] best of the practical world and the best of the digital world,” said Lucasfilm’s vice president of new media Rob Brewdow in a press release, but Abovitz describes them a bit more fantastically. “[Mixed Reality Lightfields are] whole new medium … designed to harness the power off your imagination and take you to places you never thought possible,” he told Wired.

And Thursday’s Star Wars demo is only the beginning, apparently. “We built some really crazy moments,” Abovitz said, “one-to-one scale ships and characters, things where you suddenly feel like you’re there. I could be looking at somebody, and there’s also a ship taking off and a droid running around — like you walked onto the set, but it’s all real.”

The partnership between Magic Leap and Lucasfilm was born of a mutual interest, from the sound of it. According to Wired, Industrial Light and Magic’s creative director, John Gaeta, reached out to Abovitz through social media. The two met at Magic Leap’s headquarters in Florida, and while the tech wasn’t perfect — the ungainly prototype gained the nickname “The Beast” among Magic Leap’s employees — it was enough to impressive Gaeta.

“I experienced something I’d never in my life experienced,” he said. “I was able to look at a computer-generated construct, focus along the length of it at any point, and it would abide by my natural eye focus.” After subsequent visits by ILM engineers, Lucasfilm president Kathleen Kennedy, and general manager Lynwen Brennan, an agreement was inked on paper.

The deal with Lucasfilm isn’t Magic Leap’s first foray into content, exactly. New Zealand-based special effects studio Weta Workshop teamed with the company several years ago to produce augmented games and movies (Weta Workshop’s co-founder and CEO, Sir Richard Taylor, serves as both a Magic Leap board member and the company’s Arts Ambassador to China). But Star Wars is a far bigger step toward the company’s goal of building out a library of experiences that’ll attract mainstream attention. Simply put, experiences featuring a franchise as beloved and recognizable as Star Wars — the latest movie in the long-running film franchise, The Force Awakens, grossed more than $2 billion worldwide — are bound to turn heads.

Magic Leap’s technology, which the company has yet to reveal publicly, has been described as a “head-mounted virtual retinal display” that superimposes computer-generated objects onto real-world ones by projecting light into the user’s eyes. The nascent company has offices in Los Angeles, Seattle, Austin, the U.K., New Zealand, and Israel, and has attracted more than $1 billion in seed funding from Google, Legendary Entertainment, and others. Most recently, it invited 10 hand-picked developers to program apps for Magic Leap’s platform, and announced a tentative mass-production date for its devices: this summer.

Movies & TV

To drive its giant virtual world, Ready Player One needed a custom A.I. engine

Steven Spielberg and a visual effects team led by Roger Goyett built a new, virtual universe populated by a host of familiar characters for the Oscar-nominated Ready Player One, but they still had to maintain a powerful emotional depth in…
Movies & TV

Why First Man’s Oscar-nominated visual effects are a giant leap for filmmaking

Paul Lambert, the award-winning visual effects supervisor on First Man, reveals the innovative techniques that blended old footage with modern movie magic to make the Apollo 11 mission to the moon resonate with audiences 50 years later and…
Movies & TV

The best shows on Netflix, from 'Haunting of Hill House’ to ‘Norsemen’

Looking for a new show to binge? Lucky for you, we've curated a list of the best shows on Netflix, whether you're a fan of outlandish anime, dramatic period pieces, or shows that leave you questioning what lies beyond.
Movies & TV

J.J. Abrams wraps production on Star Wars: Episode IX with a heartfelt message

Star Wars: The Force Awakens director J.J. Abrams has wrapped production on Star Wars: Episode IX, which he directed and co-wrote. Here's everything we know about the movie before it premieres in December 2019.
Gaming

These are the coolest virtual and augmented reality gadgets from CES 2019

CES 2019 had plenty of VR and AR gadgets on display, including headsets that completely change how you experience virtual reality, and some that don't even require a PC or a phone to run.
Gaming

These shoes let me stroll through ‘Skyrim,’ and I desperately want to go back

After being funded in just two hours on Kickstarter back in October 2018, Cybershoes has earned itself a place among the coolest VR walking and running tech. At CES 2019, we got to try them out and they live up to the hype.
Gaming

The Teslasuit could turn Black Mirror’s terrifying ‘Playtest’ into a reality

We spoke with Teslasuit co-founder Dimitri Mikhalchuk about VR gaming at CES 2019. With all its features, the future of the Teslasuit and virtual reality look bright. And it also sounds a bit like a Black Mirror episode.
Computing

Could the next Microsoft HoloLens be announced at MWC 2019?

After not having a presence at Mobile World Congress for three years, Microsoft is now sending out media invites for a press conference on February 24 during the annual event in Barcelona. Could a next-generation HoloLens be on the way?
Gaming

Immerse yourself in a new universe with these incredible PSVR games

The PSVR has surpassed expectations and along with it comes an incredible catalog of games. There's plenty of amazing experiences to be had so we've put together a list of the best PSVR games available today.
Gaming

Take a trip to a new virtual world with one of these awesome HTC Vive games

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.
Virtual Reality

Is the Vive Pro better than the original Vive? Our answer might surprise you

HTC Vive vs. Vive Pro, which comes out on top? That's the subject of our latest comparison, which looks at everything from tracking solutions, to controllers, and the brand new headset that could set a new standard for VR.
Computing

Samsung files a VR patent featuring a curved OLED display

Doubling down on its emphasis on curved displays, Samsung recently filed a design patent for a new virtual reality headset that could feature a curved OLED display, which would be an interesting development in VR.
Gaming

Bringing realism to VR is complex, but these developers found a way in holograms

Making virtual reality feel real is the hardest job of all VR developers. For Awake: Episode One, StartVR used volumetric recording, rather than motion capture, to bring its characters to life like never before.