Skip to main content

Microsoft unveils Mesh, and with James Cameron, dives into mixed reality

James Cameron holoport with Microsoft's Alex Kippman
James Cameron “holoports” to join Microsoft’s Alex Kipman on stage at Microsoft Ignite 2021. Microsoft

Events have been going virtual for a full year now, with the pandemic preventing physical meetings and forcing companies to innovate. But no one’s taken it quite as far as Microsoft Ignite — which just introduced us to an avatar of the guy who made Avatar.

Today at the developer conference, James Cameron — yep, that Titanic dude —  and Cirque du Soleil co-founder Guy Laliberté joined Microsoft for a fully virtual tech conference featuring “holoports” of the two, in which 3D capture technology is used to beam a lifelike image of a person into a virtual environment. Sure, we’ve seen it on stage during concerts, where great artists and actors living and dead have made virtual appearances. But never as an integral part of a conference.

“This has been the dream for mixed reality, the idea from the very beginning,” said Microsoft Technical Fellow Alex Kipman, one of the key folks behind Microsoft’s Hololens. “You can actually feel like you’re in the same place with someone sharing content, or you can teleport from different mixed-reality devices and be present with people even when you’re not physically together.”

Laliberté has been toying with virtual reality for years, he said, but nothing quite met his needs until Microsoft Mesh, a cross-technology platform also unveiled today at the show. Mesh lets app developers build persistent virtual environments for collaboration, communication, and more. Mesh pushes the boardroom scene even further, allowing people from around the globe to share holograms. Yes, you can toss a virtual key to someone else. It sounds silly, but it opens up vast new worlds, thanks to computation so complex it’s hard to fathom.

“It’s like the metaverse,” Greg Sullivan, director of mixed reality at Microsoft, told Digital Trends. “When someone who’s not in the room with you hands you a hologram, it’s a pretty powerful experience.”

Collaboration in Microsoft Mesh
An image from Microsoft illustrates the potential power of holograms and virtual collaboration in Microsoft Mesh. Image used with permission by copyright holder

With the help of Mesh, Laliberté plans to create Hanai World, a social mixed-reality platform that he’s thought about for years and would connect live and digital entertainment experiences into single events. For his part, Cameron plans to also create shared experiences across the virtual and physical worlds.

Microsoft is thinking of Mesh as a platform, and says it will release SDKs to allow any developer to add this capability to their apps — hence the announcement at the Ignite developer conference. The initial demo apes a design review on purpose — it’s a natural opportunity for this type of collaboration, Sullivan said, and any time you can avoid flying someone to a factory to inspect a prototype product, a company will be saving money. Other potential applications include remote support and training, manufacturing, and more.

Architects and engineers could physically walk through a holographic model of a factory floor under construction, seeing how all the pieces of equipment fit together in three dimensions, potentially avoiding costly mistakes. Engineering or medical students learning about electric car engines or human anatomy could gather as avatars around a holographic model and remove parts of the engine or peel back muscles to see what’s underneath.

Editors' Recommendations

Jeremy Kaplan
As Editor in Chief, Jeremy Kaplan transformed Digital Trends from a niche publisher into one of the fastest growing…
Microsoft and Samsung could team up on new AR headset
microsoft hololens 2

Samsung and Microsoft might be teaming up on a new augmented reality headset, with a possible release coming in 2024, according to a new rumor.

Digital Trends can not verify the original report behind the rumor, but according to The Elec, Microsoft and Samsung have reportedly started working on this project that's scheduled to last two years. Samsung apparently started its task force for the project in March and Microsoft in the summer. Multiple divisions of Samsung's business are also involved in the product, including Samsung Display, Electro-Mechanics, and SDI.

Read more
Apple mixed-reality headset will reportedly launch in ‘the next several months’
history of virtual reality daydream vr

Rumors that Apple is working on a top-secret mixed-reality headset have exploded in recent months. Excitingly, they just got another boost from reputable reporter Mark Gurman, who claims Apple will unveil the device at an in-person event within “the next several months.”

In a newsletter discussing Apple’s future Worldwide Developers Conference (WWDC) events, Gurman wrote: “Sometime in the next several months, the company is poised to announce a mixed-reality headset, its first major new device since 2015. If possible, Apple won't want to make such a critical announcement at an online event. It wants employees, the media, its partners, and developers in the room.”

Read more
Apple’s mixed reality headset could be half the weight of other headsets
A woman reaching out while wearing a VR headset.

Recent reports have indicated Apple is keen to get in on the smart headset game with a mixed reality device that combines augmented reality (AR) and virtual reality (VR) with a dozen built-in cameras and sensors. Now, reliable Apple analyst Ming-Chi Kuo says Apple is working on giving its headset a key advantage over rivals.

That edge will come in the form of its super-lightweight form factor. According to Kuo, Apple is aiming for a total weight of 150g (0.3 pounds), far below the rest of the market, where headsets can weigh upwards of 300g (and much more). With less bulk, Apple is likely hoping users will be able to enjoy using the headset for longer before its weight becomes apparent and tiresome.

Read more