Skip to main content
  1. Home
  2. Computing
  3. Virtual Reality
  4. News

Microsoft unveils Mesh, and with James Cameron, dives into mixed reality

Add as a preferred source on Google

James Cameron holoport with Microsoft's Alex Kippman
James Cameron “holoports” to join Microsoft’s Alex Kipman on stage at Microsoft Ignite 2021. Microsoft

Events have been going virtual for a full year now, with the pandemic preventing physical meetings and forcing companies to innovate. But no one’s taken it quite as far as Microsoft Ignite — which just introduced us to an avatar of the guy who made Avatar.

Recommended Videos

Today at the developer conference, James Cameron — yep, that Titanic dude —  and Cirque du Soleil co-founder Guy Laliberté joined Microsoft for a fully virtual tech conference featuring “holoports” of the two, in which 3D capture technology is used to beam a lifelike image of a person into a virtual environment. Sure, we’ve seen it on stage during concerts, where great artists and actors living and dead have made virtual appearances. But never as an integral part of a conference.

“This has been the dream for mixed reality, the idea from the very beginning,” said Microsoft Technical Fellow Alex Kipman, one of the key folks behind Microsoft’s Hololens. “You can actually feel like you’re in the same place with someone sharing content, or you can teleport from different mixed-reality devices and be present with people even when you’re not physically together.”

Laliberté has been toying with virtual reality for years, he said, but nothing quite met his needs until Microsoft Mesh, a cross-technology platform also unveiled today at the show. Mesh lets app developers build persistent virtual environments for collaboration, communication, and more. Mesh pushes the boardroom scene even further, allowing people from around the globe to share holograms. Yes, you can toss a virtual key to someone else. It sounds silly, but it opens up vast new worlds, thanks to computation so complex it’s hard to fathom.

“It’s like the metaverse,” Greg Sullivan, director of mixed reality at Microsoft, told Digital Trends. “When someone who’s not in the room with you hands you a hologram, it’s a pretty powerful experience.”

Collaboration in Microsoft Mesh
An image from Microsoft illustrates the potential power of holograms and virtual collaboration in Microsoft Mesh. Image used with permission by copyright holder

With the help of Mesh, Laliberté plans to create Hanai World, a social mixed-reality platform that he’s thought about for years and would connect live and digital entertainment experiences into single events. For his part, Cameron plans to also create shared experiences across the virtual and physical worlds.

Microsoft is thinking of Mesh as a platform, and says it will release SDKs to allow any developer to add this capability to their apps — hence the announcement at the Ignite developer conference. The initial demo apes a design review on purpose — it’s a natural opportunity for this type of collaboration, Sullivan said, and any time you can avoid flying someone to a factory to inspect a prototype product, a company will be saving money. Other potential applications include remote support and training, manufacturing, and more.

Architects and engineers could physically walk through a holographic model of a factory floor under construction, seeing how all the pieces of equipment fit together in three dimensions, potentially avoiding costly mistakes. Engineering or medical students learning about electric car engines or human anatomy could gather as avatars around a holographic model and remove parts of the engine or peel back muscles to see what’s underneath.

Jeremy Kaplan
As Editor in Chief, Jeremy Kaplan transformed Digital Trends from a niche publisher into one of the fastest growing…
DuckDuckGo’s browser now blocks the YouTube ads everyone hates
DuckDuckGo adds a Brave-like YouTube ad blocking feature
Text, Aircraft, Airplane

DuckDuckGo has spent the past few months gaining fresh attention as more users look for alternatives to Google’s increasingly AI-heavy Search experience. Now, the privacy-focused company is adding a feature that could make its browser even more tempting for everyday use. DuckDuckGo says its browser can now block most video ads, including those on YouTube, when a video is playing inside the browser.

What’s happening?

Read more
ChatGPT Live could make talking to AI feel straight out of the movies
We might finally get the AI sidekick sci-fi movies promised
Elderly women using ChatGPT live on a smartphone

AI voice assistants have been chasing the sci-fi dream for years, but they still have a hard time holding a conversation with humans. Most voice systems still need clear turns, clean pauses, and a few seconds before they respond. OpenAI is now rolling out GPT-Live, a new voice model for ChatGPT Voice that is designed to make those exchanges feel faster and less scripted.

The main upgrade is what OpenAI calls a full-duplex architecture. In simpler terms, GPT-Live can listen and speak at the same time. It continuously processes what the user is saying while also generating its own response, allowing it to decide when to talk, when to pause, when to keep listening, and when to use a tool.

Read more
A broken Galaxy Fold 5 just became the Pixel desktop future I want Google to steal
A broken Galaxy Fold 5 became a tiny PC because Samsung already built the desktop mode Google keeps treating like a side quest.
Desktop mode within Android 16.

A broken Galaxy Fold 5 should be a sad little monument to modern gadget math. One busted outer display, one repair bill nobody wants to inspect too closely, and suddenly a powerful foldable starts heading toward a drawer. Instead, a Redditor turned one into a glowing acrylic DeX box with spare parts, fans, a USB hub, and the kind of LED lighting that makes every homebrew computer look mildly illegal.

https://www.reddit.com/r/SamsungDex/comments/1upica7/fold_5_dexbox/

Read more