Skip to main content
  1. Home
  2. Computing
  3. News

Nvidia and Apple are collaborating on the Vision Pro in the most unlikely way

By
Nvidia revealing support for the Apple Vision Pro.
Nvidia

You don’t normally see tech titans like Nvidia and Apple pair up, but the two companies announced at this week’s Nvidia GTC 2024 that they are coming together around the Vision Pro. Nvidia is bringing its Omniverse Cloud platform to Apple’s headset, allowing users to interact with objects and design directly through the Vision Pro.

The basis of support is a set of Omniverse Cloud APIs that can stream Omniverse assets to Apple’s headset. Omniverse isn’t running on the Vision Pro itself. Instead, designers can stream scenes made with the Universal Scene Description (OpenUSD) in Omniverse to the Vision Pro, and interact with the 3D objects natively.

Recommended Videos

Nissian demoed this capability in a demo video. Through the Vision Pro, the user is able to swap out paint colors, adjust the trim, and even go inside the car using spatial awareness thanks to the Vision Pro.

Get your weekly teardown of the tech behind PC gaming
Check your inbox!
Privacy Policy

It’s sure to make a splash in the enterprise sector, but there are some consumer implications here. Nvidia is essentially showing that it can stream interactable 3D applications to the Vision Pro. This is enabled by Nvidia’s Graphics Delivery Network (GDN), which is already being used to stream 3D applications from the cloud. The fact that it can work on the Vision Pro is a big deal.

The linchpin for this are the Omniverse Cloud APIs. Also at GTC, Nvidia revealed five new APIs centered around Omniverse Universal Scene Description (OpenUSD) loud that can be used individually or collectively:

  • USD Render: support for ray-traced renders of OpenUSD data
  • USD Write: support for modifying OpenUSD data
  • USD Query: support for interactive scenes
  • USD Notify: support for tracking USD changes
  • Omniverse Channel: allows users to connect tools and projects across scenes

Right now, Omniverse Cloud on the Vision Pro is focused around enterprise applications, just as Apple’s headset itself is. This is still a critical foundation for streaming interactable 3D applications to Apple’s headset in the future. Even with how powerful the Vision Pro is, it’s not enough to handle aspects like ray tracing in highly detailed 3D scenes. Being able to stream these scenes at the same quality could line up some exciting apps in the future.

Editors’ Recommendations

Topics
Jacob Roach
Jacob Roach
Lead Reporter, PC Hardware
Jacob Roach is the lead reporter for PC hardware at Digital Trends. In addition to covering the latest PC components, from…
Apple’s cheaper Vision Pro may come with one big drawback
Apple Vision Pro demo unit.

One of the major issues with Apple’s Vision Pro is its price tag. Many folks aren’t willing or able to drop $3,499 on a device they’re not even sure they’re going to use regularly, while others feel more inclined to see if the tech company might follow through with a more affordable version.

Mark Gurman, a high-profile and generally reliable Apple tipster, wrote in his weekly Power On newsletter on Sunday that the Vision Pro team tasked with building a cheaper Vision Pro is struggling to reduce costs without ruining the experience of a cheaper mixed-reality headset, which Gurman suggests may launch at the end of 2025 at the earliest.

Read more
The Vision Pro 2 may already be dead
Apple Vision Pro

According to reports from The Information, Apple is working on a cheaper non-Pro version of the Vision Pro headset -- and hitting pause on the development of the next high-end model. These rumors come from people involved with the supply chain and manufacturing of the Vision Pro, who claim that Apple has told at least one supplier that it's stopping work on the next Vision Pro.

Just like any other Apple product with "Pro" in its name, the Vision Pro was always meant to be part of a lineup of multiple models, so it's not too much of a surprise that a cheaper model is in the works. What is surprising, however, is that there may not be a second generation of the Vision Pro released alongside it -- at least not anytime soon.

Read more
The Vision Pro just got one of its most anticipated features
A man adjusts an Apple Vision Pro headset over his eyes.

Apple's chess demo showed how to make Vision Pro games in WebXR. Apple

At the recent WWDC 2024 event, Apple previewed visionOS 2, which will arrive later this year. The developer beta version is already available, and now we know about a new way to experience VR in the Vision Pro.

Read more