Skip to main content

Nvidia and Apple are collaborating on the Vision Pro in the most unlikely way

Nvidia revealing support for the Apple Vision Pro.

You don’t normally see tech titans like Nvidia and Apple pair up, but the two companies announced at this week’s Nvidia GTC 2024 that they are coming together around the Vision Pro. Nvidia is bringing its Omniverse Cloud platform to Apple’s headset, allowing users to interact with objects and design directly through the Vision Pro.

The basis of support is a set of Omniverse Cloud APIs that can stream Omniverse assets to Apple’s headset. Omniverse isn’t running on the Vision Pro itself. Instead, designers can stream scenes made with the Universal Scene Description (OpenUSD) in Omniverse to the Vision Pro, and interact with the 3D objects natively.

Nissian demoed this capability in a demo video. Through the Vision Pro, the user is able to swap out paint colors, adjust the trim, and even go inside the car using spatial awareness thanks to the Vision Pro.

Get your weekly teardown of the tech behind PC gaming
Check your inbox!

It’s sure to make a splash in the enterprise sector, but there are some consumer implications here. Nvidia is essentially showing that it can stream interactable 3D applications to the Vision Pro. This is enabled by Nvidia’s Graphics Delivery Network (GDN), which is already being used to stream 3D applications from the cloud. The fact that it can work on the Vision Pro is a big deal.

The linchpin for this are the Omniverse Cloud APIs. Also at GTC, Nvidia revealed five new APIs centered around Omniverse Universal Scene Description (OpenUSD) loud that can be used individually or collectively:

  • USD Render: support for ray-traced renders of OpenUSD data
  • USD Write: support for modifying OpenUSD data
  • USD Query: support for interactive scenes
  • USD Notify: support for tracking USD changes
  • Omniverse Channel: allows users to connect tools and projects across scenes

Right now, Omniverse Cloud on the Vision Pro is focused around enterprise applications, just as Apple’s headset itself is. This is still a critical foundation for streaming interactable 3D applications to Apple’s headset in the future. Even with how powerful the Vision Pro is, it’s not enough to handle aspects like ray tracing in highly detailed 3D scenes. Being able to stream these scenes at the same quality could line up some exciting apps in the future.

Editors' Recommendations

Jacob Roach
Senior Staff Writer, Computing
Jacob Roach is a writer covering computing and gaming at Digital Trends. After realizing Crysis wouldn't run on a laptop, he…
Apple’s Vision Pro could be coming to these countries next
The front visor of the Vision Pro on display at an Apple Store.

Code found within visionOS appears to reveal the countries in which Apple’s Vision Pro headset will launch next.

Spotted by MacRumors on Wednesday, the code found within the Vision Pro's operating system points to keyboard support for other languages, specifically:

Read more
The MacBook Air 15 vs. MacBook Pro 14: the easy way to decide
Apple's 15-inch MacBook Air placed on a desk with its lid closed.

Picking out a new MacBook isn't as easy as it used to be.

The hardest choice in the lineup might be between the 15-inch MacBook Air and the 14-inch MacBook Pro. Both are now offered with the same M3 chip, despite there being a $300 difference in the base models. But when similarly configured, there's actually only a $100 difference between these two laptops.

Read more
Here’s why the Vision Pro succeeded where the Apple Car failed
Apple Car rendering from Vanarama.

Everywhere you look, the failure of Apple’s secret self-driving car is dominating the news. Yet, it comes shortly after another moonshot project -- the Vision Pro -- launched to higher-than-expected initial sales. Why did one crash and burn while the other was successfully brought to market?

Well, Bloomberg reporter Mark Gurman has attempted to answer that question in his latest Power On newsletter, which claims that the Apple Car (known internally as Project Titan) was “doomed nearly from the start.” In the end, there are many reasons for its failure that the Vision Pro was able to navigate its way around.

Read more