Skip to main content
  1. Home
  2. Computing
  3. News

Nvidia and Apple are collaborating on the Vision Pro in the most unlikely way

Jacob Roach
By
Nvidia revealing support for the Apple Vision Pro.
Nvidia

You don’t normally see tech titans like Nvidia and Apple pair up, but the two companies announced at this week’s Nvidia GTC 2024 that they are coming together around the Vision Pro. Nvidia is bringing its Omniverse Cloud platform to Apple’s headset, allowing users to interact with objects and design directly through the Vision Pro.

The basis of support is a set of Omniverse Cloud APIs that can stream Omniverse assets to Apple’s headset. Omniverse isn’t running on the Vision Pro itself. Instead, designers can stream scenes made with the Universal Scene Description (OpenUSD) in Omniverse to the Vision Pro, and interact with the 3D objects natively.

Recommended Videos

Nissian demoed this capability in a demo video. Through the Vision Pro, the user is able to swap out paint colors, adjust the trim, and even go inside the car using spatial awareness thanks to the Vision Pro.

Get your weekly teardown of the tech behind PC gaming
Check your inbox!
Privacy Policy

It’s sure to make a splash in the enterprise sector, but there are some consumer implications here. Nvidia is essentially showing that it can stream interactable 3D applications to the Vision Pro. This is enabled by Nvidia’s Graphics Delivery Network (GDN), which is already being used to stream 3D applications from the cloud. The fact that it can work on the Vision Pro is a big deal.

The linchpin for this are the Omniverse Cloud APIs. Also at GTC, Nvidia revealed five new APIs centered around Omniverse Universal Scene Description (OpenUSD) loud that can be used individually or collectively:

  • USD Render: support for ray-traced renders of OpenUSD data
  • USD Write: support for modifying OpenUSD data
  • USD Query: support for interactive scenes
  • USD Notify: support for tracking USD changes
  • Omniverse Channel: allows users to connect tools and projects across scenes

Right now, Omniverse Cloud on the Vision Pro is focused around enterprise applications, just as Apple’s headset itself is. This is still a critical foundation for streaming interactable 3D applications to Apple’s headset in the future. Even with how powerful the Vision Pro is, it’s not enough to handle aspects like ray tracing in highly detailed 3D scenes. Being able to stream these scenes at the same quality could line up some exciting apps in the future.

Editors' Recommendations

Topics
Jacob Roach
Jacob Roach
Senior Staff Writer, Computing
Jacob Roach is a writer covering computing and gaming at Digital Trends. After realizing Crysis wouldn't run on a laptop, he…
This one feature could prevent motion sickness, but the Vision Pro doesn’t have it
A divided image shows an Apple Vision Pro and Meta Quest 3.

A new study on virtual reality comfort suggests that some of the best VR headsets have a feature that can help prevent motion sickness. Also known as simulator sickness, the problem is due to a mismatch between what you see in a head-mounted display (HMD) and what your body feels in reality.

It’s well known that gamers prefer higher frames per second (fps) to be able to react more quickly and aim with greater accuracy. According to a recent study, though, a faster refresh rate can also reduce the chances you’ll experience nausea or vertigo after playing a VR game with lots of motion.

Read more
Meet Blackwell, Nvidia’s next-generation GPU architecture
Nvidia introducing its Blackwell GPU architecture at GTC 2024.

We finally have our first taste of Nvidia's next generation of GPUs, named Blackwell. Sure, they're built for enterprises, and no, they won't run Cyberpunk 2077 (at least not officially). But this is the first look we've have at what Nvidia is cooking up for its RTX 50-series GPUs, which are rumored to launched sometime in the next year.

The GPU we have today is the B200 -- Blackwell 200, if you can spot it -- that comes packed with 208 billion transistors. The architecture is built on TSMC's 4NP node, which is an enhanced version of the 5nm node. It's a little surprising given that Nvidia's Ada Lovelace GPUs are built with TSMC's 4N node -- one refinement step away from 4NP. Nvidia notes that it's using a custom version of this process, however.

Read more
Apple’s Vision Pro could be coming to these countries next
The front visor of the Vision Pro on display at an Apple Store.

Code found within visionOS appears to reveal the countries in which Apple’s Vision Pro headset will launch next.

Spotted by MacRumors on Wednesday, the code found within the Vision Pro's operating system points to keyboard support for other languages, specifically:

Read more