Skip to main content

Digital Trends may earn a commission when you buy through links on our site. Why trust us?

Apple’s ‘foundational’ Vision Pro tool was secretly built 6 years ago

Long before Apple’s Vision Pro headset made its debut, there was rampant speculation that the company’s wider augmented reality (AR) efforts were part of a larger project toward building the then-mysterious device. Now, it seems that at least one of those technologies was built with Vision Pro in mind.

I recently interviewed Susan Prescott, Apple’s vice president of Worldwide Developer Relations, and Steve Sinclair, senior director of product marketing for Apple Vision Pro, to find out how the company courted developers while prepping the headset. In the course of that interview, Sinclair shed some light on how Vision Pro intertwined with the company’s ARKit developer framework.

Apple Vision Pro provides virtual screens for your Mac.
Apple

Throughout my talk with Prescott and Sinclair, both made repeated references to ARKit, Apple’s framework for building AR experiences. Prescott said it was “foundational” for allowing people to build content for Vision Pro. When discussing how Apple adapted existing tools for its headset, Sinclair stated that “ARKit on iPhone and on iPadOS allowed us the opportunity to learn from developers and from ourselves on how best to implement these things on a platform like Vision Pro.”

Was ARKit specifically built with Vision Pro in mind, I asked, or did its development come about separately and subsequently?

“We’ll just say in conjunction” was Sinclair’s response.

Sinclair’s answer seems to imply that, at a minimum, Vision Pro was a consideration in the development of ARKit, if not the main driving force behind its creation.

ARKit’s secret purpose

Two people playing an augmented reality game on Apple iPad.
Apple

When Apple revealed ARKit as part of iOS 11 in 2017, it explained that the tool would allow developers to “build detailed and compelling virtual content on top of real-world scenes for interactive gaming, immersive shopping experiences, industrial design and more.” Looking back, that seems like a description ripe for Vision Pro as much as it does the iPhone or iPad.

We already know that Vision Pro has been in development since at least 2007, the date Apple provisionally applied for a very early headset patent. In the intervening 16 years, there have been many other technologies that Apple ostensibly made for different devices that could also have been created with Vision Pro in mind.

LiDAR, for instance, has been heavily promoted as a way to enjoy AR experiences using an iPhone or an iPad Pro, but it also features prominently in Vision Pro. Numerous patents registered over the years, from extending a Mac’s display into virtual space to in-air MacBook keyboards, could all have been disguised Vision Pro technologies.

That’s unsurprising given Apple’s famous tight-lipped reticence, and it’s interesting to see the suggestion that ARKit has always had a secret secondary purpose. What other seemingly innocuous techs could find their way into future Apple devices? Only time will tell.

Editors' Recommendations

Alex Blake
In ancient times, people like Alex would have been shunned for their nerdy ways and strange opinions on cheese. Today, he…
Does the Apple Vision Pro come with a battery?
Apple Vision Pro as seen from behind, with the battery pack superimposed.

Apple's Vision Pro is now available for purchase, but you might be wondering what's included at the starting price of $3,500 and if its battery is sold separately. Given that there's not a battery inside the headset itself, that's a good question.

Along with the actual headset, the base model of Vision Pro does include a battery, plus: a charger, 5-foot charging cable, front cover, top strap, light seal cushion, and polishing cloth. That means you get everything you need to start using Apple's exciting new spatial computer as soon as it arrives in the package.

Read more
This one feature could prevent motion sickness, but the Vision Pro doesn’t have it
A divided image shows an Apple Vision Pro and Meta Quest 3.

A new study on virtual reality comfort suggests that some of the best VR headsets have a feature that can help prevent motion sickness. Also known as simulator sickness, the problem is due to a mismatch between what you see in a head-mounted display (HMD) and what your body feels in reality.

It’s well known that gamers prefer higher frames per second (fps) to be able to react more quickly and aim with greater accuracy. According to a recent study, though, a faster refresh rate can also reduce the chances you’ll experience nausea or vertigo after playing a VR game with lots of motion.

Read more
Nvidia and Apple are collaborating on the Vision Pro in the most unlikely way
Nvidia revealing support for the Apple Vision Pro.

You don't normally see tech titans like Nvidia and Apple pair up, but the two companies announced at this week's Nvidia GTC 2024 that they are coming together around the Vision Pro. Nvidia is bringing its Omniverse Cloud platform to Apple's headset, allowing users to interact with objects and design directly through the Vision Pro.

The basis of support is a set of Omniverse Cloud APIs that can stream Omniverse assets to Apple's headset. Omniverse isn't running on the Vision Pro itself. Instead, designers can stream scenes made with the Universal Scene Description (OpenUSD) in Omniverse to the Vision Pro, and interact with the 3D objects natively.

Read more