Skip to main content

Apple plans to make iOS the largest augmented reality platform around, overnight

Promotional logo for WWDC 2023.
This story is part of our complete Apple WWDC coverage


Pokemon Go was undeniably one of 2016’s biggest gaming success stories, offering a wholly new mobile experience that hinged on location-based gameplay and augmented reality technology. Today at WWDC 2017, Apple unveiled ARKit, a new platform that will allow developers to integrate computer vision into their projects with greater ease than ever before.

Apple’s senior vice president of software engineering, Craig Federighi, debuted ARKit with a live demonstration on stage. He used an iPhone to run a test application that could place virtual objects on a surface in front of him at the touch of a button.

Recommended Videos

The coffee cup that Federighi set on the table remained in place as he moved around with his iPhone in hand, without the kind of stuttering or unwanted rotation that can break immersion in this kind of experience. He went on to add a lamp to the scene, which cast a realistic shadow from the coffee cup to demonstrate the way virtual objects can interact.

Please enable Javascript to view this content

ARKit will provide fast, stable motion tracking that developers can build into their apps. It’s capable of seeking out planes like tables and floors, it can estimate how much ambient light is in the vicinity, and it’s capable of balancing the scale of various objects to ensure the scene is congruent.

The utility will apparently work alongside third-party frameworks like Unity and Unreal as well as Apple’s own SceneKit to give developers more freedom in their creative process.

Apple is bullish that ARKit will become the largest AR platform in the world overnight, thanks to the hundreds of millions of iPads and iPhones already out in the wild, already capable of running content created using the tools. The company has already been working with some big-name partners, with IKEA and Lego both having experimented with the platform.

Meanwhile, Niantic has used ARKit to make Pokemon Go even more immersive. The way that Pokemon are rendered in real-world environments has been improved, integrating them into their environment with a greater sense of place and space.

Wingnut AR, a sister studio of Peter Jackson’s movie production company, then demonstrated its usage of the technology on stage. A standard table top was transformed into a sci-fi battle, with explosions and artillery covering the surface and spilling out into the ‘skies’ above.

ARKit is set to launch as part of iOS 11 later this year.

Brad Jones
Former Digital Trends Contributor
Brad is an English-born writer currently splitting his time between Edinburgh and Pennsylvania. You can find him on Twitter…
Apple aiming to unveil its mixed-reality headset this spring
Apple VR Headset Concept by Antonio De Rosa.

Apple’s highly anticipated mixed-reality headset could be unveiled just ahead of the company’s Worldwide Developers Conference (WWDC).

Apple’s headset, expected to be called "Reality Pro," will likely offer virtual reality (VR) and augmented reality (AR) capabilities so wearers can immerse themselves in a virtual world or have digital data overlaid onto real-world, real-time imagery.

Read more
Apple’s mixed reality headset may be delayed yet again
Apple VR Headset Concept by Antonio De Rosa.

If you believe the rumors, Apple’s top-secret mixed-reality headset has been beset with delays over the years. Now, it looks like it could be postponed even further.

That’s because reliable Apple analyst Ming-Chi Kuo has revised his prediction for when the headset will see the light of day, pushing it back to later in 2023.

Read more
Apple ‘Reality’ AR/VR headset: major leak shares new details
A render of Apple's VR headset.

A new report reveals several interesting details about Apple's AR/VR headset, which is expected to arrive in 2023. Apple remains silent on this product, but there have been enough patents filed, as well as leaks, to provide confirmation that the iPhone maker has done intensive research into the first of several AR wearables.

The latest news comes from The Information, which has provided some of the most detailed data of any leaker so far. The headset was already expected to be incredibly lightweight, which could be due to the battery being worn around the waist, as explained in the report. Apple's VR solution is said to feature a hot-swap design for the battery that would make the reported one-to-two-hour battery life less annoying.

Read more