Skip to main content

Apple plans to make iOS the largest augmented reality platform around, overnight

Promotional logo for WWDC 2023.
This story is part of our complete Apple WWDC coverage
Updated less than 3 days ago

Pokemon Go was undeniably one of 2016’s biggest gaming success stories, offering a wholly new mobile experience that hinged on location-based gameplay and augmented reality technology. Today at WWDC 2017, Apple unveiled ARKit, a new platform that will allow developers to integrate computer vision into their projects with greater ease than ever before.

Apple’s senior vice president of software engineering, Craig Federighi, debuted ARKit with a live demonstration on stage. He used an iPhone to run a test application that could place virtual objects on a surface in front of him at the touch of a button.

Recommended Videos

The coffee cup that Federighi set on the table remained in place as he moved around with his iPhone in hand, without the kind of stuttering or unwanted rotation that can break immersion in this kind of experience. He went on to add a lamp to the scene, which cast a realistic shadow from the coffee cup to demonstrate the way virtual objects can interact.

ARKit will provide fast, stable motion tracking that developers can build into their apps. It’s capable of seeking out planes like tables and floors, it can estimate how much ambient light is in the vicinity, and it’s capable of balancing the scale of various objects to ensure the scene is congruent.

The utility will apparently work alongside third-party frameworks like Unity and Unreal as well as Apple’s own SceneKit to give developers more freedom in their creative process.

Apple is bullish that ARKit will become the largest AR platform in the world overnight, thanks to the hundreds of millions of iPads and iPhones already out in the wild, already capable of running content created using the tools. The company has already been working with some big-name partners, with IKEA and Lego both having experimented with the platform.

Meanwhile, Niantic has used ARKit to make Pokemon Go even more immersive. The way that Pokemon are rendered in real-world environments has been improved, integrating them into their environment with a greater sense of place and space.

Wingnut AR, a sister studio of Peter Jackson’s movie production company, then demonstrated its usage of the technology on stage. A standard table top was transformed into a sci-fi battle, with explosions and artillery covering the surface and spilling out into the ‘skies’ above.

ARKit is set to launch as part of iOS 11 later this year.

Brad Jones
Brad is an English-born writer currently splitting his time between Edinburgh and Pennsylvania. You can find him on Twitter…
Apple’s Reality Pro headset may launch sooner than anyone expected
A woman reaching out while wearing a VR headset.

Apple’s mixed-reality headset is probably the company’s worst-kept secret at this point, and multiple rumors have claimed it will launch at the company’s Worldwide Developers Conference (WWDC) in June. What’s less clear is when the device will actually go on sale, but a fresh report might have just leaked this top-secret detail.

The information comes from Taiwan’s Economic Daily News (machine translation), which has just released a report on the Reality Pro headset. In that report, the outlet claims Apple is in a “final sprint” to get the product ready, suggesting it is almost ready to ship.

Read more
Apple’s Reality Pro headset is the VR industry’s ‘last hope’
A rendering of an Apple mixed-reality headset (Reality Pro) in a gray color seen from the front.

Apple’s upcoming mixed reality headset hasn’t even launched, yet it’s already being touted as the “last hope” for the virtual reality (VR) headset industry. It shows what a dire situation the market is in, at least according to some estimates.

The grim appraisal comes from respected industry analyst Ming-Chi Kuo. In a post on Medium, Kuo explained that other headset makers have cut their production plans and are shipping far fewer units than previously expected. The malaise affects augmented reality (AR) and mixed reality (MR) headsets as well as their VR counterparts, says Kuo.

Read more
Apple boss says AR ‘may be even better than just the real world’
Tim Cook Apple Event 2021

Besides maintaining Apple’s position as one of the world’s leading tech firms, the company’s CEO, Tim Cook, is also highly accomplished at never giving anything away.

This essential skill -- an absolute must-have for Apple executives -- comes into its own during media interviews, where Cook and his colleagues have to carefully formulate entire answers before the words leave their lips.

Read more