Apple is injecting core services on iOS with AR technology, a new patent shows

google maps speed limits food ordering iphone ios shutterstock 215587159
Tsyhun /
Although Apple CEO Tim Cook hasn’t officially laid out the company’s etched-in-stone plans for virtual reality and augmented reality, he has hinted that the company may lean more towards the latter, as AR keeps users visually connected with others in the same room while VR experiences completely engulf each viewer. Support for these technologies begins at the operating system level, and a recent patent reveals that Apple could be currently working on implementing AR into its base iOS services.

Published by the United States Patent and Trademark Office on Tuesday, Apple’s new patent is simply called “Augmented reality maps.” It was submitted for approval in February 2010, and lists former Apple employee Jaron Waldman as the inventor. Waldman was responsible for developing the location-based services infrastructure for Maps, CoreLocation, and MapKit for iOS and OS X. He left Apple in 2013 to establish Curbside, a service for finding, buying, and retrieving products from nearby stores.

Based on the new patent, Apple’s Maps application won’t utilize a special headset that will project augmented map information in the user’s field of view. Instead, the information will be displayed on a mobile device’s screen, and will based on the user’s current geographical location, camera direction, and the tilt of the device. Essentially, users will point their iOS device in a specific direction and a search result will display nearby points of interest in an overlay rendered over the camera’s real-time feed.

For instance, the owner of an iPhone may load up Maps and point the device in a specific direction when visiting Washington, D.C. In turn, Maps will render relevant information in a layer drawn over the camera’s real-time video feed displayed on the screen. This information will stay “attached” to those real-world points of interest no matter how the iPhone’s point-of-view is shifted. After that, if the user selects a location on the screen, Maps will progress to display directional information as the user moves toward that location.

Apple AR Maps Patent

That said, the AR version of Maps relies on several factors: a built-in camera, GPS connectivity, a digital compass to determine the camera’s direction, an accelerometer to determine the camera’s tilt orientation, and internet access for retrieving and servicing map information requests based on the area surrounding the current GPS coordinates. That information will include “descriptive” data of features including places, roads, buildings, and other points of interest.

Of course, we can’t forget the graphics processor that will generate the augmented information and the real-time video feed on the same screen:

“The graphics processor configured to: overlay, on the video image, map data representing each of the one or more identified points of interest and an illustrated portion of a route from the GPS location identified by the GPS device to a selected one of the identified points of interest, the route being determined based on the map data; and update the illustrated portion of the route as the GPS location of the video capture device changes with movement along the route; and the display configured to present the video image that has been overlaid.”

If anything, the patent reveals that Apple has tooled around with AR technology for at least six years. Naturally, the advancement of mobile technology makes the patent relevant to today’s devices rather than what powered the iPhone 4 so many years ago. It also shows that Apple is indeed building an AR foundation into iOS, and hopefully we’ll see all that work go live with an upcoming iOS release in the near future.


Add futuristic AR to your bike helmet with the Argon Transform

Singapore-based startup Whyre have a simple way to make any bike helmet smart, using an attachment which can overlay AR information on a helmet's visor. They showed off the Argon Transform at CES 2019 this year.

Rumors suggest Apple will release an iPhone XR successor this year

While it's not been long since the last iPhones launched, rumors for the next iPhone are already surfacing. Apple's 2019 flagship could include a variety of upgrades ranging from a new design to enhanced features.

Augmented reality navigation overlays direction information onto the road

Hyundai has unveiled a futuristic head-up display for cars at CES 2019. The Holographic Augmented Reality (AR) Navigation System shows information like directions that appear in front of the driver's eyes, overlaid onto the road.

These are the coolest virtual and augmented reality gadgets from CES 2019

CES 2019 had plenty of VR and AR gadgets on display, including headsets that completely change how you experience virtual reality, and some that don't even require a PC or a phone to run.
Virtual Reality

Getting into VR is spendy. Which headset is truly worth your hard-earned cash?

Virtual reality has finally gone mainstream, but how do you find the best VR headset for you? Check out a few of our favorites, whether you want the best of the best or a budget alternative for your mobile device.

Forget 8K, the Insta360 Titan records 11K that can still play back on smartphones

The Insta360 Titan is an 11K 360 camera -- and a 10K VR camera -- yet software allows the footage to be played back at full resolution, even on smartphones. The camera also uses the largest sensors in a standalone 360 camera yet.

Oculus’ Quest is the headset that will make me (and you) a VR believer

Without excessive wires or complicated setup, and a price point that makes sense for tech that just isn't there yet, Oculus' upcoming standalone headset, the Quest, could bring VR mainstream.
Virtual Reality

With 4K resolution, Pico’s latest stand-alone VR headset takes care of business

Pico Interactive, a popular VR headset manufacturer in China, is adding to its G2 line of business-focused VR headsets with the G2 4K, which is capable of rendering visuals in higher resolutions.

HTC brings two new headsets, a VR browser, and ‘Netflix for VR’ to CES 2019

HTC Vive made several new announcements to CES 2019, including two new headsets, a new subscription service, and a new user interface that completely transforms how applications are launched.

Camera records real-life scenes to design virtual worlds using a single device

Creating virtual reality worlds may get a bit easier in 2019 -- the Axis is a camera module that records a 180-degree depth map, allowing designers to reconstruct the scene for virtual or augmented reality.

The Vive Pro Eye uses Tobii eye-tracking technology to make VR more lifelike

HTC revealed the Vive Pro Eye with eye-tracking support at its CES 2019 press conference on January 7. We now know that Tobii will be the company responsible for integrating the technology.

Dive headfirst into the best experiences available now on the Oculus Rift

The Oculus Rift brought back virtual reality and put a modern twist to it. Grab your Touch Controllers, put on your VR headset, and jump into the fun with some of the best Oculus Rift games available now.
Product Review

HTC puts eye-tracking tech in Vive Pro Eye to make next-gen VR hands-free

With the announcement of integrated eye tracking for the Vive Pro Eye, hands-free VR, less demanding high-quality experiences, and intuitive software, are all on the table.

The best VR headsets at CES 2019 could bring the technology to the mainstream

While there weren't a ton of new VR headset on display at CES 2019, the ones we saw led us to believe that VR could have a real moment soon, both from a gaming and business standpoint.