Skip to main content

Apple is injecting core services on iOS with AR technology, a new patent shows

google maps speed limits food ordering iphone ios shutterstock 215587159
Tsyhun / Shutterstock.com
Although Apple CEO Tim Cook hasn’t officially laid out the company’s etched-in-stone plans for virtual reality and augmented reality, he has hinted that the company may lean more towards the latter, as AR keeps users visually connected with others in the same room while VR experiences completely engulf each viewer. Support for these technologies begins at the operating system level, and a recent patent reveals that Apple could be currently working on implementing AR into its base iOS services.

Published by the United States Patent and Trademark Office on Tuesday, Apple’s new patent is simply called “Augmented reality maps.” It was submitted for approval in February 2010, and lists former Apple employee Jaron Waldman as the inventor. Waldman was responsible for developing the location-based services infrastructure for Maps, CoreLocation, and MapKit for iOS and OS X. He left Apple in 2013 to establish Curbside, a service for finding, buying, and retrieving products from nearby stores.

Based on the new patent, Apple’s Maps application won’t utilize a special headset that will project augmented map information in the user’s field of view. Instead, the information will be displayed on a mobile device’s screen, and will based on the user’s current geographical location, camera direction, and the tilt of the device. Essentially, users will point their iOS device in a specific direction and a search result will display nearby points of interest in an overlay rendered over the camera’s real-time feed.

For instance, the owner of an iPhone may load up Maps and point the device in a specific direction when visiting Washington, D.C. In turn, Maps will render relevant information in a layer drawn over the camera’s real-time video feed displayed on the screen. This information will stay “attached” to those real-world points of interest no matter how the iPhone’s point-of-view is shifted. After that, if the user selects a location on the screen, Maps will progress to display directional information as the user moves toward that location.

Apple AR Maps Patent
Image used with permission by copyright holder

That said, the AR version of Maps relies on several factors: a built-in camera, GPS connectivity, a digital compass to determine the camera’s direction, an accelerometer to determine the camera’s tilt orientation, and internet access for retrieving and servicing map information requests based on the area surrounding the current GPS coordinates. That information will include “descriptive” data of features including places, roads, buildings, and other points of interest.

Of course, we can’t forget the graphics processor that will generate the augmented information and the real-time video feed on the same screen:

“The graphics processor configured to: overlay, on the video image, map data representing each of the one or more identified points of interest and an illustrated portion of a route from the GPS location identified by the GPS device to a selected one of the identified points of interest, the route being determined based on the map data; and update the illustrated portion of the route as the GPS location of the video capture device changes with movement along the route; and the display configured to present the video image that has been overlaid.”

If anything, the patent reveals that Apple has tooled around with AR technology for at least six years. Naturally, the advancement of mobile technology makes the patent relevant to today’s devices rather than what powered the iPhone 4 so many years ago. It also shows that Apple is indeed building an AR foundation into iOS, and hopefully we’ll see all that work go live with an upcoming iOS release in the near future.

Editors' Recommendations

Kevin Parrish
Former Digital Trends Contributor
Kevin started taking PCs apart in the 90s when Quake was on the way and his PC lacked the required components. Since then…
I hope Apple brings this Vision Pro feature to the iPhone
A concept of spatial FaceTime from Apple Vision Pro mixed reality headset running on iPhone.

Digitally crafted alternative realities can be exciting or discomforting, based on how you envision them. But Apple, among other companies invested in AR- and VR-dominant future, clearly wants you to focus on the bright side. That's why Apple spent a substantial chunk of time at its WWDC 2023 developer conference to highlight the various features of the Apple Vision Pro — Apple's extravagant new mixed reality headset.

As per Apple's surefooted narrative at the event, the Vision Pro delivers us into a new era in computing and pushes beyond the boundaries of fixed displays. The promotional walkthroughs easily convince us the headset is both visually and functionally unique in many ways.

Read more
Have an iPhone, iPad, or Apple Watch? You need to update it right now
iPhone 14 Pro Max against a red background.

If you own an Apple product — be in the iPhone, iPad, Apple Watch, or a Mac — you should update it immediately. Why? Apple has begun rolling out updates to all of its devices with fixes for a serious security vulnerability.

The security vulnerability is known as CVE-2023-32434, and it has to do with the kernel privileges of Apple devices. Per Apple's website, the vulnerability allows third-party apps to "execute arbitrary code." In other words, if a bad actor knows how to exploit this vulnerability, they could potentially gain access to your Apple device and wreck havoc.

Read more
Apple may soon eliminate the notch from your Mac and iPhone
An Apple MacBook laptop with the macOS Ventura background wallpaper and the notch seen at the top of the display.

So many Apple devices have the divisive notch cutout these days that the feature has almost become its own brand, yet it continues to stir disapproving glances and attempts to hide it wherever it's seen. Apple could now be on the brink of eliminating it for good.

That’s because the company recently filed a patent in Europe outlining how future Apple devices, from Macs to iPhones, could do away with the notch once and for all, giving you a borderless experience that’s unbroken around the screen. It’s a grand idea, and Apple thinks it knows how to make it work.

Read more