Apple may introduce augmented reality functionality into the iPhone’s camera

Report: Apple has up to 1,000 engineers working on AR product for the iPhone

apple encryption court order news logo
Google isn’t the only company looking to cash in on the augmented reality craze. Business Insider reports that Apple plans to integrate augmented reality tech directly into the iPhone’s camera app.

The new feature would reportedly take the form of computer vision. Apple’s work-in-progress camera app will be able to identify objects in-frame and recognize faces, according to the report. And it will be made available to developers in the form of a software development kit.

The most recent news we’ve heard about Apple’s augmented reality plans suggest that Apple may have as many as 1,000 engineers working on an AR-related product in Israel — a product that will make its way to the next iPhone, at least according to analyst Steven Milunovich and his team at UBS. The report, from Business Insider, also highlights that Apple has recently made a number of AR-related purchases, including PrimeSense, a 3D sensing company in Tel Aviv, and RealFace, a facial recognition company also based in Tel Aviv.

The Cupertino, California-based company is far from the first to enter the AR arena. Google Goggles, Google’s eponymous object recognition app, recognizes landmarks, barcodes, books, and works of art, and parses text of labels and signage using optical character recognition. And Amazon’s Flow app can decode QR codes, scan business cards, and recognize tens of millions of books, DVDs, and packaged products.

Apple’s system sounds nearly as ambitious: an app that can identify objects that users point the iPhone’s camera at in real time. It will rely on machine learning, a type of artificial intelligence that “learns” and improves over time, and a database of 3D objects that Apple will either license or build itself.

Beyond those basics, the project’s implications aren’t clear. Google’s Project Tango, an augmented reality platform, leverages sensors to measure the depth of surroundings, but the iPhone lacks the hardware necessary to perform that sort of tracking. Apple Insider speculates that Apple’s brand of machine-learning-powered object tracking could be used for spatial mapping, and that facial recognition, meanwhile, could be used to apply Snapchat-style filters to people’s faces.

Spearheading the project is a team comprised of employees from recent Apple acquisitions. The iPhone maker purchased PrimeSense, the Israeli company behind the motion-tracking hardware in Microsoft’s Kinect sensor, in 2013. It bought Metaio in February 2014, FaceShift in 2015, and Flyby Media in January 2016, all of which specialize in virtual reality and AR technologies. And it hired a senior optics manufacturing engineer specializing in heads-up displays, camera systems, and image sensors in September.

The project builds on another reportedly in development at Apple’s Cupertino headquarters: AR glasses. According to Business Insider, Apple is developing a compact pair of AR eyewear that connect wirelessly with an iPhone and show images and other information in the wearer’s field of vision.

If anything is for certain, it’s that an updated camera app will debut far ahead of a headset. Bloomberg reports that Apple has begun talking with suppliers about the glasses and has ordered “small quantities” of displays for testing. The publication pegs 2018 as the product’s earliest possible release window.

Until then, Snapchat’s Spectacles will have to do.

Updated on 03-02-2017 by Christian de Looper: Added new Business Insider report saying that Apple had as many as 1,000 engineers working on AR.

Emerging Tech

Awesome Tech You Can’t Buy Yet: Robo sidekicks, AC for your bed, and more

Check out our roundup of the best new crowdfunding projects and product announcements that hit the Web this week. You can't buy this stuff yet, but it sure is fun to gawk!
Mobile

Sixth public beta of iOS 12 still lacks one key feature

At this year's Worldwide Developer Conference, Apple unveiled its latest operating system, iOS 12. From app updates to group FaceTime, ARKit 2.0, and more, here are all the new features in iOS 12.
Computing

Apple AR glasses will launch in 2020, says respected industry analyst

Apple AR glasses may be closer to reality than we thought. Here is everything we know so far about the augmented reality system, including the rumored specifications of Apple's Project Mirrorshades.
Computing

Pricing and lack of content are still barriers against the adoption of VR

A recent survey questioned 595 VR and AR professionals about business growth in the consumer and enterprise markets. Only 24 percent report strong sales in the enterprise while 18 percent show strong sales in the consumer market.
Product Review

From its stunning screen to its slick S-Pen, Samsung's Note 9 is a masterpiece

It’s jaw-dropping how much tech Samsung has fit inside the Galaxy Note 9. It’s one of Samsung’s largest phones ever thanks to its 6.4-inch screen, and the S Pen is better than ever.
Mobile

Google confirms it still tracks users who turn Location History off

Google is tracking your location -- even when you tell it not to. According to an investigation by the Associated Press, Google services store location data, regardless of whether privacy settings claim otherwise.
Home Theater

Crazybaby’s Air 1S true wireless earbuds won’t make you look like a dork

Audio technology company Crazybaby has launched the Air 1S true wireless earbuds, offering considerable connectivity improvements over previous models while retaining the sleek style and supreme comfort.
Mobile

Is your smartphone frozen? Here's how to reset your iPhone

You can do a lot with an iPhone, but if you ever run into an issue with it, the first thing you should do is restart it. In this guide, we tell you how to reset your iPhone, and explain how it differs from a factory reset.
Mobile

The HTC U12 Plus is now available in color-shifting Flame Red shade

HTC has released some pretty great flagship phones in the past few years, and it's now aiming to follow up with another one. After plenty of rumors and leaks, the company has finally taken the wraps off of the new HTC U12 Plus.
Mobile

A subway passenger may have snagged a shot of the upcoming Pixel 3 XL

It hasn't been too long since Google launched the Pixel 2, but it's already gearing up for the next iteration, the Google Pixel 3. Here's everything we know about the upcoming phones so far.
Mobile

HMD may announce the U.S. release of the Nokia 6.1 Plus next week

It's shaping up to be a big year for HMD. After announcing five phones at MWC earlier this year, the handset manufacturer is reportedly bringing another budget phone, the Nokia 6.1 Plus, to the U.S.
Mobile

Newly leaked photos show a fully functioning Motorola One Power

Many of us have come to know and love Motorola's extensive lineup of budget phones. But Motorola makes some pretty awesome midrange smartphones as well. And it looks like we're about to see its next phone, the Motorola One Power, very soon.
Mobile

How to find a lost phone, whether it's Android, iPhone, or any other kind

Need to know how to find a lost phone? Here, we’ll help you locate your lost or stolen phone using both native and third-party apps and services, whether it’s a smartphone or an older variety.
Product Review

Sony's underwhelming XZ2 Premium makes a better camera than a phone

Sony’s third flagship phone of 2018 is its first to ever feature a dual-camera lens. The Sony Xperia XZ2 Premium can capture ultra-low-light video far better than the iPhone X or Galaxy Note 9, but is it worth the high cost?