Skip to main content

Google’s ARCore platform can now track faces, boasts improved memory

Google is continuing to improve its augmented reality platform, ARCore, and has released an update for Android and iOS that adds facial augmentation and improves the existing Cloud Anchors that allowed for AR object permanence.

That sounds complicated, but it’s less complex than it initially seems. The new addition, Augmented Faces, allows users to attach fun effects to their faces that follow their movements and react to their expressions in real time. The technology is similar to iOS’s Animojis and Memojis — except with a key difference. While iOS’s in-built AR effects require a depth-sensing camera (the TrueDepth selfie lens on the latest iPhones), ARCore’s new feature is able to recreate this effect without the need for advanced hardware. To achieve this, Augmented Faces lays a 3D mesh over your face with 468 individually tracked points — with each point corresponding to a specific point on the AR effect. Basically, think of Snapchat’s filters, but better.

The second major part of this update consists of improvements to ARCore’s Cloud Anchors. Introduced in May 2018, Cloud Anchors allow for a certain amount object permanence between devices. Essentially, draw an arrow on a wall with an Android device, and a friend on an iPhone will be able to see it. That may seem minor, but imagine being able to leave a breadcrumb trail of AR directions for a friend while you’re out, or view AR models of spacecrafts together.

This sort of social AR experience is something Google is eager to explore, and this update makes the existing cloud anchors more robust and efficient. More angles are processed when the anchor is created, making steadier and more realistic — so elements are less likely to come loose from their anchor and drift across your screen.

Outside of exceptions like Pokémon Go or Harry Potter: Wizards Unite, it’s probably fair to say augmented reality plays little role in most people’s lives. Part of the reason for that is, well, it doesn’t really have much use yet. However, Google’s recent addition of AR directions to Google Maps — which uses your phone’s camera and screen to overlay directions on the real world — shows what’s possible with augmented reality. This update for ARCore may not be the most exciting update so far — but it’s a big step along the road to AR becoming from commonplace in our lives. If you’re eager to check out what’s currently possible in AR, check out our list of the best AR apps for Android and iOS.

Editors' Recommendations

Mark Jansen
Mark Jansen is an avid follower of everything that beeps, bloops, or makes pretty lights. He has a degree in Ancient &…
Android does this one thing so much better than iOS, and it drives me crazy
Individual volume control sliders on a Samsung Galaxy S23

I’ve long been an iPhone user and always will be — it's just what's in my blood. Even though I’ve been dipping my toes into various Android devices since I started here at Digital Trends, my primary device is still an iPhone 14 Pro. There are a few reasons behind this decision: I’m heavily vested in the Apple ecosystem already, I bought the 1TB model to not worry about storage, and some apps I use don’t have a good enough Android equivalent.

Despite my personal choice of using iOS primarily, the more time I spend with Android, the more I notice things that it does way better than Apple’s iOS. And one of those things is how Android handles volume controls compared to iOS’ rather rudimentary and infuriating system. It may sound like a small thing to home in on, but it's something I just can't overlook.
Apple’s iOS volume controls are badly outdated

Read more
The Pixel 7’s best camera trick is coming to the iPhone and all Android phones
Erasing items in Magic Eraser.

The Google Pixel series of phones, specifically the Pixel 6 and Pixel 7, have an exclusive feature called Magic Eraser. With Magic Eraser, you can get rid of unwanted objects in a photo, such as people in the background or things like power lines. As of today, Magic Eraser is becoming available to all Android phones and iPhone users through Google One.

Magic Eraser debuted on the Pixel 6 lineup, which includes the Pixel 6, Pixel 6 Pro, and the more affordable Pixel 6a, which is still available to purchase (the Pixel 6 and 6 Pro have been discontinued). If you have a Pixel 7 or Pixel 7 Pro, you also have the Magic Eraser feature. One of the reasons I had always wanted a Pixel device is because of Magic Eraser, and it is something that I desperately wished Apple would implement.

Read more
I review phones for a living — here are the 10 apps I can’t live without
iPhone 14 Pro with custom home screen on Mickey Mouse phone holder next to flowers

For most of my life, I think I’ve had a pretty unique career path among my family and friends. Ever since I got the original iPhone, I’ve turned my love for writing into writing about technology, specifically mobile phones. Though I’ve pretty much been iPhone-only for most of my career, since I started at Digital Trends, I’ve been opening up to the world of Android.

Now that I’m checking out both iPhone and Android phones, the world of apps for me has expanded quite a bit. But regardless of what device I’m using, there are some apps that I need before anything else. Here are the first apps that I install when I get a new phone.
1Password (iOS and Android)

Read more