Skip to main content

This new Google Lens feature looks like it’s straight out of a sci-fi movie

Google has introduced AR Translate as part of a trio of updates for Google Lens that are aimed at taking image translation further into the future. The company held a demonstration at the Google Search On 2022 conference on Wednesday to show that AR Translate can use AI to make images featuring a foreign language look more natural after text is translated to another language.

Currently, any text that’s converted into a different language uses colored blocks to mask bits of the background image. AR Translate better preserves the image by removing the blocks and just swapping the text outright to make the translated image look as though it was the original photo.

What you love about Translating with Lens is now even better. 💡

With major advancements in AI, translated text appears seamlessly integrated, as if it was part of the original picture. Turning text… into context! #SearchOn pic.twitter.com/N8YySv87z1

— Google (@Google) September 28, 2022

Google said it optimized the machine learning models so that AR Translate could work in 100 milliseconds. The translation speed is made possible with the same technology Google uses for Magic Eraser, whether you’re trying to translate a screenshot or a poster with the live Lens Camera.

AR Translate is an impressive innovation that looks as though it’s taken straight out of a sci-fi film. People will not only be able to translate the posters they would see at a museum, zoo, or other tourist attraction when they travel to different countries, but one day they will also be able to translate street signs and storefront signs faster than the blink of an eye. Although, we’re not sure if the live Lens Camera will be able to translate signs in which the text is raised, like on building signs. Even so, it’s impressive to see Google continuing to improve one of its most impressive (and helpful) features.

AR Translate will roll out on the Google app later this year.

Editors' Recommendations

Cristina Alexander
Cristina Alexander has been writing since 2014, from opining about pop culture on her personal blog in college to reporting…
Google just redesigned one of its biggest apps, and it’s bad
Google Chat app on the Play Store.

Google Chat — Google's business-oriented messaging platform that is similar to Slack and Microsoft Teams — just got a big update for its Android and iOS apps. The update dramatically changes how you navigate the app and, uh, well, it sure is something.

Google Chat's mobile app used to be broken up into two pages: Chat (direct messages between you and other users) and Spaces (larger chat rooms for multiple people). As with most apps, you switched between these with a navigation bar at the bottom of your screen.

Read more
The Pixel Watch 2 just got a feature it should have launched with
The Google Pixel Watch 2 resting on a stone fireplace.

Google has heard everyone’s demands and has given in to a highly requested feature that should have already been a thing with the Google Pixel Watch 2: a fully charged notification. Yes, that’s right — you’ll now get a notification on your Android phone when your Pixel Watch 2 is fully charged. Hallelujah!

This new feature should be available starting today via the Pixel Watch app on version 2.1.0.576785526. Google did not formally announce this feature, so it seems to be rolled out quietly (and was first spotted by Android Authority).

Read more
There’s only one reason I’m still using an iPhone in 2023
A green iPhone 15 lock screen.

It's not an understatement to say I am an Android smartphone fan, as an Android phone has been my faithful companion ever since I started using the HTC Desire in 2010. I've bounced from phone to phone in the 13 years since, and I've experienced good and bad phones alike. But in all that time, I've never spent much time with an Apple iPhone. I'm obviously not unfamiliar with iPhones, having used them during my time as a tech writer grabbing screenshots, downloading apps, and testing games — but never having used one as my primary smartphone is something of a blind spot.

The Apple iPhone 15 is a good reason to end that. After all, if I'm going to use an iPhone, it might as well be Apple's latest. Two weeks after booting it up and transferring my data to it, it's been ... a journey. While I can see the iPhone 15 is an excellent smartphone, too many of iOS's idiosyncracies rub me the wrong way. However, there's one feature I've grown to really love, and I'm going to struggle to live without it.
The iPhone 15 is a mixed bag

Read more