Google is bringing AI superpowers to your smartphone camera, and it looks ridiculous

By Nadeem Sarwar Published May 14, 2024

Google Astra on a phone. — Google

It seems AI assistants are antique, or that’s what Google wants you to believe, for we are in the era of AI agents — and Google I/O 2024 has quickly proven that. Say hello to Project Astra, a generative AI agent with vision, text, and speech capabilities, with a sprinkling of memory and spatial awareness capabilities in tow.

Think of it as eyes for your phone that can make sense of the world around you. Point it at a mathematical equation, and it will solve it. Pointing the camera at a cat? Astra will suggest an apt name for the feline meow-ster. Ask it where you left your earbuds, and if the camera sensor has seen them, it will say something like, “You left them on the sofa.”

Recommended Videos

Astra can make sense of code appearing on a screen, identify objects and explain what they do, identify buildings, and more. Think of it as Google Lens but for the entire world, and can make sense of most anything in front of the camera’s lens.

Unlike Google Assistant, you don’t need to prompt it. Just point the camera at anything, utter the audio query, and Astra will explain in a natural language response. Google says Project Astra will be rolled out via the Gemini app later this year.

An all-seeing AI agent?

Project Astra demonstration on a phone. — Google

If Project Astra sounds familiar, that’s because OpenAI demoed a similar feature for ChatGPT — powered by the new GPT-4o model — just a day ago. OpenAI’s tool is currently under the red-teaming phase for safety testing and will be released in a phased manner, starting with ChatGPT Plus subscribers.

Google won’t say whether Astra will have a price tag. But given the near spontaneity of responses, the kind of visual data crunching involved, and the generative chops required to offer a meaningful response, it’s unlikely Astra will be served as a free perk owing to the compute requirements.

The best example would be the Google One AI Premium subscription, which already hides some of the new Gemini-powered experiences behind a paywall. But so far, Astra looks like the most amazing AI innovation Google has showcased ever since it wowed the world with Duplex’s capabilities a few years ago.

Managing Editor

Nadeem is the Managing Editor at Digital Trends.

Topics

Phones

Apple’s new Upgrade program launches on Tuesday with major changes

Apple's new leasing program might drop AppleCare coverage from the bundle.

iPhone 17 Pro Max

Buying your next Apple device could soon look like leasing a car. Apple is launching its new Apple Upgrade program on Tuesday, July 28, replacing new enrollments in the long-running iPhone Upgrade Program with a lease-based option that covers iPhones, iPads, Macs, and Apple Watches.

Backed by Klarna, the program is designed to lower the upfront cost of Apple's premium devices, but it is also raising questions about whether you'll actually own what you're paying for.

Phones

Setting up your dorm desk? These are the phone stands I’d actually spend my money on

From a $2 folding stand to a three-in-one Apple charging dock, these are the phone stands worth setting up this semester.

Analog Clock, Clock, Electronics

A phone stand is one of the smallest purchases on any back-to-school list, but it's also one of the easiest to get wrong, especially since there are dozens of options available on Amazon. A good phone stand is one that does its job well and, more importantly, doesn't put much of a dent in your budget.

This is one of those product categories where you don’t need to spend big, unless a MagSafe dock or a multi-device charging stand is genuinely useful for your desk or dorm setup. That is why this list begins with the most affordable options and works its way up to the more expensive ones. From a two-pack that costs about as much as a coffee to a three-in-one Apple charging station, I picked eight of Amazon's best-reviewed phone stands worth considering this back-to-school season.

Phones

I picked four wireless chargers so you can stop making your iPhone, AirPods, and Apple Watch fight over one dorm outlet

The best back-to-school wireless chargers for dorm desks, study spaces, and travel

Computer, Electronics, Laptop

A dorm-room desk can disappear surprisingly quickly beneath a laptop charger, phone cable, Apple Watch puck, and the growing collection of adapters required to power them all. Add textbooks and other academic materials, and finding enough room to study becomes the first assignment of the semester.

A wireless charging stand can consolidate several of those cables into one station. It also gives your phone a dedicated place to sit, which helps when you are checking the time or watching a lecture. Every charger here still needs one connection to the wall. So finding a peripheral that works with all of your gadgets isn't just convenient, it's smart. I picked four models ranging from an inexpensive two-device stand to a fast 25W wireless charger capable of powering an entire Apple setup.