Skip to main content

Android is getting an AI overhaul. Here’s what it looks like

Android 15 on stage at Google I/O 2024.
Google

At Google I/O 2024, Google has shown off a lot of new improvements coming to Android, thanks to Gemini. With Gemini, Android will be aware of the context on the screen in a variety of scenarios, which will make your life a lot easier. At least, according to Google.

Circle to Search, which was first shown off during Samsung’s Galaxy Unpacked event earlier this year, will be getting some new enhancements. Now, Circle to Search will be a great new study buddy for students. Why? Because it will be able to help with homework, like physics and math. You can simply circle a prompt on the screen, and it will give you step-by-step instructions on how to solve it.

This new feature for Circle to Search will be available today. By the end of the year, it should be available on over 200 million devices.

Google Gemini making a meme.
Google

A major focus of Gemini is how it will be context-aware of what’s on your screen. For example, Gemini can generate an image related to a text message, and it can be dropped right into the conversation. You can also ask Gemini specific questions about a video that you’re currently watching or even long PDF files so you don’t have to scroll through multiple pages. This feature will be rolling out to devices over the next few months.

Gemini Nano multimodal capabilities will be available for Google Pixel later this year. With this feature, your smartphone will be able to process text, as well as understand more information in certain contexts such as sounds, sighs, and spoken language.

Google Gemini Ask a PDF feature.
Google

An accessibility feature that’s being improved with Gemini is TalkBack. This is a feature that is designed for people who experience blindness or low vision. TalkBack allows users to get richer and clearer descriptions of what is happening in an image. This Gemini update to TalkBack will fill in more missing information, like details about what is in a family photo or even the cut of clothes when shopping online. No data connection is needed since Gemini Nano is on-device.

Gemini will also further help prevent scam calls. Gemini Nano can provide real-time alerts during a call if it is able to detect conversation patterns that are commonly associated with scams. For example, when a “bank representative” asks you to transfer funds, make a payment with gift cards, or provide personal information.

When Gemini Nano detects these phrases, it will give you an alert on the screen while you’re on the call with a bit of information, like telling you that banks will never ask you to move money.

This is just the start of improvements coming to Android 15.

Editors' Recommendations

Christine Romero-Chan
Christine Romero-Chan has been writing about technology, specifically Apple, for over a decade. She graduated from California…
Google’s new AI features look like my worst nightmare
Google's Gemini logo with the AI running on a smartphone and a PC.

The Google I/O 2024 keynote was AI-heavy. Very AI-heavy. We all knew it would be, but I went into it hoping the often-exciting company would show me what I really wanted: AI with personality. Alas, once again, the AI on show all did a variation of the same old things, with absolutely no fun, excitement, or joy in it at all.

This was absolutely when Google needed to roll out its very own version of R2-D2 at I/O to fire up our imaginations about AI, given the overload about it recently. But what we got instead was the computer from Star Trek, and oh, how monotonous and uninspiring it was.
Google’s AI life is not my life

Read more
Google just announced 10 huge updates for your Android phone
The Home Screen on the Google Pixel 8 Pro.

Google I/O, the annual everything-Google-software fest, has kicked off. As usual, Android takes center stage. From enhanced privacy and Google Wallet upgrades to theft detection and app safety checkups, there’s a lot to look forward to here.

From Android 15 features to more general Android updates, here’s a breakdown of all the major Android announcements from I/O 2024.
Making life easier with Google Wallet

Read more
Wear OS 5 is the future of Android smartwatches. Here’s what’s new
A person wearing the Google Pixel Watch 2.

With the Google I/O 2024 opening keynote having come and gone yesterday, showcasing Google’s various AI initiatives with Gemini AI and more, news about the Wear OS took second fiddle -- until now. After revealing that Wear OS grew its user base by 40% in 2023, Google has just announced Wear OS 5, along with a slew of new watch face updates and health-tracking features.

Here’s what’s new.
Wear OS 5

Read more