Skip to main content

Digital Trends may earn a commission when you buy through links on our site. Why trust us?

Some Android phones are about to get superpowerful AI apps

MediaTek chip illustration on the Samsung Galaxy S23 Ultra.
Nadeem Sarwar / Digital Trends

You may have already tried a bunch of generative AI apps on your phone. OpenAI’s ChatGPT or HeyPi are some examples of chatty AI apps, while the likes of Runway ML will let you create AI-generated videos right on your phone.

But so far, almost every generative AI app has relied on cloud-based computing, which means all the magical AI processing happens in the cloud, just the way Xbox kits do the heavy lifting at Microsoft server centers when you stream a console game on your phone or tablet.

MediaTek wants to change that, allowing for on-device generative AI computing right on your smartphone. That ambitious moonshot will materialize with the next flagship chipset by MediaTek, which is going to appear inside Android phones by the end of this year. The company is aided in its efforts by Facebook parent Meta, which is offering the Llama 2 model as the foundational stone for generative AI apps.

The chipmaker is touting a whole gamut of benefits from its on-device generative AI processing approach, which includes “seamless performance, greater privacy, better security and reliability, lower latency, the ability to work in areas with little to no connectivity, and lower operation cost.”

Speeding up generative AI on phones

White Xiaomi POCO F5 and bluish-green OnePlus Nord 3 held in hand over a heap of Android smartphones including OnePlus 11, Pixel 6a, Samsung Galaxy Z Flip 4, Galaxy S23.
Tushar Mehta / Digital Trends

The upcoming top-end MediaTek chip will employ three key tactics to enhance the generative AI experience for smartphones. First, it will feature a dedicated software stack optimized to run Llama 2, an open-source large language model developed by Meta that seeks to challenge OpenAI’s GPT and Google’s PaLM 2 models.

Llama 2, which was released in July, is “free for research and commercial use.” So far, not many apps that rely on the Llama 2 language model have arrived, as GPT-based AI apps are currently the talk of the town. But Meta has been actively soliciting players in the smartphone industry, including MediaTek’s archrival, Qualcomm.

Just like MediaTek, Qualcomm also inked a deal with Meta to showcase on-device processing for Llama-based applications on smartphones powered by its flagship chips starting in 2024. Both companies are also targeting other application areas, such as vehicles. XR hardware, smart home devices, and more, with their device-local generative AI efforts facilitated by top-tier silicon.

Meta's Llama 2 language model on a phone.
Nadeem Sarwar / Digital Trends

On its upcoming AI-friendly flagship chip, MediaTek will also use a souped-up APU (AI Processing Unit) that relies on “transformer backbone acceleration.” Transformers are a type of neural network architecture tasked with creating large language models such as GPT (Generative Pre-Trained Transformers) that gave birth to products such as ChatGPT and Microsoft’s Bing Chat.

Finally, MediaTek’s new chip will also dip into the DRAM module to enhance the user experience of Llama-based generative AI apps. DRAM, short for Dynamic Random Memory, is the high-speed, low-latency memory module that stores an app’s working data. The more DRAM in your phone, the higher the number of apps you can run in the background without any issue. There’s a reason smartphone makers like OnePlus have fitted as much as 24GB DRAM on their phones.

What these AI upgrades mean for you

Poster with the MediaTek logo in orange.
Joe Maring / Digital Trends

With the aforementioned tweaks in place, MediaTek says its upcoming AI chip will enhance LLM and AIGC (Artificial Intelligence-Generated Content) experience by shifting the bulk of processing requirements to the local hardware.

As for the kind of tasks you can expect to speed up, well, it would depend on the capabilities of Meta’s Llama 2 model and the kind of apps that are built atop it. Llama 2 is a text-based natural language model, so you can expect it to pull the same kind of tricks as ChatGPT or Bard. It can process queries and provide answers based on its training datasets, summarize or expand text, and more.

As for MediaTek, this won’t be the first AI partnership of its kind. In July this year, the company inked a deal with the China arm of Unity — which develops the eponymous game development engine — to explore generative AI applications in the gaming segment.

MediaTek expects its new chip with Llama 2 apps to arrive in smartphones by the end of the year, so we don’t have that much longer to wait to see what this all looks like in an actual product.

Nadeem Sarwar
Nadeem is a tech journalist who started reading about cool smartphone tech out of curiosity and soon started writing…
Arc Search, one of the best iPhone apps right now, just got even better
Arc Search's Call Arc feature.

One of our favorite iPhone browser apps has just introduced an interesting new feature. Arc Search’s new "Call Arc" tool functions similarly to making a phone call on your iPhone 15 Pro or other iPhone. Instead of speaking to someone on the other end of the line, though, you ask Arc to answer your queries. The outcome is fresh and unique, and it actually works really well.

Before its latest software update, Arc Search already offered a voice search feature. The AI-powered Call Arc is different and designed for people on the go who are looking for quick answers to short questions.

Read more
The Google app on your Android phone is getting a helpful new feature
Google app on Android beta showing Notifications.

The Google app for Android phones is getting a helpful new feature to make search even better. The latest beta has a dedicated "Notifications" feed in its bottom bar. The feature was first introduced on the mobile version of Google for Android earlier this year. The app feature was first noticed by 9to5Google.

The app now includes a Notifications option at the bottom, next to Discover, Search, and Saved items. The Notifications section displays a continuous list of alerts from Google Search, weather conditions, flight information, sports scores, movies and TV shows, and more. The notifications are grouped under “Today” and “Earlier." This feature should prove handy if you miss a notification from the Google app, as it provides a more focused view than Android's system-level history.

Read more
Android phones are about to get a major iMessage feature
Google Messages app on a Pixel 8 Pro, showing an RCS Chat message thread.

Being able to edit sent messages is a popular feature on messaging apps like iMessage and WhatsApp. However, it has yet to arrive to the masses via the Google Messages app on Android phones. Thankfully, that could change very soon.

On X (formerly Twitter), Jhow_kira has shared two screenshots demonstrating how the Google Messages editing feature will work in an upcoming software version. Some Android users, including the X poster, are currently testing this new feature.

Read more