Skip to main content

Digital Trends may earn a commission when you buy through links on our site. Why trust us?

The iPhone’s AI future just got a lot more interesting

The Apple iPhone 15 Pro Max's camera module.
Apple iPhone 15 Pro Max Andy Boxall / Digital Trends

Not too long ago, Apple was rumored to be internally working on something called Apple GPT, a chatbot based on the company’s own AI model with the goal of emulating what OpenAI’s ChatGPT does. In the months that followed, we have seen generative AI products appearing everywhere, from Google Pixels and Samsung’s Galaxy S24 phones to an upstart like the Nothing Phone 2a.

In the meanwhile, all we got from Apple were vague, but bold claims. Apple CEO Tim Cook told investors that Apple’s generative AI push will “break new ground” when it arrives later this year. However, it appears that Apple will have a helping hand from Google to realize those dreams. Or maybe even OpenAI will come to the rescue.

According to Bloomberg, Apple is reportedly in talks with Google to license the Gemini AI models for iPhones. That sounds like the same strategy Samsung followed for the Galaxy S24 series phones, which can run Google’s Gemini Nano model on-device, while more powerful versions are available on the cloud.

The terms of the deal haven’t been finalized yet, as discussions are said to be very much in flux. However, Apple is reportedly in talks with OpenAI as well. To recall, OpenAI’s foundation tech, such as the GPT-4 model and Dall-E, is currently available across Microsoft’s suite of products and through standalone apps and services like ChatGPT Plus. It’s an interesting development in Apple’s AI ambitions — and one that has me equally excited and worried.

Apple’s AI journey (so far)

How to use Gemini on your Android.based device.
Digital Trends

In the final month of 2023, without much fanfare, Apple introduced a series of model libraries and frameworks under the MLX group designed to operate on its proprietary silicon. This move is poised to introduce generative AI capabilities to the Mac series, akin to Qualcomm’s endeavors with its Snapdragon X Elite platform.

At the beginning of this year, Apple’s research division unveiled a paper on a generative AI tool named Keyframer — enabling users to produce animated content. It is fundamentally based on the GPT-4 model from OpenAI, yet it incorporates vector graphics for processing still images.

Furthermore, Apple’s experts also pushed a research paper describing an AI tool that facilitates image editing through simple verbal instructions. This feature bears resemblance to the voice-assisted media editing toolkit touted by Qualcomm’s latest premier Snapdragon chips.

ChatGPT app running on an iPhone.
Joe Maring / Digital Trends

A subsequent report by Bloomberg highlighted that Apple has been augmenting its dedicated team responsible for examining generative AI functionalities, with the grand aim of making these tools accessible to developers by 2024.

It’s rumored that Apple’s inaugural batch of generative AI functionalities will debut with iOS 18, which is lined up for a June reveal. But as per Bloomberg’s latest report, those features are geared towards native on-device systems and not really generative AI facilities that are usually cloud-connected, such as those provided by ChatGPT, Gemini, or Perplexity.

In September, The Information disclosed that Apple has been developing “foundation models” aimed at enhancing Siri. This initiative is purportedly similar to how Gemini is advancing Google Assistant.

What could Gemini do on iPhones?

Google Gemini app in action on Android.
Google

Now, Gemini brings a ton of capabilities to a phone while running locally and when connected to the internet. When implemented on-device, as is the case with the Google Pixel 8 Pro, it can summarize conversations in the Recorder app even when the phone is offline.

For folks running the Gboard keyboard app, Gemini Nano brings Smart Reply to the table, starting with apps like WhatsApp. In a nutshell, it reads your conversation and accordingly suggests replies based on the context. On-device AI also adds offline translations, a feature that is already shipping on the Gemini-ready Samsung Galaxy S24 series phones.

Right now, with the Gemini app installed on a phone, it can accomplish the following tasks.

  • Just like Google Assistant or ChatGPT, you can engage in natural language conversations with Gemini and get help with writing, coming up with ideas, and more.
  • Quickly summarize the information in your emails or files after activating the Workspace extension. Information can be summarized in formats like lists, charts, and tables.
  • Generate images using text prompts a la OpenAI’s Dall-E engine.
  • Get help using your camera in new ways. In the Gemini app, point the camera at a scene and ask the AI for information about objects in the frame.
  • Understand what’s on your screen. Summon Gemini with a “Hey Google” command to get the job done. For example, it can summarize the article you are currently reading.
  • Use Google Maps and Google Flights to plan trips and even create customized routines.

How an Apple-Google AI deal might play out

Talking with Perplexity chatbot on Nothing Phone 2a.
Nadeem Sarwar / Digital Trends

As mentioned above, Samsung worked closely with Google to get the Gemini Nano AI model running on its flagship phones. But Gemini is not merely limited to flagships. In February this year, MediaTek announced that its mid-range Dimensity 8300 silicon is now optimized for Google Gemini alongside the flagship Dimensity 9300.

Doing something similar for Apple shouldn’t be much of a hassle. If an on-device licensing deal doesn’t pan out, there’s always the application route. For now, it’s unclear what strategy Apple implements, assuming the deal goes through in the first place.

The bigger question is whether a Gemini licensing deal will meaningfully change how users interact with their iPhones. And more importantly, will Gemini foster any change for Siri? To put it bluntly, Siri still has a lot of ground to cover before it can catch up with Google Assistant.

Siri on an iPhone.
Nadeem Sarwar / Digital Trends

But then, even Google hasn’t quite figured out where Gemini exists, or replaces Google Assistant in its entirety. Right now, when you install Gemini on an Android phone, it replaces Google Assistant. Or, at least, it tries to.

Your phone still relies on Google Assistant for a wide range of mundane yet meaningful tasks — like making a call, setting an alarm, sending a message, controlling smart home devices, and creating calendar entries. Similarly, for navigation, voice typing in Gboard, and Android Auto, Google Assistant is still the trusty AI, not Gemini.

Moreover, Google Assistant is still the go-to AI companion on smart displays and Wear OS smartwatches. Considering how tightly Apple interweaves its software across the hardware ecosystem, especially between iPhones and the Apple Watch, a staggered approach where Gemini, Google Assistant, and/or Siri shoulder only a share of the responsibilities is going to create a lot of confusion for an average user.

Alternatively, Apple could work closely with Google and create exclusive integrations, tying Gemini with Apple ecosystem features such as Siri, Mail, Notes, Safari, Calendar, Health, and more. However, given the current state of Gemini data storage policies, we are not holding our breath for such a tight system-level integration.

The risks of Gemini for Apple

Google Gemini app on Android.
Nadeem Sarwar / Digital Trends

Of course, Apple missed the first wave of generative AI on smartphones, and if reports are to be believed, the company is frantically working to catch up. But a Gemini licensing deal also means we might never see Apple’s own work with generative AI development under the project “Ajax.” Or maybe we will only see it in a diluted form while Gemini does the AI heavy lifting on iPhones.

But Gemini is not without its faults. On the contrary, it has fumbled more astonishingly than any other mainstream generative AI tool. A few weeks ago, Gemini users noticed that it was producing grossly inaccurate images, particularly mishandling skin tone, ethnicity, and historical accuracy.

The controversy escalated to the extent that Google paused text-to-image creation for Gemini. “To be clear, that’s completely unacceptable, and we got it wrong,” Google CEO Sundar Pichai wrote in an internal memo, which was reported by NPR.

The Google Gemini AI logo.
Google

Across the Atlantic, Gemini became mired in another controversy when its remarks regarding India’s Prime Minister Narendra were deemed derogatory and went viral on social media. “To simply then say ‘… sorry, it was untested’ is not consistent with our expectations of compliance with the law,” warned (via NDTV) India’s Union Minister Rajeev Chandrasekhar.

The controversy once again thrust AI regulation into the debate and an advisory was also issued for major AI players, requiring them to get explicit approval before tools like Gemini are released publicly.

For a company that plays it as safe with government regulations as Apple, licensing Gemini for hundreds of millions of devices worldwide is no small risk. Particularly when Google itself warns that “Gemini will make mistakes” and says that you should always double-check for inaccuracies.

Editors' Recommendations

Nadeem Sarwar
Nadeem is a tech journalist who started reading about cool smartphone tech out of curiosity and soon started writing…
The Galaxy S24 just got a big camera update. Here’s what’s new
The Samsung Galaxy S24 Ultra in Titanium Orange and in Titanium Silver.

Samsung Galaxy S24 owners just received some great news. Samsung recently released an April software update that addresses various camera issues. Unfortunately, this update is only available in South Korea, but according to information posted on the Samsung Korea forum, it is expected to be released in other regions soon.

Firmware version S928NKSU1AXCA is almost 800MB in size. It includes improvements for lowlight images and image colors in Samsung's Expert RAW app, improved text clarity when zooming in photo mode, and support for 480 x 480 resolution when recording Instant Slow-Mo videos. The Galaxy S24 update for April builds on the improvements from the previous February release, which included enhanced zoom, portrait mode, night mode, and rear camera video capture capabilities.

Read more
Mophie made one of the cutest iPhone accessories I’ve ever used
Mophie Cherry Blossom 3-in-1 Travel Charger with MagSafe.

Out with the old and in with the new. Spring is finally here, kicking out old man winter and breathing some color back into nature. Plus, the National Cherry Blossom Festival has started in Washington, DC, so if you’re lucky enough to be in the area, take advantage of those gorgeous cherry blossoms!

For those of us who aren’t around for one of the biggest spring celebrations in the U.S., there are other ways to commemorate the season. For example, Mophie recently released a limited edition Cherry Blossom color for its 3-in-1 Travel Charger with MagSafe.

Read more
5 phones you should buy instead of the iPhone 15 Pro Max
iPhone 15 Pro Max lying on the ground surrounded by leaves.

Apple’s iPhone 15 Pro Max is one of the top choices for a premium smartphone. It offers the latest and greatest from Apple, including the new A17 Pro chip, a fantastic camera system, a lightweight titanium body, the Action button, and USB-C charging. It's a great package.

But there’s no doubt about it — the iPhone 15 Pro Max is also quite expensive, with a starting price of $1,200. It’s also not the only option out there if you want the best smartphone on the market, especially if you aren’t particularly invested in the Apple ecosystem.

Read more