Skip to main content

GPT-4o: What the latest ChatGPT update can do and when you can get it

OpenAI developer using GPT-4o.
OpenAI

GPT-4o is the latest and greatest large language model (LLM) AI released by OpenAI, and it brings with it heaps of new features for free and paid users alike. It’s a multimodal AI and enhances ChatGPT with faster responses, greater comprehension, and a number of new abilities that will continue to roll out in the weeks to come.

With increasing competition from Meta’s Llama 3 and Google’s Gemini, OpenAI’s latest release is looking to stay ahead of the game. Here’s why it’s so exciting.

Availability and price

If you’ve been using the free version of ChatGPT for a while and jealously eyed the features that ChatGPT Plus users have been enjoying, there’s great news! You too can now play around with image detection, file uploads, find custom GPTs in the GPT Store, utilize Memory to retain your conversation as you chat so that you don’t need to repeat yourself, and analyze data and perform complicated calculations.

That’s all alongside the higher intelligence of the standard GPT-4 model, which GPT-4o is an equivalent of, even if it was trained from the ground up as a multimodal AI. The reason this is possible is because GPT-4o is computationally far cheaper to run, meaning it requires fewer tokens, which makes it more viable for a wider user base to enjoy it.

However, free users will have a limited number of messages they can send to GPT-4o per day. When that threshold is reached, you’ll be bumped over to the GPT-3.5 model.

It’s way faster

OpenAI's Mira Murati introduces GPT-4o.
OpenAI

GPT-4 was distinct from GPT-3.5 in a number of ways, and speed was one of them. GPT-4 was just way, way slower, even with its advances in recent months and the introduction of GPT-4 Turbo. However, GPT-4o is almost instantaneous. That makes its text responses far swifter and more actionable, with voice conversations occurring in closer to real- time.

While response speed feels like more of a nice-to-have feature than a game-changing one, the fact that you can get responses in near real time makes GPT-4o a much more viable tool for tasks like translation and conversational help.

Advanced voice support

Although upon its initial debut, GPT-4o is only able to work with text and images, it’s been built from the ground up to utilize voice commands and to be able to interact with users using audio. That means that where GPT-4 could take a voice, convert it into text, respond to that, and then convert its text response to a voice output, GPT-4o can hear a voice, and respond in kind. With its improved speed, it can respond far more conversationally, and can understand unique aspects of voice like tone, pace, mood, and more.

GPT-4o can laugh, be sarcastic, catch itself when making a mistake, and adjust midstream, and you can interrupt it conversationally without that derailing its response. It can also understand different languages and translate on the fly, making it usable as a real-time translation tool. It can sing — or even duet with itself.

Two GPT-4os interacting and singing

This could be used for interview prep, singing coaching, running role-playing NPCs, telling dramatic bedtime stories with different voices and characters, creating voiced dialogue for a game project, telling jokes (and laughing in response to yours), and so much more.

Improved comprehension

GPT-4o understands you much better than its predecessors did, especially if you speak to it. It can read tone and intention far better, and if you want it to be relaxed and friendly, it’ll joke with you in an attempt to keep the conversation light.

When it’s analyzing code or text, it’ll take your intentions into consideration far more, making it better at giving you the response you want and requiring less-specific prompting. It’s better at reading video and images, making it capable of understanding the world around it.

Live demo of GPT-4o vision capabilities

In several demos, OpenAI showed users filming the room they’re in, with GPT-4o models then describing it. In one video, the AI even described the room space to another version of itself, which then had its own responses based on that description.

Native macOS desktop app

The ChatGPT desktop app open in a window next to some code.
OpenAI

Native AI in Windows is still restricted to the very limited Copilot (for now), but macOS users will soon be able to make full use of ChatGPT and its new GPT-4o model right from the desktop. With a new native desktop app, ChatGPT will be more readily available — and with a new user interface to boot — making it easier to use than ever before.

The app will be available for most ChatGPT Plus users in the coming days, and will be rolled out to free users in the coming weeks. A Windows version is promised for later this year.

It’s not all quite ready, yet

At the time of writing, the only aspects of GPT-4o that are available to the public are the text and image modes. There’s no advanced voice support, no real-time video comprehension, and the macOS desktop app won’t be available to everyone for a few more days at least.

But it is all coming. These changes and other exciting upgrades for ChatGPT are just around the corner.

Jon Martindale
Jon Martindale is a freelance evergreen writer and occasional section coordinator, covering how to guides, best-of lists, and…
Nvidia just released an open-source LLM to rival GPT-4
Nvidia CEO Jensen in front of a background.

Nvidia, which builds some of the most highly sought-after GPUs in the AI industry, has announced that it has released an open-source large language model that reportedly performs on par with leading proprietary models from OpenAI, Anthropic, Meta, and Google.

The company introduced its new NVLM 1.0 family in a recently released white paper, and it's spearheaded by the 72 billion-parameter NVLM-D-72B model. “We introduce NVLM 1.0, a family of frontier-class multimodal large language models that achieve state-of-the-art results on vision-language tasks, rivaling the leading proprietary models (e.g., GPT-4o) and open-access models,” the researchers wrote.

Read more
ChatGPT’s Advanced Voice feature is finally rolling out to Plus and Teams subscribers
The Advanced Voice Mode's UI

OpenAI announced via Twitter on Tuesday that it will begin rolling out its Advanced Voice feature, as well as five new voices for the conversational AI, to subscribers of the Plus and Teams tiers throughout this week. Enterprise and Edu subscribers will gain access starting next week.

https://x.com/OpenAI/status/1838642444365369814

Read more
ChatGPT’s resource demands are getting out of control
a server

It's no secret that the growth of generative AI has demanded ever increasing amounts of water and electricity, but a new study from The Washington Post and researchers from University of California, Riverside shows just how many resources OpenAI's chatbot needs in order to perform even its most basic functions.

In terms of water usage, the amount needed for ChatGPT to write a 100-word email depends on the state and the user's proximity to OpenAI's nearest data center. The less prevalent water is in a given region, and the less expensive electricity is, the more likely the data center is to rely on electrically powered air conditioning units instead. In Texas, for example, the chatbot only consumes an estimated 235 milliliters needed to generate one 100-word email. That same email drafted in Washington, on the other hand, would require 1,408 milliliters (nearly a liter and a half) per email.

Read more