Skip to main content

Here’s why people are claiming GPT-4 just got way better

It appears that OpenAI is busy playing cleanup with its GPT language models after accusations that GPT-4 has been getting “lazy,” “dumb,” and has been experiencing errors outside of the norm for the ChatGPT chatbot circulated social media in late November.

Some are even speculating that GPT-4.5 has secretly been rolled out to some users, based on some responses from ChatGPT itself. Regardless of whether or not that’s true, there’s definitely been some positive internal changes over the past behind GPT-4.

More GPUs, better performance?

Posts started rolling in as early as last Thursday that noticed the improvement in GPT-4’s performance. Wharton Professor Ethan Mollick, who previously commented on the sharp downturn in GPT-4 performance in November, has also noted a revitalization in the model, without seeing any proof of a switch to GPT-4.5 for himself. Consistently using a code interpreter to fix his code, he described the change as “night and day, for both speed and answer quality” after experiencing ChatGPT-4 being “unreliable and a little dull for weeks.”

While this was happening, OpenAI quietly reopened its ChatGPT Plus subscriptions last Wednesday, which had registration down since November 14. Altman stated in an X post, “Thanks for your patience while we found more GPUs.”

There is no word whether there is a correlation between the reinstating of ChatGPT Plus signups and the improvement of GPT-4, but the timing is interesting. Notably, signups for the paid version closed shortly after OpenAI’s first DevDay developers’, where the company unveiled a host of new functions for the paid version of the AI chatbot. The company put a waitlist in place for ChatGPT Plus subscriptions due to post-DevDay signups exceeding the service’s capacity to process functions.

People complained that GPT-4 would explain how to execute commands instead of executing the task.

Shortly after that, users began reporting unusual behavior from GPT-4 beyond the traditional AI quips that are already known. One common grievance was that GPT-4 would “back talk” users or require multiple explanations of a command before being able to execute the query. Another complaint was that the model would explain to users how to execute their command instead of executing the task.

Degradation of GPT-4 dates back to at least July, when a study observed a steep decline in accuracy between March and June. Many, including OpenAI Product Vice President Peter Welinder, have suggested that answer quality might appear insufficient as a psychological phenomenon as the model further updates. Some have added that users might benefit from changing their queries to get desired results.

Though OpenAI has kept largely mum about its inner workings, Altman’s X post about GPUs was likely a large indicator of what is happening behind the scenes. Reports from April indicated that OpenAI would need an excess of 30,000 GPU units to maintain its commercial performance for the remainder of the year. That was before the spike in interest in November.

Secret GPT-4.5 testing or just hallucinations?

Beyond that, speculation about GPT-4.5 has ramped up with several other details about a potential new GPT version leaking.

Founder of the @therundownai newsletter, Rowan Cheung, recently shared on X (formerly Twitter) leaked pricing details for a new GPT-4.5 model that OpenAI has in development. The details include new pricing tiers and information about advanced multimodal capabilities.

Cheung asked OpenAI CEO Sam Altman via the social media platform about the validity of the leak, to which he replied, “Nah.”

The GPT 4.5 speculation started on Thursday with a ‘leaked‘ image showing a new GPT-4.5 model with new advanced multimodal capabilities and new pricing.

However, Sam Altman commented "nah" when asked if the rumors were true.

But there's more to the story…

— Rowan Cheung (@rowancheung) December 18, 2023

However, several users who have handled the proposed update are convinced that they are using GPT-4.5 and that it is new and better than ever. Some have asked the chatbot, which they believed to be running GPT-4 what its model was — and it replied “GPT-4.5 Turbo.”

This has led many to believe that OpenAI has been testing GPT-4.5, primarily on its mobile apps, hoping to evade savvy users. However, not everyone has been able to recreate these results, and the model will tell them the latest version is simply GPT-4. OpenAI employee Will Depue also commented on the matter, calling it a “very weird and oddly consistent hallucination.”

Cheung noted a post from the official ChatGPT X page, with the brain and head in the clouds emojis, which he believes is OpenAI’s vague way of reiterating that the responses are hallucinations.

Notably, OpenAI gives early and exclusive access to its paid users, which includes ChatGPT Plus users, developer API users, and enterprise users. When features are announced, these are among the first to experience the latest GPT versions and their features. Many tinkering with the models and noticing the subtle changes likely have some form of developer API access or are using the service to test code and are sharing their input with the public.

Even if OpenAI is testing GPT-4.5, there’s no telling when an update could occur, especially when the company is settling down from service and organizational destabilization. Additionally, the company and product are still new, and it’s not yet clear what a routine update cycle looks like. For now, I suppose it doesn’t matter what “version” of ChatGPT we’re on because the improvements seem real.

Editors' Recommendations

Fionna Agomuoh
Fionna Agomuoh is a technology journalist with over a decade of experience writing about various consumer electronics topics…
Google might finally have an answer to Chat GPT-4
ChatGPT versus Google on smartphones.

Google has announced the launch of its most extensive artificial intelligence model, Gemini, and it features three versions: Gemini Ultra, the largest and most capable; Gemini Pro, which is versatile across various tasks; and Gemini Nano, designed for specific tasks and mobile devices. The plan is to license Gemini to customers through Google Cloud for use in their applications, in a challenge to OpenAI's ChatGPT.

Gemini Ultra excels in massive multitask language understanding, outperforming human experts across subjects like math, physics, history, law, medicine, and ethics. It's expected to power Google products like Bard chatbot and Search Generative Experience. Google aims to monetize AI and plans to offer Gemini Pro through its cloud services.

Read more
This app just got me excited for the future of AI on Macs
The ChatGPT website on a laptop's screen as the laptop sits on a counter in front of a black background.

In a year where virtually every tech company in existence is talking about AI, Apple has been silent. That doesn't mean Apple-focused developers aren't taking matters into their own hands, though. An update to the the popular Mac writing app iA Writer just made me really excited about seeing what Apple's eventual take on AI will be.

In the iA Writer 7 update, you’ll be able to use text generated by ChatGPT as a starting point for your own words. The idea is that you get ideas from ChatGPT, then tweak its output by adding your distinct flavor to the text, making it your own in the process. Most apps that use generative AI do so in a way that basically hands the reins over to the artificial intelligence, such as an email client that writes messages for you or a collaboration tool that summarizes your meetings.

Read more
One year ago, ChatGPT started a revolution
The ChatGPT website on a laptop's screen as the laptop sits on a counter in front of a black background.

Exactly one year ago, OpenAI put a simple little web app online called ChatGPT. It wasn't the first publicly available AI chatbot on the internet, and it also wasn't the first large language model. But over the following few months, it would grow into one of the biggest tech phenomenons in recent memory.

Thanks to how precise and natural its language abilities were, people were quick to shout that the sky was falling and that sentient artificial intelligence had arrived to consume us all. Or, the opposite side, which puts its hope for humanity within the walls of OpenAI. The debate between these polar extremes has continued to rage up until today, punctuated by the drama at OpenAI and the series of conspiracy theories that have been proposed as an explanation.

Read more