Skip to main content

You won’t believe how much ChatGPT costs to operate

A new report claims to know how much ChatGPT costs to run per day, including how much each query approximately costs. The popular text-to-speech chatbot might have set off an AI revolution in November 2022, but has proven extremely expensive to maintain.

The new report comes from Dylan Patel, chief analyst at the research firm SemiAnalysis, who says it costs approximately $700,000 per day, or 36 cents per query, to keep the chatbot up and running.

It’s so expensive, in fact, that Microsoft might be developing its own proprietary AI chips to assist in the maintenance of OpenAI’s operation of ChatGPT, according to Windows Central.

The ChatGPT website on a laptop's screen as the laptop sits on a counter in front of a black background.
Airam Dato-on/Pexels

In addition to quickly hitting a 100 million active users in January, a feat that previously took tech brands years to achieve, ChatGPT has struggled with high traffic and capacity issues slowing down and crashing its servers. The company attempted to remedy this by introducing a paid ChatGPT Plus tier, which costs $20 per month, however, there is no word on how many users subscribe to the paid option.

OpenAI currently uses Nvidia GPUs to maintain not only its own ChatGPT processes, but also those of the brands with which it partners. Industry analysts expect the company will likely require an additional 30,000 GPUs from Nvidia to maintain its commercial performance for the remainder of 2023 alone.

With Microsoft as one of its primary collaborators and investors, OpenAI might be looking at the tech brand to assist in developing hardware to bring down the cost of operations for ChatGPT. According to Windows Central, Microsoft already has this AI chip in the works. Code-named Athena, it is currently being tested internally with the brand’s own teams. The chip is expected to be introduced next year for Microsoft’s Azure AI services.

There is no word on how or when the chip will trickle down to OpenAI and ChatGPT, but the assumption is that it will. The connection comes from the fact that ChatGPT is supported by Azure services. The AI chip might not fully replace Nvidia GPUs, but might help decrease the demand for the hardware, thus reducing the cost of running ChatGPT, Windows Central added.

Editors' Recommendations

Fionna Agomuoh
Fionna Agomuoh is a technology journalist with over a decade of experience writing about various consumer electronics topics…
Is Apple making its own version of ChatGPT? It seems that way
AI assistants compared with ChatGPT.

Apple is likely working on some kind of answer to ChatGPT and generative AI -- because of course it is. It would have been safe to assume that without evidence, but now we have some solid proof that Apple is starting to take AI seriously.

As noticed by TechCrunch, Apple currently has posted 28 AI-related jobs in May alone, and 9to5Mac points out that there's a total of 88 open jobs at Apple that are somehow related to AI. That's a lot, especially considering the hiring freeze that was instituted earlier this year.

Read more
OpenAI’s new ChatGPT app is free for iPhone and iPad
The ChatGPT website on an iPhone.

OpenAI has just launched a free ChatGPT app for iOS, giving iPhone and iPad owners an easy way to take the AI-powered tool for a spin.

The new app, which is able to converse in a remarkably human-like way, is available now in the U.S. App Store and will come to additional countries “in the coming weeks,” OpenAI said. Android users are promised their own ChatGPT app “soon.”

Read more
What is ChatGPT Code Interpreter and how to use it
ChatGPT plugin store.

The latest buzz around OpenAI's ChatGPT chatbot is that it can now access the internet and run plug-ins. You need to be a ChatGPT Plus subscriber, but if you are, the feature is widely available, and it's gotten a lot of people very excited. Why? Because it lets ChatGPT do a whole lot more. In fact, some of its most dedicated users are already putting it to work in new and exciting ways.

From visualizing every lighthouse in America to converting images to text and even doing some video editing, ChatGPT's code interpreter gives it all kinds of exciting new abilities.
What is ChatGPT Code Interpreter?
The ChatGPT Code Interpreter is one of a handful of new plug-ins that you can add to the standard ChatGPT experience to augment and improve its abilities. It makes it possible to run Python code within a chat with ChatGPT, with additional options to upload and download files. You can then further adjust the code, or have ChatGPT make its own changes and suggestions.

Read more