Skip to main content

You won’t believe how much ChatGPT costs to operate

A new report claims to know how much ChatGPT costs to run per day, including how much each query approximately costs. The popular text-to-speech chatbot might have set off an AI revolution in November 2022, but has proven extremely expensive to maintain.

The new report comes from Dylan Patel, chief analyst at the research firm SemiAnalysis, who says it costs approximately $700,000 per day, or 36 cents per query, to keep the chatbot up and running.

It’s so expensive, in fact, that Microsoft might be developing its own proprietary AI chips to assist in the maintenance of OpenAI’s operation of ChatGPT, according to Windows Central.

The ChatGPT website on a laptop's screen as the laptop sits on a counter in front of a black background.
Airam Dato-on/Pexels / Pexels

In addition to quickly hitting a 100 million active users in January, a feat that previously took tech brands years to achieve, ChatGPT has struggled with high traffic and capacity issues slowing down and crashing its servers. The company attempted to remedy this by introducing a paid ChatGPT Plus tier, which costs $20 per month, however, there is no word on how many users subscribe to the paid option.

OpenAI currently uses Nvidia GPUs to maintain not only its own ChatGPT processes, but also those of the brands with which it partners. Industry analysts expect the company will likely require an additional 30,000 GPUs from Nvidia to maintain its commercial performance for the remainder of 2023 alone.

With Microsoft as one of its primary collaborators and investors, OpenAI might be looking at the tech brand to assist in developing hardware to bring down the cost of operations for ChatGPT. According to Windows Central, Microsoft already has this AI chip in the works. Code-named Athena, it is currently being tested internally with the brand’s own teams. The chip is expected to be introduced next year for Microsoft’s Azure AI services.

There is no word on how or when the chip will trickle down to OpenAI and ChatGPT, but the assumption is that it will. The connection comes from the fact that ChatGPT is supported by Azure services. The AI chip might not fully replace Nvidia GPUs, but might help decrease the demand for the hardware, thus reducing the cost of running ChatGPT, Windows Central added.

Editors' Recommendations

Fionna Agomuoh
Fionna Agomuoh is a technology journalist with over a decade of experience writing about various consumer electronics topics…
This powerful ChatGPT feature is back from the dead — with a few key changes
A laptop screen shows the home page for ChatGPT, OpenAI's artificial intelligence chatbot.

ChatGPT has just regained the ability to browse the internet to help you find information. That should (hopefully) help you get more accurate, up-to-date data right when you need it, rather than solely relying on the artificial intelligence (AI) chatbot’s rather outdated training data.

As well as giving straight-up answers to your questions based on info found online, ChatGPT developer OpenAI revealed that the tool will provide a link to its sources so you can check the facts yourself. If it turns out that ChatGPT was wrong or misleading, well, that’s just another one for the chatbot’s long list of missteps.

Read more
ChatGPT’s new upgrade finally breaks the text barrier
A person typing on a laptop that is showing the ChatGPT generative AI website.

OpenAI is rolling out new functionalities for ChatGPT that will allow prompts to be executed with images and voice directives in addition to text.

The AI brand announced on Monday that it will be making these new features available over the next two weeks to ChatGPT Plus and Enterprise users. The voice feature is available in iOS and Android in an opt-in capacity, while the images feature is available on all ChatGPT platforms. OpenAI notes it plans to expand the availability of the images and voice features beyond paid users after the staggered rollout.

Read more
Microsoft Copilot sounds great. Here’s why I definitely won’t use it
Using Windows 11 copilot to summarize a document.

A lot of Microsoft's September event was dedicated to Copilot, Bing Chat, and other AI-driven features. In a way, the updates made to laptops like the Surface Laptop Studio 2 almost felt like an afterthought. It was a real AI fest -- and no wonder, as Microsoft has certainly created something bragworthy.

Despite how impressive Copilot seems to be, I can't see myself actually using it. It's a neat party trick, but my concerns with the AI outweigh any upsides it might have.
AI everywhere

Read more