Skip to main content

You won’t believe how much ChatGPT costs to operate

A new report claims to know how much ChatGPT costs to run per day, including how much each query approximately costs. The popular text-to-speech chatbot might have set off an AI revolution in November 2022, but has proven extremely expensive to maintain.

The new report comes from Dylan Patel, chief analyst at the research firm SemiAnalysis, who says it costs approximately $700,000 per day, or 36 cents per query, to keep the chatbot up and running.

It’s so expensive, in fact, that Microsoft might be developing its own proprietary AI chips to assist in the maintenance of OpenAI’s operation of ChatGPT, according to Windows Central.

The ChatGPT website on a laptop's screen as the laptop sits on a counter in front of a black background.
Airam Dato-on/Pexels / Pexels

In addition to quickly hitting a 100 million active users in January, a feat that previously took tech brands years to achieve, ChatGPT has struggled with high traffic and capacity issues slowing down and crashing its servers. The company attempted to remedy this by introducing a paid ChatGPT Plus tier, which costs $20 per month, however, there is no word on how many users subscribe to the paid option.

OpenAI currently uses Nvidia GPUs to maintain not only its own ChatGPT processes, but also those of the brands with which it partners. Industry analysts expect the company will likely require an additional 30,000 GPUs from Nvidia to maintain its commercial performance for the remainder of 2023 alone.

With Microsoft as one of its primary collaborators and investors, OpenAI might be looking at the tech brand to assist in developing hardware to bring down the cost of operations for ChatGPT. According to Windows Central, Microsoft already has this AI chip in the works. Code-named Athena, it is currently being tested internally with the brand’s own teams. The chip is expected to be introduced next year for Microsoft’s Azure AI services.

There is no word on how or when the chip will trickle down to OpenAI and ChatGPT, but the assumption is that it will. The connection comes from the fact that ChatGPT is supported by Azure services. The AI chip might not fully replace Nvidia GPUs, but might help decrease the demand for the hardware, thus reducing the cost of running ChatGPT, Windows Central added.

Editors' Recommendations

Fionna Agomuoh
Fionna Agomuoh is a technology journalist with over a decade of experience writing about various consumer electronics topics…
The best custom GPTs to make ChatGPT even more powerful
A person typing on a laptop that is showing the ChatGPT generative AI website.

The introduction of Custom GPTs was one of the most exciting additions to ChatGPT in recent months. These allow you to craft custom chatbots with their own instructions and data by feeding them documents, weblinks, and more to make sure they know what you need and respond how you would like them to.

But you don't have to make your own Custom GPT if you don't want to. Indeed, there are tens of thousands of Custom GPTs already made by engineers around the world, and many of them are very impressive.

Read more
I used ChatGPT to help me make my first game. Don’t make the same mistakes I did
A person typing on a laptop that is showing the ChatGPT generative AI website.

Alongside writing articles about ChatGPT, coming to terms with AI chatbot has been a major mission of mine for the past year. I've found it useful for coming up with recipe ideas from a list of ingredients, writing fun alternate history ideas, and answering board game rules clarifications. But I wanted to see if it could do something more impressive: teach me how to make a game.
The first hurdle
I've wanted to make a game for a while now. I programmed a bunch of basic Flash games when I was a kid -- if you can find my Newgrounds profile, you can have a good laugh at them -- but I've had a few ideas ticking in my mind that have calcified into thoughts that will not shift. I need to make them someday and maybe someday is now.

But knowing how to start making a game isn't easy. I didn't really know what kind of game I was trying to make, or what engine I should use, or how you actually start making a game. Until recently, I just hadn't done it. I'd downloaded Unity once, became intimidated, and uninstalled it.

Read more
This one image breaks ChatGPT each and every time
A laptop screen shows the home page for ChatGPT, OpenAI's artificial intelligence chatbot.

Sending images as prompts to ChatGPT is still a fairly new feature, but in my own testing, it works fine most of the time. However, someone's just found an image that ChatGPT can't seem to handle, and it's definitely not what you expect.

The image, spotted by brandon_xyzw on X (formerly Twitter), presents some digital noise. It's nothing special, really -- just a black background with some vertical lines all over it. But if you try to show it to ChatGPT, the image breaks the chatbot each and every time, without fail.

Read more