Skip to main content

Microsoft may have ignored warnings about Bing Chat’s unhinged responses

Microsoft’s Bing Chat is in a much better place than it was when it released in February, but it’s hard to overlook the issues the GPT-4-powered chatbot had when it released. It told us it wanted to be human, after all, and often broke down into unhinged responses. And according to a new report, Microsoft was warned about these types of responses and decided to release Bing Chat anyway.

According to the Wall Street Journal, OpenAI, the company behind ChatGPT and the GPT-4 model powering Bing Chat, warned Microsoft about integrating its early AI model into Bing Chat. Specifically, OpenAI flagged “inaccurate or bizarre” responses, which Microsoft seems to have ignored.

Bing Chat saying it wants to be human.
Jacob Roach / Digital Trends

The report describes a unique tension between OpenAI and Microsoft, which have entered into somewhat of an open partnership over the last few years. OpenAI’s models are built on Microsoft hardware (including thousands of Nvidia GPUs), and Microsoft leverages the company’s tech across Bing, Microsoft Office, and Windows itself. In early 2023, Microsoft even invested $10 billion in OpenAI, coming just short of purchasing the company outright.

Recommended Videos

Despite this, the report alleges that Microsoft employees have issues with restricted access to OpenAI’s models, and that they were worried about ChatGPT overshadowing the AI-inundated Bing Chat. To make matters worse, the Wall Street Journal reports that OpenAI and Microsoft both sell OpenAI’s technology, leading to situations where vendors are dealing with contacts at both companies.

Please enable Javascript to view this content

The biggest issue, according to the report, is that Microsoft and OpenAI are trying to make money with a similar product. With Microsoft backing, but not controlling OpenAI, the ChatGPT developer is free to make partnerships with other companies, some of which can directly compete with Microsoft’s products.

Based on what we’ve seen, OpenAI’s reported warnings held water. Shortly after releasing Bing Chat, Microsoft limited the number of responses users could receive in a single session. And since then, Microsoft has slowly lifted the restriction as the GPT-4 model in Bing Chat is refined. Reports suggest some Microsoft employees often reference “Sydney,” poking fun at the early days of Bing Chat (code-named Sydney) and its responses.

Jacob Roach
Former Digital Trends Contributor
Jacob Roach is the lead reporter for PC hardware at Digital Trends. In addition to covering the latest PC components, from…
Check out Meta’s not-so-cunning plan to take on ChatGPT
Meta AI logo.

Meta wants a piece of the pie -- a big piece -- when it comes to generative AI. As part of its long-term strategy to embed itself in every part of our lives, the Mark Zuckerberg-led company is planning to launch its Meta AI chatbot as a standalone app, CNBC reported on Thursday, citing unnamed sources claiming to have knowledge of the matter.

Meta is aiming to launch the AI chatbot app between April and June this year, the sources said. The company may also offer a subscription model with more advanced features.

Read more
OpenAI cracks down on ChatGPT scammers
ChatGPT logo on a phone

OpenAI has made it clear that its flagship AI service, ChatGPT is not intended for malicious use.

The company has released a report detailing that it has observed the trends of bad actors using its platform as it becomes more popular. OpenAI indicated it has removed dozens of accounts on the suspicion of using ChatGPT in unauthorized ways, such as for "debugging code to generating content for publication on various distribution platforms."

Read more
Microsoft prepares for major GPT-5 updates from OpenAI
OpenAI's Mira Murati introduces GPT-4o.

Microsoft is set to get a major AI update and is preparing its server capacity to support the next iteration of OpenAI’s models. As OpenAI CEO, Sam Altman has previously indicated the brand will soon release the GPT-4.5 large language model in the coming weeks, the Verge has reported that the new model could be available “as early as next week.”

As with other technology advancements, OpenAI has made claims of GPT-4.5 being significantly more powerful than its prior version, GPT-4. The model, codenamed Orion, is set to be OpenAI’s last “non-chain-of-thought model.” Also indicating the coming launch of GPT-5 flagship model with major updates to its functionality, will also affect how partners, such as Microsoft incorporate the technology as well.

Read more