Skip to main content

Investigation exposes murkier side of ChatGPT and the AI chatbot industry

A Time investigation has exposed the murkier side of the AI chatbot industry, highlighting how at least one startup has been using questionable practices to improve its technology.

Published on Wednesday, Time’s report focuses on Microsoft-backed OpenAI and its ChatGPT chatbot, a technology that’s gained much attention recently for its remarkable ability to produce highly natural conversational text.

Time’s probe found that to train the AI technology, OpenAI used the services of a team in Kenya to pore over text that included disturbing subject matter such as child sexual abuse, bestiality, murder, suicide, torture, self-harm, and incest. And for their efforts to label the abhorrent content, many on the team received less than $2 an hour.

The work, which started in November 2021, was necessary as ChatGPT’s predecessor, GPT-3, while impressive, had a tendency to spew out offensive content as its training dataset had been compiled by scraping hundreds of billions of words from all corners of the web.

The Kenya-based team, operated by San Francisco firm Sama, would label the offensive content to help train OpenAI’s chatbot, thereby improving its dataset and reducing the chances of any objectionable output.

Time said that all four of the Sama employees that it interviewed described being mentally scarred by their work. Sama offered counseling sessions, but the employees said they were ineffective and rarely took place due to the demands of the job, though a Sama spokesperson told Time that the therapists were accessible at any time.

One worker told Time that reading the shocking material sometimes felt like “torture,” adding that they felt “disturbed” by the end of the week.

In February 2022, things took an even darker turn for Sama when OpenAI launched a separate project unrelated to ChatGPT that required its Kenya team to collect images of a sexual and violent nature. OpenAI told Time that the work was necessary for making its AI tools safer.

Within weeks of this image-based project starting, the alarming nature of the tasks prompted Sama to cancel all of its contracts with OpenAI, though Time suggests it could also have been prompted by the PR fallout from a report on a similar subject matter that it published about Facebook at around the same time.

Open AI told Time there had been “a miscommunication” about the nature of the imagery that it asked Sama to collect, insisting that it had not asked for the most extreme imagery, and had not viewed any that it had been sent.

But ending the contracts impacted the workers’ livelihoods, with some of the team in Kenya losing their jobs, while others were moved onto lower-paying projects.

Time’s investigation offers an uncomfortable but important look at the kind of work that’s going into the AI-powered chatbots that have recently been getting the tech industry so excited.

While transformative and potentially beneficial, the technology clearly comes at a human cost and throws up a slew of ethical questions about how companies go about developing their new technologies, and more broadly about how wealthier countries continue to farm out less desirable tasks to poorer nations for a lower financial outlay.

The startups behind the tech will come under more focused scrutiny in the coming months and years, and so they would do well to review and improve their practices at the earliest opportunity.

Digital Trends has reached out to OpenAI for comment on Time’s report and we will update this article when we hear back.

Editors' Recommendations

Trevor Mogg
Contributing Editor
Not so many moons ago, Trevor moved from one tea-loving island nation that drives on the left (Britain) to another (Japan)…
GPT-4: how to use the AI chatbot that puts ChatGPT to shame
A laptop opened to the ChatGPT website.

People were in awe when ChatGPT came out, impressed by its natural language abilities as an AI chatbot. But when the highly anticipated GPT-4 large language model came out, it blew the lid off what we thought was possible with AI, with some calling it the early glimpses of AGI (artificial general intelligence).

The creator of the model, OpenAI, calls it the company's "most advanced system, producing safer and more useful responses." Here's everything you need to know about it, including how to use it and what it can do.
What is GPT-4?
GPT-4 is a new language model created by OpenAI that can generate text that is similar to human speech. It advances the technology used by ChatGPT, which is currently based on GPT-3.5. GPT is the acronym for Generative Pre-trained Transformer, a deep learning technology that uses artificial neural networks to write like a human.

Read more
Zoom adds ChatGPT to help you catch up on missed calls
A person conducting a Zoom call on a laptop while sat at a desk.

The Zoom video-calling app has just added its own “AI Companion” assistant that integrates artificial intelligence (AI) and large language models (LLMs) from ChatGPT maker OpenAI and Facebook owner Meta. The tool is designed to help you catch up on meetings you missed and devise quick responses to chat messages.

Zoom’s developer says the AI Companion “empowers individuals by helping them be more productive, connect and collaborate with teammates, and improve their skills.”

Read more
ChatGPT is violating your privacy, says major GDPR complaint
ChatGPT app running on an iPhone.

Ever since the first generative artificial intelligence (AI) tools exploded onto the tech scene, there have been questions over where they’re getting their data and whether they’re harvesting your private data to train their products. Now, ChatGPT maker OpenAI could be in hot water for exactly these reasons.

According to TechCrunch, a complaint has been filed with the Polish Office for Personal Data Protection alleging that ChatGPT violates a large number of rules found in the European Union’s General Data Protection Regulation (GDPR). It suggests that OpenAI’s tool has been scooping up user data in all sorts of questionable ways.

Read more