Skip to main content

Investigation exposes murkier side of ChatGPT and the AI chatbot industry

A Time investigation has exposed the murkier side of the AI chatbot industry, highlighting how at least one startup has been using questionable practices to improve its technology.

Published on Wednesday, Time’s report focuses on Microsoft-backed OpenAI and its ChatGPT chatbot, a technology that’s gained much attention recently for its remarkable ability to produce highly natural conversational text.

Recommended Videos

Time’s probe found that to train the AI technology, OpenAI used the services of a team in Kenya to pore over text that included disturbing subject matter such as child sexual abuse, bestiality, murder, suicide, torture, self-harm, and incest. And for their efforts to label the abhorrent content, many on the team received less than $2 an hour.

The work, which started in November 2021, was necessary as ChatGPT’s predecessor, GPT-3, while impressive, had a tendency to spew out offensive content as its training dataset had been compiled by scraping hundreds of billions of words from all corners of the web.

The Kenya-based team, operated by San Francisco firm Sama, would label the offensive content to help train OpenAI’s chatbot, thereby improving its dataset and reducing the chances of any objectionable output.

Time said that all four of the Sama employees that it interviewed described being mentally scarred by their work. Sama offered counseling sessions, but the employees said they were ineffective and rarely took place due to the demands of the job, though a Sama spokesperson told Time that the therapists were accessible at any time.

One worker told Time that reading the shocking material sometimes felt like “torture,” adding that they felt “disturbed” by the end of the week.

In February 2022, things took an even darker turn for Sama when OpenAI launched a separate project unrelated to ChatGPT that required its Kenya team to collect images of a sexual and violent nature. OpenAI told Time that the work was necessary for making its AI tools safer.

Within weeks of this image-based project starting, the alarming nature of the tasks prompted Sama to cancel all of its contracts with OpenAI, though Time suggests it could also have been prompted by the PR fallout from a report on a similar subject matter that it published about Facebook at around the same time.

Open AI told Time there had been “a miscommunication” about the nature of the imagery that it asked Sama to collect, insisting that it had not asked for the most extreme imagery, and had not viewed any that it had been sent.

But ending the contracts impacted the workers’ livelihoods, with some of the team in Kenya losing their jobs, while others were moved onto lower-paying projects.

Time’s investigation offers an uncomfortable but important look at the kind of work that’s going into the AI-powered chatbots that have recently been getting the tech industry so excited.

While transformative and potentially beneficial, the technology clearly comes at a human cost and throws up a slew of ethical questions about how companies go about developing their new technologies, and more broadly about how wealthier countries continue to farm out less desirable tasks to poorer nations for a lower financial outlay.

The startups behind the tech will come under more focused scrutiny in the coming months and years, and so they would do well to review and improve their practices at the earliest opportunity.

Digital Trends has reached out to OpenAI for comment on Time’s report and we will update this article when we hear back.

Trevor Mogg
Contributing Editor
Not so many moons ago, Trevor moved from one tea-loving island nation that drives on the left (Britain) to another (Japan)…
Mountainhead creator says he ‘scraped AI companies back’ to make his movie
A group of four men pose for a photo on a mountain.

Mountainhead writer and director Jesse Armstrong has said he’s “pretty sure that the AI companies have been scraping my material along with everyone else’s to train their large language models,” and that to find the right voices for the movie’s tech-bro characters, “I’ve been scraping them back.” 

Mountainhead, which lands on HBO this weekend, is a dark satire about a group of tech billionaires who retreat to a secluded mountain lodge during a global crisis --  a crisis that’s exacerbated by their own creations, including highly convincing AI-generated deepfakes and a social media platform that fuels misinformation and instability.

Read more
Can AI really replace your keyboard and mouse?
Gemini Live on a phone atop a keyboard.

“Hey ChatGPT, left-click on the enter password field in the pop-up window appearing in the lower left quadrant of the screen and fill XUS&(#($J, and press Enter.” 

Fun, eh? No, thanks. I'll just move my cheap mouse and type the 12 characters on my needlessly clicky keyboard, instead of speaking the password out loud in my co-working space.

Read more
I tested Gemini Advanced, ChatGPT, and Copilot Pro. Here’s which AI searched best
ChatGPT logo on a phone

With AI chatbots now built into search engines, browsers, and even your desktop, it's easy to assume they all do the same thing. But when it comes to getting useful search results, some outperform the rest.

I wanted to test Gemini Advanced, ChatGPT, and Copilot Pro head-to-head to see which one helps you get answers faster and more accurately. These are the paid versions, all promising live web access, smarter context, and fewer hallucinations.

Read more