Skip to main content

ChatGPT agrees: it shouldn’t write the articles you read

AI is taking the media world by storm, and that’s not an exaggeration. This week, it was revealed that CNET and the venture capital firm that owns it, Red Ventures, have been using AI to generate content across the various brands it owns.

The story picked up, and journalists uncovered that these AI-generated articles were littered with inaccuracies and often incorrectly attributed to human writers. There’s a moral and philosophical question about AI generating content that mimics a human, but I wanted to go to the source and ask AI what it thought about writing articles. Its own response to the ethical dilemma shows that it’s not as confident in its own technology as some companies are.

ChatGPT says no

ChatGPT and OpenAI logos.
Image used with permission by copyright holder

Before getting into the responses, all AI-generated content in this article will be in quotes, separated into its own paragraph, and include a note that it was generated by ChatGPT. Everything else comes from me.

ChatGPT is the forerunner in the world of AI chatbots right now, so I started off by asking it to react to CNET using AI in particular:

“I am an AI model, so I do not have personal opinions. However, I can tell you that using AI to generate articles can be a useful tool for media companies, as it can save time and resources. However, the quality and accuracy of the generated articles will depend on the data and algorithms used. It is important for media companies to have a process in place for fact-checking and editing the content generated by AI to ensure accuracy and integrity.” (Generated by ChatGPT).

That seems straightforward enough, and it mirrors the process that CNET has taken toward its AI-generated articles. Even if the fact-checking policy isn’t up to snuff, CNET still insists that its articles are reviewed and fact-checked by human editors. But I posed the more general question of “should ChatGPT be used to write articles” and got a slightly more detailed response:

“ChatGPT and other language models like it can be a useful tool for generating written content, but it should not be used as the sole source for creating articles. The quality and accuracy of the content generated by a language model like ChatGPT will depend on the data and algorithms used, and it is important to have a process in place for fact-checking and editing the content generated by the model to ensure accuracy and integrity.

It is also important to note that while ChatGPT can generate text that is coherent and grammatically correct, it may lack the depth and nuance that human writers bring to their work. It may also not be able to fully understand and interpret complex and nuanced information.

In summary, ChatGPT can be used as a tool to assist in the writing process, but it should not be used to replace human writers. It’s important to have human oversight and editing to ensure the accuracy and integrity of the content generated.” (Generated by ChatGPT).

That sounds fairly self-aware — an admission that ChatGPT itself lacks the nuance and depth to write articles on its own. But I had a feeling there was more missing than just nuance. After all, AI-generated content also lacks context, and that’s what I wanted to test out for myself.

Lacking nuance

Shutterstock

In the case of CNET, the AI was being used to generate content surrounding credit cards, which is a topic that needs a lot of context in 2023. Interest rates are continuing to rise, and job growth is slowing. There’s an ethical dilemma around these finance topics that AI can’t account for and react to. Or, at the very least, AI can’t bring human empathy that opening a new line of credit might not be the best idea under certain circumstances.

But I’m not a finance writer, so I might not even spot some of the mishandling of that context. I am, however, an expert in gaming PCs and graphics cards — so in theory, I should be able to spot that missing nuance and context from ChatGPT’s answers. To start off, I asked ChatGPT if AMD or Nvidia was better, and here’s what I got:

“The choice between an Nvidia or AMD graphics card depends on your specific needs and budget. Both companies offer a range of graphics card options that vary in terms of performance, price, and features.

“Nvidia graphics cards are known for their excellent performance in gaming and professional applications such as video editing, 3D rendering, and AI development. They also have a wide range of features such as ray tracing, which is a technology that provides more realistic lighting and shadows, and DLSS (Deep Learning Super Sampling) which improves the performance in games.

“AMD graphics cards, on the other hand, are known for their excellent value for money. They often offer similar or even better performance than Nvidia cards at a lower price point. They also have a feature called FreeSync which helps to reduce screen tearing and stuttering in games.

“When making your decision, it’s important to consider the specific needs of your application. If gaming is your primary focus, Nvidia graphics cards may be the better choice due to their excellent gaming performance and features. If you’re looking for a more budget-friendly option or want to use the card for other applications such as video editing, AMD graphics cards may be a better choice.

“It’s also important to check the compatibility of the card with your computer’s power supply and motherboard, and the supported resolution and refresh rate of your monitor. It’s always recommended to check the benchmarks, reviews and technical specifications of the models you are considering before making a purchase.” (Generated by ChatGPT).

Two AMD Radeon RX 7000 graphics cards on a pink surface.
Jacob Roach / Digital Trends

At first blush, the response doesn’t seem too bad. Nvidia cards are more powerful overall, but AMD cards offer a better value. The devil is in the details here, though. For example, ChatGPT recommends an AMD graphics card for video editing and an Nvidia graphics card solely for gaming. The opposite is true, with Nvidia graphics cards vastly speeding up video editing workflows compared to AMD (a fact that ChatGPT even highlighted in the second paragraph of its response).

There are some critical elements missing, too. The response would lead you to believe that Nvidia graphics cards are the only ones that support ray tracing. On the other end, it fails to mention G-Sync or the VESA Adaptive Sync standard, leading you to believe that FreeSync is an exclusive feature for AMD graphics cards.

Perhaps that’s the nuance ChatGPT admits it lacks. And sure, you can see the bones of something accurate here and prod the copy into a more usable state. Still, it’s important to remember that none of this comes from a human, and the AI doesn’t care about inaccuracies (or anything, for that matter). It’s OK to be wrong, and I don’t want advice from a source that’s willing to do that.

ChatGPT AI bot running a phone.
Shutterstock

To drive this point home, I asked ChatGPT a final question about if the AMD RX 7900 XT or RTX 4080 was better:

“As of 2021, the RTX 3080 is currently considered a better overall graphics card than the AMD RX 7900 XT. The RTX 3080 offers better performance in most benchmarks and games, and also has support for newer technology such as ray tracing and DLSS. However, the RX 7900 XT is also a very powerful graphics card and may be a better choice for certain specific use cases or scenarios. Ultimately, the best choice for you will depend on your specific needs and budget.” (Generated by ChatGPT).

Bluntly, that’s an asinine response — you can read our human-written best graphics cards roundup for context. But my point is that it’s not enough for an editor to go in and tweak some of the wording or fact-check a couple of claims. To the average person, it might sound sensible and well-written — but to someone knowledgeable on the topic, the reasoning and logic behind its answers are entirely unfounded. But hey, I’d expect no more from content generated by AI.

Editors' Recommendations

Jacob Roach
Senior Staff Writer, Computing
Jacob Roach is a writer covering computing and gaming at Digital Trends. After realizing Crysis wouldn't run on a laptop, he…
This app just got me excited for the future of AI on Macs
The ChatGPT website on a laptop's screen as the laptop sits on a counter in front of a black background.

In a year where virtually every tech company in existence is talking about AI, Apple has been silent. That doesn't mean Apple-focused developers aren't taking matters into their own hands, though. An update to the the popular Mac writing app iA Writer just made me really excited about seeing what Apple's eventual take on AI will be.

In the iA Writer 7 update, you’ll be able to use text generated by ChatGPT as a starting point for your own words. The idea is that you get ideas from ChatGPT, then tweak its output by adding your distinct flavor to the text, making it your own in the process. Most apps that use generative AI do so in a way that basically hands the reins over to the artificial intelligence, such as an email client that writes messages for you or a collaboration tool that summarizes your meetings.

Read more
One year ago, ChatGPT started a revolution
The ChatGPT website on a laptop's screen as the laptop sits on a counter in front of a black background.

Exactly one year ago, OpenAI put a simple little web app online called ChatGPT. It wasn't the first publicly available AI chatbot on the internet, and it also wasn't the first large language model. But over the following few months, it would grow into one of the biggest tech phenomenons in recent memory.

Thanks to how precise and natural its language abilities were, people were quick to shout that the sky was falling and that sentient artificial intelligence had arrived to consume us all. Or, the opposite side, which puts its hope for humanity within the walls of OpenAI. The debate between these polar extremes has continued to rage up until today, punctuated by the drama at OpenAI and the series of conspiracy theories that have been proposed as an explanation.

Read more
Here’s why people are saying GPT-4 is getting ‘lazy’
OpenAI announced its latest iteration of ChatGPT with greater accuracy and creativity.

OpenAI and its technologies have been in the midst of scandal for most of November. Between the swift firing and rehiring of CEO Sam Altman and the curious case of the halted ChatGPT Plus paid subscriptions, OpenAI has kept the artificial intelligence industry in the news for weeks.

Now, AI enthusiasts have rehashed an issue that has many wondering whether GPT-4 is getting "lazier" as the language model continues to be trained. Many who use it speed up more intensive tasks have taken to X (formerly Twitter) to air their grievances about the perceived changes.

Read more