Skip to main content

ChatGPT tried to pass a college exam and it didn’t go well

Studying to pass your college exams can be a stressful experience, but what if ChatGPT could just write your papers for you? That’s the question posed by researchers at the U.K.’s University of Bath, and their findings might surprise you.

According to a report from the BBC, artificial intelligence (AI) tools like ChatGPT excel at certain tasks. James Fern, a lecturer at the University of Bath, noted that “Multiple choice questions, for example, [ChatGPT] will handle those very well. We definitely were not expecting it to do as well as it did … it was getting close to 100% correct.”

A person studying and writing notes onto a piece of paper. There is a coffee cup and binder in the distance.
Unseen Studio / Unsplash / .

Yet there were tell-tale signs that the paper it produced was not crafted by a human brain. ChatGPT struggled with more complex questions that required a degree of creativity rather than simply regurgitating facts or picking from multiple options.

When answering a question on why it is important to understand the timing of exercise in relation to nutrition status, for instance, ChatGPT slipped up several times. It repeated parts of the question word for word on two occasions, created vague and unattributed statements, and wrote in oversimplified language without being specific.

The chatbot even invented fake academic papers and then cited them in its answer. While the names of the authors and journals were correct, the cited articles simply did not exist, which would be easy for examiners to spot with just a cursory check.

So, while ChatGPT can produce convincing answers in many different contexts, writing your college thesis for you seems to be a step too far for now.

An uncertain future

A MacBook Pro on a desk with ChatGPT's website showing on its display.
Hatice Baran / Unsplash

ChatGPT’s academic future isn’t entirely in tatters, however. Gillian Keegan, the U.K.’s Education Secretary, believes that it is “making a difference in schools and universities already,” and that it could provide assistance to teachers when it comes to lesson planning and marking.

It can also help students get started on tasks and generate ideas that they can then expand upon. While it might not be able to properly answer exam papers, it can at least provide a starting point for further research.

In any case, ChatGPT isn’t going away, and universities and colleges around the world are going to have to adapt to it. It has a lot of potential to improve productivity in the future, and colleges are already teaching students how to use it to improve their output.

But while ChatGPT is unlikely to be awarded a degree any time soon, its potential for misuse is still very real. Apple founder Steve Wozniak has just warned that chatbots could make scams even more realistic, and he was part of a group of prominent tech leaders who signed an open letter in March calling for a pause on further chatbot development. ChatGPT’s future is very much uncertain, but it is no doubt being studied at colleges and universities up and down the land.

Editors' Recommendations

Alex Blake
In ancient times, people like Alex would have been shunned for their nerdy ways and strange opinions on cheese. Today, he…
GPTZero: how to use the ChatGPT detection tool
A MidJourney rendering of a student and his robot friend in front of a blackboard.

In terms of world-changing technologies, ChatGPT has truly made a massive impact on the way people think about writing and coding in the short time that it's been available. Being able to plug in a prompt and get out a stream of almost good enough text is a tempting proposition for many people who aren't confident in their writing skills or are looking to save time. However, this ability has come with a significant downside, particularly in education, where students are tempted to use ChatGPT for their own papers or exams. That prevents them from learning as much as they could, which has given teachers a whole new headache when it comes to detecting AI use.

Teachers and other users are now looking for ways to detect the use of ChatGPT in students' work, and many are turning to tools like GPTZero, a ChatGPT detection tool built by Princeton University student Edward Tian. The software is available to everyone, so if you want to try it out and see the chances that a particular piece of text was written using ChatGPT, here's how you can do that.
What is GPTZero?

Read more
Is ChatGPT safe? Here are the risks to consider before using it
A response from ChatGPT on an Android phone.

For those who have seen ChatGPT in action, you know just how amazing this generative AI tool can be. And if you haven’t seen ChatGPT do its thing, prepare to have your mind blown! 

There’s no doubting the power and performance of OpenAI’s famous chatbot, but is ChatGPT actually safe to use? While tech leaders the world over are concerned over the evolutionary development of AI, these global concerns don’t necessarily translate to an individual user experience. With that being said, let’s take a closer look at ChatGPT to help you hone in on your comfort level.
Privacy and financial leaks
In at least one instance, chat history between users was mixed up. On March 20, 2023, ChatGPT creator OpenAI discovered a problem, and ChatGPT was down for several hours. Around that time, a few ChatGPT users saw the conversation history of other people instead of their own. Possibly more concerning was the news that payment-related information from ChatGPT-Plus subscribers might have leaked as well.

Read more
What is ChatGPT Plus? Here’s what to know before you subscribe
Close up of ChatGPT and OpenAI logo.

ChatGPT is completely free to use, but that doesn't mean OpenAI isn't also interested in making some money.

ChatGPT Plus is a subscription model that gives you access to a completely different service based on the GPT-4 model, along with faster speeds, more reliability, and first access to new features. Beyond that, it also opens up the ability to use ChatGPT plug-ins, create custom chatbots, use DALL-E 3 image generation, and much more.
What is ChatGPT Plus?
Like the standard version of ChatGPT, ChatGPT Plus is an AI chatbot, and it offers a highly accurate machine learning assistant that's able to carry out natural language "chats." This is the latest version of the chatbot that's currently available.

Read more