Skip to main content

ChatGPT tried to pass a college exam and it didn’t go well

Studying to pass your college exams can be a stressful experience, but what if ChatGPT could just write your papers for you? That’s the question posed by researchers at the U.K.’s University of Bath, and their findings might surprise you.

According to a report from the BBC, artificial intelligence (AI) tools like ChatGPT excel at certain tasks. James Fern, a lecturer at the University of Bath, noted that “Multiple choice questions, for example, [ChatGPT] will handle those very well. We definitely were not expecting it to do as well as it did … it was getting close to 100% correct.”

A person studying and writing notes onto a piece of paper. There is a coffee cup and binder in the distance.
Unseen Studio / Unsplash / .

Yet there were tell-tale signs that the paper it produced was not crafted by a human brain. ChatGPT struggled with more complex questions that required a degree of creativity rather than simply regurgitating facts or picking from multiple options.

When answering a question on why it is important to understand the timing of exercise in relation to nutrition status, for instance, ChatGPT slipped up several times. It repeated parts of the question word for word on two occasions, created vague and unattributed statements, and wrote in oversimplified language without being specific.

The chatbot even invented fake academic papers and then cited them in its answer. While the names of the authors and journals were correct, the cited articles simply did not exist, which would be easy for examiners to spot with just a cursory check.

So, while ChatGPT can produce convincing answers in many different contexts, writing your college thesis for you seems to be a step too far for now.

An uncertain future

A MacBook Pro on a desk with ChatGPT's website showing on its display.
Hatice Baran / Unsplash

ChatGPT’s academic future isn’t entirely in tatters, however. Gillian Keegan, the U.K.’s Education Secretary, believes that it is “making a difference in schools and universities already,” and that it could provide assistance to teachers when it comes to lesson planning and marking.

It can also help students get started on tasks and generate ideas that they can then expand upon. While it might not be able to properly answer exam papers, it can at least provide a starting point for further research.

In any case, ChatGPT isn’t going away, and universities and colleges around the world are going to have to adapt to it. It has a lot of potential to improve productivity in the future, and colleges are already teaching students how to use it to improve their output.

But while ChatGPT is unlikely to be awarded a degree any time soon, its potential for misuse is still very real. Apple founder Steve Wozniak has just warned that chatbots could make scams even more realistic, and he was part of a group of prominent tech leaders who signed an open letter in March calling for a pause on further chatbot development. ChatGPT’s future is very much uncertain, but it is no doubt being studied at colleges and universities up and down the land.

Editors' Recommendations

Alex Blake
In ancient times, people like Alex would have been shunned for their nerdy ways and strange opinions on cheese. Today, he…
How much does an AI supercomputer cost? Try $100 billion
A Microsoft datacenter.

It looks like OpenAI's ChatGPT and Sora, among other projects, are about to get a lot more juice. According to a new report shared by The Information, Microsoft and OpenAI are working on a new data center project, one part of which will be a massive AI supercomputer dubbed "Stargate." Microsoft is said to be footing the bill, and the cost is astronomical as the name of the supercomputer suggests -- the whole project might cost over $100 billion.

Spending over $100 billion on anything is mind-blowing, but when put into perspective, the price truly shows just how big a venture this might be: The Information claims that the new Microsoft and OpenAI joint project might cost a whopping 100 times more than some of the largest data centers currently in operation.

Read more
We may have just learned how Apple will compete with ChatGPT
An iPhone on a table with the Siri activation animation playing on the screen.

As we approach Apple’s Worldwide Developers Conference (WWDC) in June, the rumor mill has been abuzz with claims over Apple’s future artificial intelligence (AI) plans. Well, there have just been a couple of major developments that shed some light on what Apple could eventually reveal to the world, and you might be surprised at what Apple is apparently working on.

According to Bloomberg, Apple is in talks with Google to infuse its Gemini generative AI tool into Apple’s systems and has also considered enlisting ChatGPT’s help instead. The move with Google has the potential to completely change how the Mac, iPhone, and other Apple devices work on a day-to-day basis, but it could come under severe regulatory scrutiny.

Read more
Copilot: how to use Microsoft’s own version of ChatGPT
Microsoft's AI Copilot being used in various Microsoft Office apps.

ChatGPT isn’t the only AI chatbot in town. One direct competitor is Microsoft’s Copilot (formerly Bing Chat), and if you’ve never used it before, you should definitely give it a try. As part of a greater suite of Microsoft tools, Copilot can be integrated into your smartphone, tablet, and desktop experience, thanks to a Copilot sidebar in Microsoft Edge. 

Like any good AI chatbot, Copilot’s abilities are constantly evolving, so you can always expect something new from this generative learning professional. Today though, we’re giving a crash course on where to find Copilot, how to download it, and how you can use the amazing bot. 
How to get Microsoft Copilot
Microsoft Copilot comes to Bing and Edge. Microsoft

Read more