Stay up to date with notifications from The Independent

Notifications can be managed in browser preferences.

How teachers can tell if a student has used ChatGPT in an essay

Researchers compared essays written by three first-year undergraduate students, with the aid of ChatGPT, with 164 essays written by IGCSE students

Eleanor Busby
Thursday 28 March 2024 06:17 EDT
Comments
Related video: Boost your productivity with these 8 ChatGPT commands

Your support helps us to tell the story

From reproductive rights to climate change to Big Tech, The Independent is on the ground when the story is developing. Whether it's investigating the financials of Elon Musk's pro-Trump PAC or producing our latest documentary, 'The A Word', which shines a light on the American women fighting for reproductive rights, we know how important it is to parse out the facts from the messaging.

At such a critical moment in US history, we need reporters on the ground. Your donation allows us to keep sending journalists to speak to both sides of the story.

The Independent is trusted by Americans across the entire political spectrum. And unlike many other quality news outlets, we choose not to lock Americans out of our reporting and analysis with paywalls. We believe quality journalism should be available to everyone, paid for by those who can afford it.

Your support makes all the difference.

Experts have revealed the tell-tale signs that an essay has been written by ChatGPT and not a student.

It comes after the rise of generative AI tools, like ChatGPT, has sparked concerns about cheating among pupils in the education sector.

Repetition of words, tautology and paragraphs starting with “however” are some tell-tale features, researchers said.

The writing style of the artificial intelligence tool is “bland” and “journalistic”, according to a Cambridge University Press and Assessment study.

Researchers compared essays written by three first-year undergraduate students, with the aid of ChatGPT, with 164 essays written by IGCSE students.

These essays were marked by examiners and the undergraduates were then interviewed and their essays were analysed.

The study found essays written with the help of ChatGPT performed poorly on analysis and comparison skills compared to non-ChatGPT-assisted essays.

But ChatGPT-assisted essays performed strongly on information and reflection skills.

Researchers identified a number of key features of the ChatGPT writing style, which included the use of Latinate vocabulary, repetition of words or phrases and ideas, and pleonasms.

Researchers identified a number of key features of the ChatGPT writing style
Researchers identified a number of key features of the ChatGPT writing style (Copyright 2022 The Associated Press. All rights reserved.)

Essays written with the help of ChatGPT were also more likely to use paragraphs starting with discourse markers like “however”, “moreover”, and “overall”, and numbered lists with items.

The researchers said ChatGPT’s default writing style “echoes the bland, clipped, and objective style that characterises much generic journalistic writing found on the internet”.

The report said: “The students found ChatGPT useful for gathering information quickly.

“However, they considered that complete reliance on this technology would produce essays of a low academic standard.”

Lead researcher Jude Brady, of Cambridge University Press and Assessment, said: “Our findings offer insights into the growing area of generative AI and assessment, which is still largely uncharted territory.

“Despite the small sample size, we are excited about these findings as they have the capacity to inform the work of teachers as well as students.”

She added: “We hope our research might help people to identify when a piece of text has been written by ChatGPT.

“For students and the wider population, learning to use and detect generative AI forms an increasingly important aspect of digital literacy.”

Join our commenting forum

Join thought-provoking conversations, follow other Independent readers and see their replies

Comments

Thank you for registering

Please refresh the page or navigate to another page on the site to be automatically logged inPlease refresh your browser to be logged in