Stay up to date with notifications from The Independent

Notifications can be managed in browser preferences.

Artificial intelligence may help trainee teachers with assessments – study

Researchers said AI could be an “effective substitute” when personal feedback is not immediately available

Sam Russell
Sunday 10 April 2022 21:45 EDT
A teacher writes on a whiteboard to explain William Shakespeare’s Romeo & Juliet during an English lesson. Now AI could help trainee teachers identify struggling students, say researchers (Ben Birchall/PA)
A teacher writes on a whiteboard to explain William Shakespeare’s Romeo & Juliet during an English lesson. Now AI could help trainee teachers identify struggling students, say researchers (Ben Birchall/PA) (PA Archive)

Your support helps us to tell the story

From reproductive rights to climate change to Big Tech, The Independent is on the ground when the story is developing. Whether it's investigating the financials of Elon Musk's pro-Trump PAC or producing our latest documentary, 'The A Word', which shines a light on the American women fighting for reproductive rights, we know how important it is to parse out the facts from the messaging.

At such a critical moment in US history, we need reporters on the ground. Your donation allows us to keep sending journalists to speak to both sides of the story.

The Independent is trusted by Americans across the entire political spectrum. And unlike many other quality news outlets, we choose not to lock Americans out of our reporting and analysis with paywalls. We believe quality journalism should be available to everyone, paid for by those who can afford it.

Your support makes all the difference.

Artificial intelligence (AI) could be used to mark the work of trainee teachers who are trying to identify pupils with potential learning difficulties, a study suggests.

Researchers said it could be an “effective substitute” when personal feedback is not readily available.

In a trial, 178 German trainee teachers were asked to assess six fictionalised pupils to decide whether they had learning difficulties such as dyslexia or Attention Deficit Hyperactivity Disorder (ADHD), and to explain their reasoning.

They were given examples of their schoolwork, as well as other information such as behaviour records and transcriptions of conversations with parents.

It does seem that AI-generated feedback helped these trainees to focus on what they really needed to learn

Dr Michael Sailer, LMU Munich

Immediately after submitting their answers, half of the trainees received a prototype ‘expert solution’, written in advance by a qualified professional, to compare with their own.

This is typical of the practice material that German trainee teachers usually receive outside taught classes.

The others received AI-generated feedback, which highlighted the correct parts of their solution and flagged aspects they might have improved.

The tests were scored by researchers, who assessed both their diagnostic accuracy – whether the trainees had correctly identified cases of dyslexia or ADHD – and their diagnostic reasoning: how well they had used the available evidence to make this judgement.

The average score for diagnostic reasoning among trainees who had received AI feedback during the six preliminary exercises was an estimated 10 percentage points higher than those who had worked with the pre-written expert solutions.

The reason for this may be the ‘adaptive’ nature of the AI, according to the study, led by academics at Cambridge University and Ludwig Maximilian University in Munich

Because it analysed the trainee teachers’ own work, rather than asking them to compare it with an expert version, the researchers believe the feedback was clearer.

There is no evidence, therefore, that AI of this type would improve on one-to-one feedback from a human tutor or high-quality mentor, but if such close support was not readily available, it could have benefits, particularly for trainees on larger courses.

Dr Michael Sailer, from LMU Munich, said: “Obviously we are not arguing that AI should replace teacher-educators: new teachers still need expert guidance on how to recognise learning difficulties in the first place.

“It does seem, however, that AI-generated feedback helped these trainees to focus on what they really needed to learn.

“Where personal feedback is not readily available, it could be an effective substitute.”

The study used a system capable of analysing human language and spotting certain phrases, ideas, hypotheses or evaluations in the trainees’ text.

Teachers play a critical role in recognising the signs of disorders and learning difficulties in pupils and referring them to specialists

Riikka Hofmann, Cambridge University

It was created using the responses of an earlier cohort of pre-service teachers to a similar exercise.

By segmenting and coding these responses, the team ‘trained’ the AI system to recognise the presence or absence of key points in the solutions provided by trainees during the trial.

The system then selected pre-written blocks of text to give the participants appropriate feedback.

Riikka Hofmann, associate professor at Cambridge University’s Faculty of Education, said: “Teachers play a critical role in recognising the signs of disorders and learning difficulties in pupils and referring them to specialists.

“Our findings suggest that AI could provide an extra level of individualised feedback to help them develop these essential competencies.”

The research is published in the journal Learning and Instruction.

Thank you for registering

Please refresh the page or navigate to another page on the site to be automatically logged inPlease refresh your browser to be logged in