Scotland's schools quango has been ridiculed for plans to teach pupils how to spot artificial intelligence blunders – despite using AI to edit curriculum papers littered with serious errors.
asserted
quango → ridicule → errors
Education Scotland is at the centre of a row over the use of AI to help create a series of papers about reforming the syllabus, including one which recommended lessons on pornography addiction for children as young as eight.
asserted
which → help → eight
Now it has emerged the under-fire organisation is proposing lessons to teach pupils how to spot AI ‘hallucinations’ – mistakes – in a draft consultation document on literacy and English classes.
asserted
organisation → emerge → literacy
The Education Scotland ‘framework’ for proposed lessons sets out what pupils should learn about reading, writing, communication, information literacy, media literacy and AI.
asserted
pupils → propose → reading
Former Downing Street adviser Chris McGovern, chairman of the Campaign for Real Education, said Education Scotland had ‘made a fool of itself’ and ‘should put its own house in order before lecturing others about the dangers of relying on AI’.
asserted
Scotland → say → AI
He said: ‘Minsters will lose credibility if they place any confidence in what Education Scotland has to say about AI.
‘Public bodies need to understand that much of AI is still in its infancy and should carry a trigger warning.’
asserted
much → say → warning
Former Downing Street adviser Chris McGovern, chairman of the Campaign for Real Education, said Education Scotland had ‘made a fool of itself’
asserted
Scotland → say → itself
Màiri McAllan has been encouraged to be 'bold now and halt the review of the curriculum immediately'
asserted
McAllan → encourage → curriculum
The Education Scotland document contains extensive guidance on AI and AI-generated misinformation.
asserted
document → contain → AI
It states: ‘Information from AI generated content may contain inaccuracies, biases, omissions, hallucinations or outdated sources.’
uncertain
Information → state → inaccuracies
The paper also says pupils should be able to ‘confirm or dispute generative AI responses by comparing them to other information sources’.
asserted
pupils → say → sources
Another requirement is that ‘information is trusted when it is supported by verifiable evidence that references its sources’.
asserted
that → trust → sources
The definition of an AI ‘hallucination’ is given as ‘invented content, presented as fact, which is incorrect or misleading’.
asserted
which → give → fact
Pupils should be taught the difference between misinformation and disinformation.
asserted
Pupils → teach → misinformation
The paper also states: ‘Misinformation is when false information is shared without the deliberate intention to deceive.’
asserted
information → state → intention
Disinformation is ‘when false information is deliberately created to manipulate or mislead’.
asserted
information → create → ?
The paper was published shortly after Education Scotland acknowledged making corrections to several Curriculum Improvement Cycle papers following concerns raised by Brodie Runciman, a lecturer in initial teacher education at the University of Edinburgh.
asserted
Scotland → publish → Edinburgh
He alleged that documents contained fabricated references, non-existent sources, incorrect citations and other errors.
asserted
documents → allege → references
Education Scotland previously stated it was ‘made aware of some errors in the Curriculum Improvement Cycle evidence papers earlier this year and we acted promptly to rectify them and make the necessary corrections’.
asserted
we → state → corrections
The Mail revealed earlier this month that a separate paper on health and wellbeing, which was published online, called for lessons on dealing with addiction to pornography for children as young as eight.
asserted
which → reveal → eight
Bosses at the quango said the document had been updated this month but refused to explain why the plan was dropped – or whether AI was to blame for its original inclusion.
asserted
AI → say → inclusion
A June draft of Education Scotland’s Health and Wellbeing framework included a call for lessons on tackling ‘addiction including but not limited to... pornography’ for pupils in P5 to P7.
asserted
draft → include → P7
After questions were raised by the Mail, Education Scotland pointed to a later version of the framework in which the pornography reference had been removed entirely but did not explain why pornography was included in the draft or why it was subsequently removed.
asserted
it → raise → draft
Referring to the wider controversy over allegedly fabricated references in curriculum papers, Lindsay Paterson, an emeritus professor of education policy at the University of Edinburgh, said: ‘If a policy claims to be based on evidence, but the evidence turns out to be fabricated, then the policy is based merely on speculation.
uncertain
policy → refer → speculation
He added: ‘These background documents are supposed to provide the bedrock for the whole process.
asserted
documents → add → process
‘If the bedrock crumbles, then the policy process rests on sand.
asserted
process → crumble → sand
‘Teachers are being expected to work with policy documents that ultimately have only a tenuous connection to reality.
asserted
that → expect → reality
‘Màiri McAllan [the Education Secretary] has shown herself to be willing to think beyond the assumptions of the past few decades.
asserted
herself → show → decades
‘She should be bold now and halt the review of the curriculum immediately, before further harm is done.
asserted
harm → halt → curriculum
‘It should start again with an independent source of research and ideas, and with proper scrutiny of the integrity of the whole enterprise.’
asserted
It → start → enterprise
Education Scotland said it had produced 45 Curriculum Improvement Cycle documents and that the errors identified affected only a small proportion of the material.
A spokesman said: ‘Education Scotland is committed to transparency and the responsible use of information, and we believe the guidance provides important support to help learners critically evaluate AI-generated content alongside all sources of information.’
A Scottish Government spokesman said: ‘We understand that Education Scotland was made aware of some errors in the Curriculum Improvement Cycle evidence papers
Scottish Tory education spokesman Meghan Gallacher said: 'Education Scotland needs to get its own house in order before lecturing children about spotting fake information.
'
asserted
house → say → information
It is utterly humiliating that the body responsible for shaping our children’s education has had to correct errors in its own curriculum documents.
asserted
body → shape → documents
'John Swinney must explain how such basic failures have slipped through the net and whether anyone is properly checking this work.
asserted
anyone → explain → work
'Parents deserve better than a shambolic curriculum process that risks undermining confidence in our education system.'
asserted
that → deserve → system