Skip to content
The UK's only independent think tank devoted to higher education.

Are the right freshers in the right places?

  • 7 September 2022
  • By Dennis Sherwood

This blog was written by Dennis Sherwood, author of Missing the Mark: Why so many school exam grades are wrong, and how to get results we can trust, published by Canbury Press. It was recently reviewed in a HEPI blog by Rob Cuthbert, Emeritus Professor of Higher Education Management at the University of the West of England and Managing Partner of the Practical Academics consultancy. 

As the 2022 freshers arrive and start finding their way around, some will be supremely confident; others somewhat apprehensive; all will be excited. But will the right students be settling in to their new digs and dorms in the right places?

Here are some numbers you won’t find in the official UCAS, Department for Education, or Ofqual statistics.

For every 100 students awarded AAA for English A Levels in Chemistry, Biology and Physics – a subject combination well-suited to Medicine, for example – about 15 would have been given at least one grade B had their scripts been marked by a senior examiner, whose grade, according to Ofqual’s preferred terminology, is ‘definitive’ or ‘true’. If your institution used AAA in these subjects as the determinant of which students to admit, and which to reject, then about 15 per cent of your intake could well be under-qualified, occupying places that perhaps should have been taken up by students who received certificates bearing at least one B, when they should have received AAA.

For students taking humanities, the numbers are more startling. For every 100 students awarded AAA for Geography, Sociology and Economics, about 40 merited at least one B; for every 100 taking English Language, English Literature and History, about 50.

The fact is that A level grades in England – and AS and GCSE grades too – are, to use Ofqual’s own words, ‘reliable to one grade either way’. As a result, many of the candidates who missed an AAA offer for want of a single grade did so not because they were unlucky in revising the wrong topics, not because their teachers weren’t up to the job, but because Ofqual interprets its statutory duty ‘to secure that regulated qualifications give a reliable indication of knowledge, skills and understanding’ in the belief that grades ‘reliable to one grade either way’ are reliable enough.

Two other numbers:

  • For every 10 students in England who sat eight GCSE subjects, only about one received a certificate on which all eight grades were ‘definitive’ or ‘true’ (to me, a much simpler word is ‘right’).
  • Around 25,000 students in England who sat GCSE English and who were awarded ‘fail’ grade 3, and so consigned to the social dustbin of the ‘forgotten third’, would have been awarded ‘pass’ grades of either 4 or (for a few) 5, had their scripts been marked by a senior examiner.

These numbers, by the way, are not my invention. They are all derived from the measures of the reliability of grades as published by Ofqual in November 2018. Yes, you do need a ruler to determine what those reliabilities actually are, for Ofqual publish only a chart (figure 12, on page 21). And you do need a calculator or spreadsheet to combine the probabilities associated with different subject combinations. The raw data, however, was published by Ofqual nearly four years ago.

It may be that you have read this far and are thinking, ‘So what? None of this matters – as long as all our places are filled, that’s OK.’ Well, I understand that – sort of.

Alternatively, you may be thinking, ‘Really, is all this true? That’s outrageous!’, only to return to your emails, prepare that first lecture to welcome the new class, or go back to your research. I understand that too.

Let me point out, though, that higher education institutions – apart from the students themselves, of course – are the largest and most important ‘consumers’ of exam grades. In principle, higher education has enormous clout. But only if the institutions act collectively.

Ofqual has known about this problem since the mid-2010s and has been progressively forced into admitting just how unreliable exam grades are. So, for example, following an article in the Sunday Times on 11 August 2019, a ‘news story’ was posted on the Ofqual website admitting that ‘more than one grade could well be a legitimate reflection of a student’s performance’. Tell that to the student who missed an offer for want of that single grade.

Yet despite this knowledge, Ofqual has failed to fix the problem. And one reason for this is that insufficient pressure has been brought to bear. 

Higher education can exert that pressure.

But only if you believe that it matters that, on average,  about 1 exam grade in 4 is ‘non-definitive’ or ‘untrue’ (I prefer the simple word ‘wrong’). And only if you care enough to do something about it. Like discussing this with your colleagues in your faculties and departments. Like convincing your Principal or VC that this must be taken up at the highest level.

The power is in your hands. 

But only if you wish to use it.

Get our updates via email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

3 comments

  1. albert wright says:

    Good to be reminded of these facts.

    Perhaps Universities have failed to do much about this information, in part, because they too may be worried that the degree grades they allocate to different students on different courses, may also be slightly misleading / not what they seem.

    Each University is independent. This includes the way they choose to award degrees and the grade of degree. This can vary by subject within the same University.

    Many employers are already aware that a 1st from University A in a particular subject may represent a different level of learning, competence and ability from a 1st at University B.

    It is almost impossible to define the “quality” of a degree let alone measure it.

    Some students may also be aware how their grade is calculated and that it may be different from the way the grades of other students studying different courses at the same University are graded.

    I think the general public have little idea of how “random” the award of grades throughout further and higher education are.

    Perhaps they should be better informed and also informed as to how academic awards differ from apprenticeships.

  2. My apologies for the insensitivity of my opening words about “settling in” – for it appears that many of this year’s freshers are not “settling in” at all – https://www.theguardian.com/education/2022/sep/10/devastated-uk-students-forced-to-live-in-neighbouring-cities-in-university-accommodation-crisis.

    I did not know that when I wrote the blog.

  3. Huy Duong says:

    Hi Dennis,

    Would it be practical to have fewer grades and more effort in validating cases that are near the grade boundaries, or would that validation be prohibitively expensive?

Leave a Reply

Your email address will not be published.