Providing evidence that can inform awarding is an important application of Comparative Judgement (CJ) methods in high-stakes qualifications. The process of marking scripts is not changed, but CJ methods can assist in the maintenance of standards from one series to another by informing decisions about where to place grade boundaries or cut scores.…

The rationale for the use of comparative judgement (CJ) to help set grade boundaries is to provide a way of using expert judgement to identify and uphold certain minimum standards of performance rather than relying purely on statistical approaches such as comparable outcomes. This article summarises the results of recent trials of using CJ for…

Two of the central issues in comparative judgement (CJ), which are perhaps underexplored compared to questions of the method's reliability and technical quality, are "what processes do judges use to make their decisions" and "what features do they focus on when making their decisions?" This article discusses both, in the…

In this article, I report on examiners' views and experiences of using Pairwise Comparative Judgement (PCJ) and Rank Ordering (RO) as alternatives to traditional analytical marking for GCSE English Language essays. Fifteen GCSE English Language examiners took part in the study. After each had judged 100 pairs of essays using PCJ and eight packs of…

Many high-stakes qualifications include non-exam assessments that are marked by teachers. Awarding bodies then apply a moderation process to bring the marking of these assessments to an agreed standard. Comparative Judgement (CJ) is a technique where two (or more) pieces of work are compared at a time, allowing an overall rank order of work to be…

In Comparative Judgement (CJ) exercises, examiners are asked to look at a selection of candidate scripts (with marks removed) and order them in terms of which they believe display the best quality. By including scripts from different examination sessions, the results of these exercises can be used to help with maintaining standards. Results from…

The COVID-19 pandemic caused unprecedented disruption to education around the world. As education systems gradually return to normal, there is a push to understand effects of the disruption. A major impact on students is "learning loss", in which attainment and progress may have fallen behind expected levels. Various efforts have been…

The results of an assessment taken at the start and end of the Reception Year by children in state schools in England over three years were analysed. Over 70,000 children were assessed during this time. The results of the analysis provided evidence of what the average child could do when they started school, and how much progress they made in that…

The concept of educational recovery is relevant to many systems, both those that experience some form of sudden disruption as well as those that historically have been prone to disruption. Our involvement in developing a curriculum framework for displaced learners in the Learning Passport project (UNICEF, 2020) made us more aware of the field of…

In England, there are persistent associations between measures of socio-economic advantage and educational outcomes. Research on the history of names, meanwhile, confirms that surnames in England--like many other countries--were highly socially stratified in their origins. These facts prompted us to wonder whether educational outcomes in England…

Equating methods are designed to adjust between alternate versions of assessments targeting the same content at the same level, with the aim that scores from the different versions can be used interchangeably. The statistical processes used in equating have, however, been extended to statistically "link" assessments that differ, such as…

In 2020, the COVID-19 pandemic led to the closing of schools across the United Kingdom, and to the cancellation of exams and assessments in England. A large number of learners take Vocational and Technical Qualifications (VTQs) that are offered in a diverse range of subject groups and they can be used to enter the next stage of education,…

Was the approach proposed for calculating exam grades in summer 2020 fair? Were the grades eventually awarded (after policy changes) fair? What is a fair arrangement for 2021? These questions have been at the heart of debate in the UK in the light of COVID-19. After schools were closed in the spring of 2020 and the decision was made not to proceed…

In times of crisis it is good to look back. Not only is it comforting, but better understanding of events in our past can inform decision-making and help us find direction at uncertain times. COVID-19 may have presented new challenges, but this exploration of historical disruptions to school exams highlights themes and a recognisable human spirit.…

Inspired by the work of David Raffe and his co-authors who set out the positive benefits gained from comparing the policies of "the UK home nations" in an article published in 1999, researchers in the Education and Curriculum Team launched a project in early 2020 that we called Curriculum Watch. The aim of this project was to collate a…