ERIC Number: EJ1024197
Record Type: Journal
Publication Date: 2013
Abstractor: As Provided
Reference Count: 21
Gains in Marking Reliability from Item-Level Marking: Is the Sum of the Parts Better than the Whole?
Wheadon, Christopher; Pinot de Moira, Anne
Educational Research and Evaluation, v19 n8 p665-679 2013
Marking of high-stakes examinations in England has traditionally been administered by schools and colleges sending their examination papers directly to examiners. As a consequence, the work of one candidate has, historically, been marked by one examiner, as has work of an entire centre. Previous studies have suggested that the marking of both whole scripts and whole centres is liable to bias, caused either by examiner characteristics or the characteristics of the allocation of marking. This study used operational data from 2 Geography papers which had moved from whole script, whole centre marking to item-level marking, and then back again, to quantify the gains in reliability from item-level marking. It found that there were substantial gains in the reliability of marking for the highest performing candidates when the marking was at item level. The reasons for these gains did not appear to be associated with any characteristics of a centre entry.
Descriptors: Foreign Countries, Scoring, High Stakes Tests, Reliability, Bias, Test Items, Geography, Hierarchical Linear Modeling
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom (England)