NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ972637
Record Type: Journal
Publication Date: 2012
Pages: 20
Abstractor: As Provided
Reference Count: 56
ISSN: ISSN-0969-594X
An Exploration of the Examination Script Features that Most Influence Expert Judgements in Three Methods of Evaluating Script Quality
Suto, Irenka; Novakovic, Nadezda
Assessment in Education: Principles, Policy & Practice, v19 n3 p301-320 2012
Some methods of determining grade boundaries within examinations, such as awarding, paired comparisons, and rank ordering, entail expert judgements of script quality. We aimed to identify the features of examinees' scripts that most influence judgements in the three methods. For contrasting examinations in biology and English, a Latin square design enabled each of three matched groups of 10 experienced examiners to use each method to determine grade boundaries in an experimental setting. Additionally, every script was rated separately for nine potentially influential features by at least two examiners working independently. All three methods generated plausible grade boundary marks. The most influential features were inferred from analyses of the relationships between script feature ratings and grading judgements. Although the three methods yielded similarities and variations in the most influential features, no influential features were deemed likely to compromise the methods' validities. (Contains 5 tables, 2 figures and 1 note.)
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom (England)