NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ865462
Record Type: Journal
Publication Date: 2009-Dec
Pages: 19
Abstractor: As Provided
Reference Count: 24
ISSN: ISSN-0260-2938
Bones, Boys, Bombs and Booze: An Exploratory Study of the Reliability of Marking Dissertations across Disciplines
Bettany-Saltikov, Josette; Kilinc, Stephanie; Stow, Karen
Assessment & Evaluation in Higher Education, v34 n6 p621-639 Dec 2009
The primary aim of this study was to evaluate the reliability of the University's Masters' level (M-level) generic assessment criteria when used by lecturers from different disciplines. A further aim was to evaluate if subject-specific knowledge was essential to marking these dissertations. Four senior lecturers from diverse disciplines participated in this study. The University of Teesside's generic M-level assessment criteria were used and formatted into a grid. The assessment criteria related to the learning outcomes, the depth of understanding, the complexity of analysis and synthesis and the structure and academic presentation of the work. As well as a quantitative mark, a qualitative statement for the reason behind the judgement was required. Each lecturer provided a dissertation that had previously been marked. All participants then marked each of the four projects using the M-level grid and comments sheet. The study found very good inter-rater reliability. For any one project, the variation in marks from the original mark was no more than 6% on average. This study also found that subject-specific knowledge was not essential to marking when using generic assessment criteria in terms of the reliability of marks. The authors acknowledge the exploratory nature of these results and hope other lecturers will join in the exploration to test the robustness of generic assessment criteria across disciplines. (Contains 3 tables and 4 figures.)
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site:
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom