NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1172319
Record Type: Journal
Publication Date: 2018
Pages: 12
Abstractor: As Provided
ISSN: ISSN-0260-2938
The Reliability and Sources of Error of Using Rubrics-Based Assessment for Student Projects
Menéndez-Varela, José-Luis; Gregori-Giralt, Eva
Assessment & Evaluation in Higher Education, v43 n3 p488-499 2018
Rubrics are widely used in higher education to assess performance in project-based learning environments. To date, the sources of error that may affect their reliability have not been studied in depth. Using generalisability theory as its starting-point, this article analyses the influence of the assessors and the criteria of the rubrics on the assessment of two service-learning projects. A sample of 365 novice students studying for three different undergraduate degrees was evaluated by eight student assessors and two teachers at three stages of assessment. Depending on the type of project and the stage of assessment, between 19.27 and 39.55% of the total variance was attributed to the quality of the projects, 0-7.49% to the main effect of the raters, and 3.44-17.3% to the main effect of the criteria. The results demonstrated that acceptable levels of reliability (=0.70) were obtained with three raters and eight criteria or four raters and nine criteria in contexts of relative or absolute decisions, respectively.
Taylor & Francis. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A