ERIC Number: EJ1086927
Record Type: Journal
Publication Date: 2016
Abstractor: As Provided
Peer Assessment in the Digital Age: A Meta-Analysis Comparing Peer and Teacher Ratings
Li, Hongli; Xiong, Yao; Zang, Xiaojiao; Kornhaber, Mindy L.; Lyu, Youngsun; Chung, Kyung Sun; Suen, Hoi K.
Assessment & Evaluation in Higher Education, v41 n2 p245-264 2016
Given the wide use of peer assessment, especially in higher education, the relative accuracy of peer ratings compared to teacher ratings is a major concern for both educators and researchers. This concern has grown with the increase of peer assessment in digital platforms. In this meta-analysis, using a variance-known hierarchical linear modelling approach, we synthesise findings from studies on peer assessment since 1999 when computer-assisted peer assessment started to proliferate. The estimated average Pearson correlation between peer and teacher ratings is found to be 0.63, which is moderately strong. This correlation is significantly higher when: (a) the peer assessment is paper-based rather than computer-assisted; (b) the subject area is not medical/clinical; (c) the course is graduate level rather than undergraduate or K-12; (d) individual work instead of group work is assessed; (e) the assessors and assessees are matched at random; (f) the peer assessment is voluntary instead of compulsory; (g) the peer assessment is non-anonymous; (h) peer raters provide both scores and qualitative comments instead of only scores; and (i) peer raters are involved in developing the rating criteria. The findings are expected to inform practitioners regarding peer assessment practices that are more likely to exhibit better agreement with teacher assessment.
Descriptors: Peer Evaluation, Comparative Analysis, Meta Analysis, Student Evaluation, Hierarchical Linear Modeling, Correlation, Graduate Study, Undergraduate Study, Elementary Secondary Education, Literature Reviews
Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research; Information Analyses
Education Level: Higher Education; Postsecondary Education; Elementary Secondary Education
Authoring Institution: N/A