ERIC Number: EJ1161756
Record Type: Journal
Publication Date: 2018
Abstractor: As Provided
A Modified Peer Rating System to Recognise Rating Skill as a Learning Outcome
Cheung-Blunden, Violet; Khan, Saera R.
Assessment & Evaluation in Higher Education, v43 n1 p58-67 2018
The peer rating system used here advances the quantitative literacy goals outlined in the social sciences. We instituted a mid-semester intervention to teach rating skills and used an index to track longitudinal changes of skill mastery over the course of the semester. Seventy-four students in five advanced research classes followed the procedure of the existing peer rating system by completing reading assignments, writing reflections online, engaging in class discussions, rating their peers' reflections and receiving feedback on their group effort. Peer ratings were then compared with each other and also with the instructor ratings to derive individualised indices of reliability and validity. These technical indicators enabled two rounds of assessment before and after a class-wide intervention. An omnibus test across the five classes showed a significant improvement in rating quality due to the intervention. Our courses not only met a quantitative learning outcome but also promised vocational competence.
Descriptors: Peer Evaluation, Rating Scales, Skill Development, College Students, Reading Assignments, Reflection, Group Discussion, Feedback (Response), Group Activities, College Faculty, Intervention, Program Effectiveness, Pretests Posttests
Taylor & Francis. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Authoring Institution: N/A
Grant or Contract Numbers: N/A