ERIC Number: EJ1237852
Record Type: Journal
Publication Date: 2020
Pages: 10
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0260-2938
EISSN: N/A
Available Date: N/A
Sources of Variance in End-of-Course Student Evaluations
Assessment & Evaluation in Higher Education, v45 n1 p44-53 2020
Evaluation of college instructors often centers on course ratings; however, there is little evidence that these ratings only reflect teaching. The purpose of this study was to assess the relative importance of three facets of course ratings: instructor, course and occasion. We sampled 2,459 fully-crossed dyads from a large university where two instructors taught the same two courses at least twice in a 3-year period. Generalizability theory was used to estimate unconfounded variance components for instructor, course and occasion, as well as their interactions. Meta-analysis was used to summarize those estimates. Results indicated that a three-way interaction between instructor, course and occasion that includes measurement error accounted for the most variance in student ratings (24%), with instructor accounting for the second largest amount (22%). While instructor -- and presumably teaching -- accounted for substantial variance in student course ratings, factors other than instructor quality had a larger influence on student ratings.
Descriptors: Student Evaluation of Teacher Performance, Course Evaluation, Error of Measurement, Teacher Effectiveness, Context Effect, College Students, College Faculty, Correlation, Student Attitudes
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A