ERIC Number: EJ933696
Record Type: Journal
Publication Date: 2011-Feb
Abstractor: As Provided
Reference Count: 11
Do More Online Instructional Ratings Lead to Better Prediction of Instructor Quality?
Sanders, Shane; Walia, Bhavneet; Potter, Joel; Linna, Kenneth W.
Practical Assessment, Research & Evaluation, v16 n2 Feb 2011
Online instructional ratings are taken by many with a grain of salt. This study analyzes the ability of said ratings to estimate the official (university-administered) instructional ratings of the same respective university instructors. Given self-selection among raters, we further test whether more online ratings of instructors lead to better prediction of official ratings in terms of both R-squared value and root mean squared error. We lastly test and correct for heteroskedastic error terms in the regression analysis to allow for the first robust estimations on the topic. Despite having a starkly different distribution of values, online ratings explain much of the variation in official ratings. This conclusion strengthens, and root mean squared error typically falls, as one considers regression subsets over which instructors have a larger number of online ratings. Though (public) online ratings do not mimic the results of (semi-private) official ratings, they provide a reliable source of information for predicting official ratings. There is strong evidence that this reliability increases in online rating usage. (Contains 1 figure, 5 tables, and 3 footnotes.)
Descriptors: Prediction, Student Evaluation of Teacher Performance, Teacher Evaluation, Web Sites, College Faculty, Regression (Statistics), College Students, Teacher Competencies, Teaching Skills, Rating Scales, Validity, Reliability
Dr. Lawrence M. Rudner. e-mail: firstname.lastname@example.org; Web site: http://pareonline.net
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Authoring Institution: N/A
Identifiers - Location: Alabama