NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ933696
Record Type: Journal
Publication Date: 2011-Feb
Pages: 6
Abstractor: As Provided
Reference Count: 11
ISSN: ISSN-1531-7714
Do More Online Instructional Ratings Lead to Better Prediction of Instructor Quality?
Sanders, Shane; Walia, Bhavneet; Potter, Joel; Linna, Kenneth W.
Practical Assessment, Research & Evaluation, v16 n2 Feb 2011
Online instructional ratings are taken by many with a grain of salt. This study analyzes the ability of said ratings to estimate the official (university-administered) instructional ratings of the same respective university instructors. Given self-selection among raters, we further test whether more online ratings of instructors lead to better prediction of official ratings in terms of both R-squared value and root mean squared error. We lastly test and correct for heteroskedastic error terms in the regression analysis to allow for the first robust estimations on the topic. Despite having a starkly different distribution of values, online ratings explain much of the variation in official ratings. This conclusion strengthens, and root mean squared error typically falls, as one considers regression subsets over which instructors have a larger number of online ratings. Though (public) online ratings do not mimic the results of (semi-private) official ratings, they provide a reliable source of information for predicting official ratings. There is strong evidence that this reliability increases in online rating usage. (Contains 1 figure, 5 tables, and 3 footnotes.)
Dr. Lawrence M. Rudner. e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Alabama