ERIC Number: EJ1050519
Record Type: Journal
Publication Date: 2014
Abstractor: As Provided
Reference Count: 18
What Response Rates Are Needed to Make Reliable Inferences from Student Evaluations of Teaching?
Zumrawi, Abdel Azim; Bates, Simon P.; Schroeder, Marianne
Educational Research and Evaluation, v20 n7-8 p557-563 2014
This paper addresses the determination of statistically desirable response rates in students' surveys, with emphasis on assessing the effect of underlying variability in the student evaluation of teaching (SET). We discuss factors affecting the determination of adequate response rates and highlight challenges caused by non-response and lack of randomization. Estimates of underlying variability were obtained for a period of 4 years, from online evaluations at the University of British Columbia (UBC). Simulations were used to examine the effect of underlying variability on desirable response rates. The UBC response rates were compared to those reported in the literature. Results indicate that small differences in underlying variability may not impact desired rates. We present acceptable response rates for a range of variability scenarios, class sizes, confidence level, and margin of error. The stability of estimates observed at UBC, over a 4-year period, indicates that valid model-based inferences of SET could be made.
Descriptors: Inferences, Test Reliability, Response Rates (Questionnaires), Student Evaluation of Teacher Performance, Evaluation Problems, Online Surveys, Likert Scales, Learning Modules, Simulation, Vignettes, Methods Research, Test Items, Robustness (Statistics), Goodness of Fit, Error of Measurement, College Students, Foreign Countries
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Authoring Institution: N/A
Identifiers - Location: Canada