NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1078783
Record Type: Journal
Publication Date: 2015
Pages: 19
Abstractor: As Provided
ISSN: ISSN-0260-2938
Using the Sampling Margin of Error to Assess the Interpretative Validity of Student Evaluations of Teaching
James, David E.; Schraw, Gregory; Kuch, Fred
Assessment & Evaluation in Higher Education, v40 n8 p1123-1141 2015
We present an equation, derived from standard statistical theory, that can be used to estimate sampling margin of error for student evaluations of teaching (SETs). We use the equation to examine the effect of sample size, response rates and sample variability on the estimated sampling margin of error, and present results in four tables that allow users to assess the interpretative validity (IV) of a SET score for a specific evaluation context. In this framework, a small margin of error, e.g. 3% of the range, suggests a greater precision, or IV in a score, whereas a large margin of error, e.g. 10% of the range, suggests a lower IV. We review the SET literature and summarise five ways that low response rates may be ameliorated. We also compare our results to previous published studies. Our findings matched, but greatly extended, prior results.
Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A