ERIC Number: EJ1011024
Record Type: Journal
Publication Date: 2013-Jun
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0013-1644
EISSN: N/A
Investigating Halo and Ceiling Effects in Student Evaluations of Instruction
Keeley, Jared W.; English, Taylor; Irons, Jessica; Henslee, Amber M.
Educational and Psychological Measurement, v73 n3 p440-457 Jun 2013
Many measurement biases affect student evaluations of instruction (SEIs). However, two have been relatively understudied: halo effects and ceiling/floor effects. This study examined these effects in two ways. To examine the halo effect, using a videotaped lecture, we manipulated specific teacher behaviors to be "good" or "bad" based on specific items on the evaluation form (the Teacher Behavior Checklist). To examine ceiling/floor effects, we expanded the standard 5-point rating to either 7 or 9 points. Across three universities, 537 students watched and rated the videotaped lecture. Both biases were robust and remained despite characteristics of the measure designed to combat them. Instead, direct instruction regarding how to use the evaluation forms seems to be necessary to limit these biases on ratings. (Contains 3 figures and 5 tables.)
Descriptors: Robustness (Statistics), Test Bias, Course Evaluation, Student Evaluation of Teacher Performance, Likert Scales, Item Analysis, Item Response Theory, Protocol Analysis, Teacher Behavior, Video Technology, Student Attitudes, Rating Scales, Teacher Evaluation, Check Lists, Test Reliability, Test Validity, Teaching Styles, Evaluation Methods, Evaluation Research, College Students
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A