NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1088668
Record Type: Journal
Publication Date: 2015
Pages: 13
Abstractor: As Provided
ISSN: ISSN-1927-6044
Reliability-Related Issues in the Context of Student Evaluations of Teaching in Higher Education
Kalender, Ilker
International Journal of Higher Education, v4 n3 p44-56 2015
Student evaluations of teaching (SET) have been the principal instrument to elicit students' opinions in higher education institutions. Many decisions, including high-stake ones, are made based on SET scores reported by students. In this respect, reliability of SET scores is of considerable importance. This paper has an argument that there are some problems in choosing and using of reliability indices in SET context. Three hypotheses were tested: (i) using internal consistency measures is misleading in SET context since the variability is mainly due to disagreement between students' ratings, which requires use of inter-rater reliability coefficients, (ii) number of minimum feedbacks is not achieved in most of the classes, resulting in unreliable decisions, and (iii) calculating reliability coefficient assuming a common factor structure across all classes is misleading because a common model may not be tenable for all. Results showed that use of internal consistency only to assess reliability of SET scores may result in wrong decisions. Considerable large numbers of missing feedback were observed to achieve acceptable reliability levels. Findings also indicated that factorial model differed across several groups.
Sciedu Press. 1120 Finch Avenue West Suite 701-309, Toronto Ontario, Canada M3J 3H7. Tel: 416-479-0028; Fax: 416-642-8548; e-mail: ijhe@scieduca; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Turkey
Grant or Contract Numbers: N/A