ERIC Number: EJ1110316
Record Type: Journal
Publication Date: 2016
Assessment of Teacher Candidate Dispositions: Evidence of Reliability and Validity
Choi, Hee-sook; Benson, Nicholas F.; Shudak, Nicholas J.
Teacher Education Quarterly, v43 n3 p71-89 Sum 2016
The current study is an attempt to inform professionals, such as university trainers and field-based supervisors, as to the utility of professional dispositions assessment as a means of gauging teacher candidate success in their professional roles. According to the "Standards for Educational and Psychological Testing" (2014), test users must select measures that accurately reflect the measurement targets of interest and have validity for intended purposes. Are supervisors' ratings of professional dispositions supported by reliability and validity evidence? Do dispositions make a difference in practice? To address these questions, researchers examined evidence for reliability such as internal consistency, stability, and interrater agreement. To this end, the study explored the structure of the dispositions rating form as to its consistency with its intended structure. The authors examined whether these dispositions are measured consistently across raters and time. Criterion-related evidence for validity was examined by correlating teacher candidate disposition ratings with teaching effectiveness, which was measured by direct observation of their levels of student engagement. Overall, the findings of this study appear to support the skepticism regarding the assessment of dispositions in the teacher education field. The findings challenge the utility of assessing dispositions; that is, unless the term "dispositions" is clearly understood and defined, it cannot be reliably and validly assessed.
Descriptors: Reliability, Validity, Teacher Education, Teacher Effectiveness, Standards, Teacher Education Programs, Factor Analysis, Statistical Analysis, Correlation, Learner Engagement, Student Teachers, Student Teaching, Item Analysis, Observation
Caddo Gap Press. 3145 Geary Boulevard PMB 275, San Francisco, CA 94118. Tel: 415-666-3012; Fax: 415-666-3552; e-mail: firstname.lastname@example.org; Web site: http://www.caddogap.com
Publication Type: Journal Articles; Tests/Questionnaires; Reports - Research
Education Level: Higher Education
Authoring Institution: N/A
Grant or Contract Numbers: N/A