ERIC Number: EJ1234674
Record Type: Journal
Publication Date: 2019-Dec
Pages: 31
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0002-8312
EISSN: N/A
The Consistency of Composite Ratings of Teacher Effectiveness: Evidence from New Mexico
Doan, Sy; Schweig, Jonathan D.; Mihaly, Kata
American Educational Research Journal, v56 n6 p2116-2146 Dec 2019
Contemporary teacher evaluation systems use multiple measures of performance to construct ratings of teacher quality. While the properties of constituent measures have been studied, little is known about whether composite ratings themselves are sufficiently reliable to support high-stakes decision making. We address this gap by estimating the consistency of composite ratings of teacher quality from New Mexico's teacher evaluation system from 2015 to 2016. We estimate that roughly 40% of teachers would receive a different composite rating if reevaluated in the same year; 97% of teachers would receive ratings within ±1 level of their original rating. We discuss mechanisms by which policymakers can improve rating consistency, and the implications of those changes to other properties of teacher evaluation systems.
Descriptors: Teacher Effectiveness, Reliability, Teacher Evaluation, Measures (Individuals), Value Added Models, Observation, Teacher Attendance, Parent Surveys, Student Surveys, Educational Policy, Cutting Scores
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
Identifiers - Location: New Mexico
IES Funded: Yes
Grant or Contract Numbers: R305A160223