ERIC Number: EJ1015326
Record Type: Journal
Publication Date: 2013-Jan-29
Pages: 39
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1068-2341
EISSN: N/A
Value-Added Teacher Estimates as Part of Teacher Evaluations: Exploring the Effects of Data and Model Specifications on the Stability of Teacher Value-Added Scores
Kersting, Nicole B.; Chen, Mei-kuang; Stigler, James W.
Education Policy Analysis Archives, v21 n7 Jan 2013
If teacher value-added estimates (VAEs) are to be used as indicators of
individual teacher performance in teacher evaluation and accountability systems, it is important to understand how much VAEs are affected by the data and model specifications used to estimate them. In this study we explored the effects of three conditions on the stability of VAEs and evaluated their relative impact. We varied how we accounted for differences among students in their prior learning; whether we estimated VAEs from single or multiple cohorts of students; and the number of students
contributing to the VAE for each teacher. Using data from one of the largest school districts in the nation, we created a single, complete data set and used it to estimate several sets of VAEs for each of the 3,651 5th grade mathematics teachers. We found that approximately two thirds of teachers' were stable in that they remained in the same performance group across all conditions. We also found that differences in number of students used for VAEs accounted for up to one third of teacher reclassifications into
different performance groups; single versus multiple cohort models accounted for about one fifth; and different methods for controlling for student prior learning accounted for about one sixth (16%) of teacher reclassifications. We relate our findings to characteristics of our data and discuss implications for educational policy. (Contains 7 tables and 5 figures.)
Descriptors: Teacher Effectiveness, Teacher Competencies, Accountability, Teacher Evaluation, Evaluation Methods, Teaching Skills, Student Characteristics, Prior Learning, Sampling, School Districts, Mathematics Teachers, Environmental Influences, Urban Schools, Mathematics Achievement, Standardized Tests, Elementary Schools, Racial Differences, Special Education, Socioeconomic Status, Scores, Cohort Analysis
Colleges of Education at Arizona State University and the University of South Florida. c/o Editor, USF EDU162, 4202 East Fowler Avenue, Tampa, FL 33620-5650. Tel: 813-974-3400; Fax: 813-974-3826; Web site: http://epaa.asu.edu
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 5; Elementary Education; Grade 3; Grade 4
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: California
Grant or Contract Numbers: N/A
IES Cited: ED565633; ED552484