ERIC Number: EJ1049629
Record Type: Journal
Publication Date: 2015
Abstractor: As Provided
Assessing the "Rothstein Falsification Test": Does It Really Show Teacher Value-Added Models Are Biased?
Goldhaber, Dan; Chaplin, Duncan Dunbar
Journal of Research on Educational Effectiveness, v8 n1 p8-34 2015
In an influential paper, Jesse Rothstein (2010) shows that standard value-added models (VAMs) suggest implausible and large future teacher effects on past student achievement. This is the basis of a falsification test that "appears" to indicate bias in typical VAM estimates of teacher contributions to student learning on standardized tests. We find that the "Rothstein falsification test" generates large and implausible future teacher effects even when students are randomly assigned to classrooms. Importantly, we also show that although the test can determine when students are tracked to teachers, this tracking result does not necessarily imply bias in estimates of teacher effectiveness. The primary reason that the test does not imply bias is that tracking could be based on lagged student achievement, which is usually accounted for in VAMs. Specifically, we show theoretically and through simulations that the test proposed in Rothstein will often falsify VAMs that are unbiased and fail to falsify VAMs that are biased.
Descriptors: Teacher Evaluation, Teacher Effectiveness, Teacher Influence, Models, Test Bias, Academic Achievement, Standardized Tests, Grade 5, Elementary School Teachers, Equations (Mathematics), Computation, Statistical Significance, Prediction, Error Patterns, Simulation
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 5; Intermediate Grades; Middle Schools; Elementary Education
Authoring Institution: N/A