NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1049629
Record Type: Journal
Publication Date: 2015
Pages: 27
Abstractor: As Provided
ISSN: ISSN-1934-5747
Assessing the "Rothstein Falsification Test": Does It Really Show Teacher Value-Added Models Are Biased?
Goldhaber, Dan; Chaplin, Duncan Dunbar
Journal of Research on Educational Effectiveness, v8 n1 p8-34 2015
In an influential paper, Jesse Rothstein (2010) shows that standard value-added models (VAMs) suggest implausible and large future teacher effects on past student achievement. This is the basis of a falsification test that "appears" to indicate bias in typical VAM estimates of teacher contributions to student learning on standardized tests. We find that the "Rothstein falsification test" generates large and implausible future teacher effects even when students are randomly assigned to classrooms. Importantly, we also show that although the test can determine when students are tracked to teachers, this tracking result does not necessarily imply bias in estimates of teacher effectiveness. The primary reason that the test does not imply bias is that tracking could be based on lagged student achievement, which is usually accounted for in VAMs. Specifically, we show theoretically and through simulations that the test proposed in Rothstein will often falsify VAMs that are unbiased and fail to falsify VAMs that are biased.
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 5; Intermediate Grades; Middle Schools; Elementary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A