NotesFAQContact Us
Collection
Advanced
Search Tips
ERIC Number: ED529167
Record Type: Non-Journal
Publication Date: 2012-Jan
Pages: 33
Abstractor: As Provided
Reference Count: 35
ISBN: N/A
ISSN: N/A
Assessing the "Rothstein Test": Does It Really Show Teacher Value-Added Models Are Biased? Working Paper 71
Goldhaber, Dan; Chaplin, Duncan
National Center for Analysis of Longitudinal Data in Education Research
In a provocative and influential paper, Jesse Rothstein (2010) finds that standard value-added models (VAMs) suggest implausible future teacher effects on past student achievement, a finding that obviously cannot be viewed as causal. This is the basis of a falsification test (the Rothstein falsification test) that appears to indicate bias in VAM estimates of current teacher contributions to student learning. More precisely, the falsification test is designed to identify whether or not students are effectively randomly assigned conditional on the covariates included in the model. Rothstein's finding is significant because there is considerable interest in using VAM teacher effect estimates for high-stakes teacher personnel policies, and the results of the Rothstein test cast considerable doubt on the notion that VAMs can be used fairly for this purpose. However, in this paper, we illustrate--theoretically and through simulations--plausible conditions under which the Rothstein falsification test rejects VAMs even when students are randomly assigned, conditional on the covariates in the model, and even when there is no bias in estimated teacher effects. Appended are: (1) When Falsification Tests Fail; and (2) Negatively Correlated Errors Need Not Cause Bias. (Contains 1 table and 53 footnotes.)
National Center for Analysis of Longitudinal Data in Education Research. American Institutes for Research, 1000 Thomas Jefferson Street NW, Washington, DC 20007. Tel: 202-403-5000; Fax: 202-403-5454; e-mail: inquiry@caldercenter.org; Web site: http://www.caldercenter.org
Publication Type: Reports - Evaluative
Education Level: Elementary Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: Urban Institute, National Center for Analysis of Longitudinal Data in Education Research (CALDER)
IES Funded: Yes
Grant or Contract Numbers: R305A060067
IES Cited: ED544345