ERIC Number: EJ1049630
Record Type: Journal
Publication Date: 2015
Abstractor: As Provided
Evaluating Specification Tests in the Context of Value-Added Estimation
Guarino, Cassandra M.; Reckase, Mark D.; Stacy, Brian W.; Wooldridge, Jeffrey M.
Journal of Research on Educational Effectiveness, v8 n1 p35-59 2015
We study the properties of two specification tests that have been applied to a variety of estimators in the context of value-added measures (VAMs) of teacher and school quality: the Hausman test for choosing between student-level random and fixed effects, and a test for feedback (sometimes called a "falsification test"). We discuss theoretical properties of the tests to serve as background, and propose parsimonious one-degree-of-freedom versions. An extensive simulation study provides important further insight into the VAM setting. Unfortunately, although both the Hausman and feedback tests have good power for detecting the kinds of nonrandom assignment that can invalidate VAM estimates, they also reject in situations where estimated VAMs perform very well in terms of ranking teachers. Consequently, the tests must be used with caution when student tracking is used to form classrooms.
Descriptors: Teacher Effectiveness, Educational Quality, Evaluation Methods, Tests, Feedback (Response), Statistical Analysis, Simulation, Academic Rank (Professional), Testing Problems
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305D100028