ERIC Number: EJ1020058
Record Type: Journal
Publication Date: 2014-Feb
Abstractor: As Provided
Correcting for Test Score Measurement Error in ANCOVA Models for Estimating Treatment Effects
Lockwood, J. R.; McCaffrey, Daniel F.
Journal of Educational and Behavioral Statistics, v39 n1 p22-52 Feb 2014
A common strategy for estimating treatment effects in observational studies using individual student-level data is analysis of covariance (ANCOVA) or hierarchical variants of it, in which outcomes (often standardized test scores) are regressed on pretreatment test scores, other student characteristics, and treatment group indicators. Measurement error in the prior test scores, which typically is both large and heteroscedastic, is regularly overlooked in empirical analyses and may erode the ability of regression models to adjust for student factors and may result in biased treatment effect estimates. We develop extensions of method-of-moments, Simulation-Extrapolation, and latent regression approaches to correcting for measurement error using the conditional standard errors of measure of test scores, and demonstrate their effectiveness relative to simpler alternatives using both simulation and a case study of teacher value-added effect estimation using longitudinal data from a large suburban school district.
Descriptors: Error of Measurement, Scores, Statistical Analysis, Computation, Regression (Statistics), Teacher Effectiveness, Suburban Schools, Longitudinal Studies, Mathematics Achievement, Grade 6, Bayesian Statistics, Statistical Bias
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: firstname.lastname@example.org; Web site: http://sagepub.com
Publication Type: Reports - Research; Journal Articles
Education Level: Grade 6; Elementary Education; Intermediate Grades; Middle Schools
Authoring Institution: N/A
Grant or Contract Numbers: N/A