NotesFAQContact Us
Search Tips
ERIC Number: ED518823
Record Type: Non-Journal
Publication Date: 2011
Pages: 11
Abstractor: ERIC
Reference Count: 9
Constructing Counterfactuals in a Multisite Observational Study Using Propensity Score Matching and Multilevel Modeling: An Empirical Example Looking at the Effect of 8th Grade Algebra across Students and Schools
Rickles, Jordan H.
Society for Research on Educational Effectiveness
This study seeks to demonstrate a method for treatment effect estimation in a multisite observational study where the treatment is highly selective and the assignment mechanism varies across sites. The method is demonstrated by addressing three primary research questions about the effect of 8th grade algebra: (1) For students who take algebra in 8th grade, what is the average effect of taking algebra in 8th grade on algebra achievement by the end of 9th grade?; (2) Does the average effect vary across students with different levels of demonstrated 7th grade mathematics achievement and propensity for taking 8th grade algebra?; and (3) Does the average effect vary across classrooms and schools? Through these three research questions, the author focuses on preprocessing the data with propensity score matching and imputation of the counterfactual, and on the exploration of treatment effect heterogeneity with multilevel modeling. This paper recognizes, but does not directly address, the importance of sensitivity analysis. (Contains 3 tables and 2 figures.)
Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; Fax: 202-640-4401; e-mail:; Web site:
Publication Type: Reports - Research
Education Level: Grade 7; Grade 8; Grade 9; Middle Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: Society for Research on Educational Effectiveness (SREE)
Identifiers - Location: California