NotesFAQContact Us
Search Tips
ERIC Number: ED518856
Record Type: Non-Journal
Publication Date: 2011-Apr
Pages: 48
Abstractor: As Provided
Reference Count: 12
Designing and Analyzing Studies that Randomize Schools to Estimate Intervention Effects on Student Academic Outcomes without Classroom-Level Information
Zhu, Pei; Jacob, Robin; Bloom, Howard; Xu, Zeyu
This paper provides practical guidance for researchers who are designing and analyzing studies that randomize schools--which comprise three levels of clustering (students in classrooms in schools)--to measure intervention effects on student academic outcomes when information on the middle level (classrooms) is missing. This situation arises frequently in practice because many available data sets identify the schools that students attend but not the classrooms in which they are taught. Do studies conducted under these circumstances yield results that are substantially different from what they would have been if this information had been available? The paper first considers this problem in the context of planning a school-randomized study based on preexisting two-level information about how academic outcomes for students vary across schools and across students within schools (but not across classrooms in schools). The paper next considers this issue in the context of estimating intervention effects from school-randomized studies. Findings are based on empirical analyses of four multisite data sets using academic outcomes for students within classrooms within schools. The results indicate that in almost all situations one will obtain nearly identical results whether or not the classroom or middle level is omitted when designing or analyzing studies. Three-Level vs. Two-Level Model Comparisons: Estimated R-Squared for School- and Student-Level Covariates are appended. (Contains 9 tables and 2 footnotes.)
MDRC. 16 East 34th Street 19th Floor, New York, NY 10016-4326. Tel: 212-532-3200; Fax: 212-684-0832; e-mail:; Web site:
Publication Type: Guides - Non-Classroom; Reports - Descriptive
Education Level: Elementary Secondary Education
Audience: Researchers
Language: English
Sponsor: William T. Grant Foundation; Judith Gueron Fund for Methodological Innovation in Social Policy Research at MDRC
Authoring Institution: MDRC