Download full text
Download full text
ERIC Number: ED563360
Record Type: Non-Journal
Publication Date: 2013
Reference Count: 3
Methods for Analyzing Data from a Randomized Control Trial with a Nationally Representative Sample
Bell, Stephen H.; Puma, Michael J.; Cook, Ronna J.; Heid, Camilla A.
Society for Research on Educational Effectiveness
Access to Head Start has been shown to improve children's preschool experiences and school readiness on selected factors through the end of 1st grade. Two more years of follow-up, through the end of 3rd grade, can now be examined to determine whether these effects continue into the middle elementary grades. The statistical design and impact analysis methodology for the Head Start Impact Study (HSIS) has been lauded as exemplary for a large scale social experiment, and analytic strategies continue to evolve through three rounds of analysis covering six years of sample follow-up. Based on a randomized admission lottery in hundreds of local sites, the HSIS provides a platform for measuring Head Start's impacts--both short term and long term--on a nationally representative sample of participants without selection bias, providing internally and externally valid impact estimates for the overall Head Start participant population and for subsets of participants of particular policy interest. The HSIS includes a nationally representative sample of 4,667 three- and four-year-old children in 383 centers nationwide. The evaluation has followed sample children through the end of 3rd grade, with rich data available across many outcomes over multiple years. The foundation of random assignment both empowers and challenges methodological development when seeking to measure program effectiveness without bias and with balanced interpretation as to the strength of the statistical data and measurement tools used. Throughout its 12-year course, the HSIS has sought to capitalize on its experimental design, larger representative sample, and vast rich data elements.
Descriptors: Evaluation Methods, Data Analysis, Randomized Controlled Trials, Sampling, Early Childhood Education, Preschool Children, School Readiness, Program Effectiveness, Program Evaluation, Grade 3, Research Design, Disadvantaged Youth, Statistical Analysis, Psychometrics, Robustness (Statistics)
Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; Fax: 202-640-4401; e-mail: firstname.lastname@example.org; Web site: http://www.sree.org
Publication Type: Reports - Research
Education Level: Early Childhood Education; Grade 3; Primary Education; Elementary Education
Authoring Institution: Society for Research on Educational Effectiveness (SREE)