NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ806031
Record Type: Journal
Publication Date: 2006-May-1
Pages: 47
Abstractor: As Provided
Reference Count: 22
ISSN: ISSN-1068-2341
Gathering Evidence on an After-School Supplemental Instruction Program: Design Challenges and Early Findings in Light of NCLB
Chatterji, Madhabi; Kwon, Young Ae; Sng, Clarice
Education Policy Analysis Archives, v14 n12 p1-47 May 2006
The No Child Left Behind (NCLB) Act of 2001 requires that public schools adopt research-supported programs and practices, with a strong recommendation for randomized controlled trials (RCTs) as the "gold standard" for scientific rigor in empirical research. Within that policy framework, this paper compares the relative utility of federally-recommended RCT versus the demonstrated "extended term mixed-method" (ETMM) designs as options for monitoring effects of novel programs in real-time field settings. Guided by the program's theory of action, a year-long, two-phase study was conducted to monitor the context, processes and early outcomes of an after-school supplemental program in a New York elementary school. In both phases, the design combined a matched-groups, quasi-experiment with qualitative classroom observations and descriptive surveys. Early findings showed some positive, albeit "gross" program effects. Although findings are tentative, the ETMM approach enhanced interpretations by shedding light on relevant environmental variables, causes for program instabilities and sample attrition, and factors affecting treatment fidelity and scaling-up of the program beyond the pilot year. (Contains 3 figures, 18 tables, and 1 footnote.)
Colleges of Education at Arizona State University and the University of South Florida. c/o Editor, USF EDU162, 4202 East Fowler Avenue, Tampa, FL 33620-5650. Tel: 813-974-3400; Fax: 813-974-3826; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: New York
Identifiers - Laws, Policies, & Programs: No Child Left Behind Act 2001