NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1125345
Record Type: Journal
Publication Date: 2017
Pages: 39
Abstractor: As Provided
ISSN: ISSN-1934-5747
Characteristics of School Districts That Participate in Rigorous National Educational Evaluations
Stuart, Elizabeth A.; Bell, Stephen H.; Ebnesajjad, Cyrus; Olsen, Robert B.; Orr, Larry L.
Journal of Research on Educational Effectiveness, v10 n1 p168-206 2017
Given increasing interest in evidence-based policy, there is growing attention to how well the results from rigorous program evaluations may inform policy decisions. However, little attention has been paid to documenting the characteristics of schools or districts that participate in rigorous educational evaluations, and how they compare to potential target populations for the interventions that were evaluated. Utilizing a list of the actual districts that participated in 11 large-scale rigorous educational evaluations, we compare those districts to several different target populations of districts that could potentially be affected by policy decisions regarding the interventions under study. We find that school districts that participated in the 11 rigorous educational evaluations differ from the interventions' target populations in several ways, including size, student performance on state assessments, and location (urban/rural). These findings raise questions about whether, as currently implemented, the results from rigorous impact studies in education are likely to generalize to the larger set of school districts--and thus schools and students--of potential interest to policymakers, and how we can improve our study designs to retain strong internal validity while also enhancing external validity.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: National Institute of Mental Health (DHHS/NIH); National Science Foundation (NSF); Institute of Education Sciences (ED)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: K25MH083846; DRL1335843; R305A090307