NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1407186
Record Type: Journal
Publication Date: 2023
Pages: 29
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1557-3060
EISSN: EISSN-1557-3079
Leveraging Experimental and Observational Evidence to Assess the Generalizability of the Effects of Early Colleges in North Carolina
Sarah Fuller; Douglas Lee Lauen; Fatih Unlu
Education Finance and Policy, v18 n4 p568-596 2023
Early college high schools (ECHSs) in North Carolina are small public schools of choice on college campuses that seek to promote attaining postsecondary credits in high school, college readiness, and postsecondary enrollment for underrepresented groups. Evidence from randomized control trials (RCTs) has shown positive effects of the ECHS model on important high school and postsecondary outcomes but appear to be underpowered to detect moderation effects. Furthermore, RCTs rarely address the key question of primary policy interest: Is the program effective on average across the population? This leaves us uncertain about: (1) whether the early college intervention is a good strategy for helping to close enrollment and attainment gaps between under- and overrepresented groups, and (2) whether the expansion of the ECHS model will lead to the positive results that the RCT studies suggest. This study uses administrative data on all ECHSs in North Carolina including those that were part of a lottery study. This allows us to generate RCT estimates for the ECHSs in the lottery sample and quasi-experimental estimates for both the lottery and non-lottery ECHSs. We leverage this unique circumstance to generate estimates of the effect of ECHS on postsecondary outcomes that simultaneously maximize both internal and external validity. Specifically, because generalization depends on both moderation and sample selection, we: (1) investigate sample selection, (2) conduct a moderation analysis to determine whether the effects of the intervention vary by key factors that also predict sample selection, and (3) produce a pooled estimate by extending a method called cross-design synthesis to incorporate both RCT evidence and quasi-experimental evidence. We find strong evidence that the positive results of the RCTs generalize to the full sample of ECHSs, which provides stronger evidence of effectiveness.
MIT Press. 55 Hayward Street, Cambridge, MA 02142. Tel: 617-253-2889; Fax: 617-253-1709; e-mail: journals-rights@mit.edu; Web site: http://www.mitpressjournals.org/loi/edfp
Related Records: ED643800
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education; High Schools; Higher Education; Postsecondary Education
Audience: N/A
Language: N/A
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
Identifiers - Location: North Carolina
IES Funded: Yes
Grant or Contract Numbers: R305A150477