NotesFAQContact Us
Search Tips
ERIC Number: ED553147
Record Type: Non-Journal
Publication Date: 2013-Apr
Pages: 46
Abstractor: ERIC
Reference Count: N/A
A Snapshot of OST Programming in Philadelphia: An Evaluation of Six 21st Century Community Learning Center Grantees
Hartmann, Tracey A.; Gao, Jian; Kumar, Anurag; Edmunds, Kimberly
Research For Action
This report looks at the 21st Century Community Learning Center (CCLC) programs evaluated by Research for Action (RFA). It seeks to answer the following questions: (1) Who participated in the 21st CCLC programs and how frequently did they participate?; (2) What elements of program quality were in place to achieve the intended outcomes?; and (3) What was the relationship between program participation and academic, attendance and behavioral outcomes? RFA addresses these research questions through a mixed-methods study that includes an aggregate analysis of student outcomes data, program participation data, and qualitative data from the local evaluations including interviews with program staff, site visits, and a review of program documents. We report only aggregated findings to inform broader discussions about OST programs and systembuilding efforts in Philadelphia. The study includes data from each of the 24 sites operated by the seven provider organizations. However, the analysis of student outcomes focuses on a smaller subset of nine sites which operated programs for the entire school year and for which we had sufficient data. The analysis of student outcomes considers math and reading course grades, math and reading Pennsylvania System of School Assessment (PSSA) scores, school attendance, and suspensions, and compares OST participants to other non-participating students within their schools and in relationship to their level of participation in the program. A more detailed description of data collected and methods can be found in the Appendix. Overall, the study finds promising evidence of the benefits of the 21st CCLC programs in each of the outcome areas for elementary school students who participate more frequently. We found less evidence of the benefits for middle school students. However, the small sample size for middle school students reduced the strength of the analysis. Our analysis of 21st CCLC program content, staffing, and school partnerships demonstrated some elements of quality. It also suggested ways in which programs could increase their impact on students' academic outcomes. The report begins with descriptive information about the providers and schools and then presents analyses addressing each of the research questions. The sections of the report are as follows: (1) Context: Providers and Schools; (2) Participant Characteristics and Level of Participation; (3) Elements of Quality Programming: Program Content, Staff and School Partnerships; and (4) Student Outcomes: Academics, Attendance, Behavior. The following are appended: (1) Qualitative Methodology; (2) Quantitative Methods; and (3) Profile of Sites Included in the Student Outcome Analysis.
Research for Action. 3701 Chestnut Street, Philadelphia, PA 19104. Tel: 215-823-2500; Fax: 215-823-2510; e-mail:; Web site:
Publication Type: Reports - Evaluative; Reports - Research-practitioner Partnerships
Education Level: Elementary Education; Middle Schools; Secondary Education; Junior High Schools
Audience: N/A
Language: English
Sponsor: Pennsylvania Department of Education
Authoring Institution: Research for Action
Identifiers - Location: Pennsylvania