ERIC Number: EJ1069081
Record Type: Journal
Publication Date: 2015
Abstractor: As Provided
Measuring Afterschool Program Quality Using Setting-Level Observational Approaches
Oh, Yoonkyung; Osgood, D. Wayne; Smith, Emilie P.
Journal of Early Adolescence, v35 n5-6 p681-713 Jun-Aug 2015
The importance of afterschool hours for youth development is widely acknowledged, and afterschool settings have recently received increasing attention as an important venue for youth interventions, bringing a growing need for reliable and valid measures of afterschool quality. This study examined the extent to which the two observational tools, that is, Caregiver Interaction Scales (CIS) and Promising Practices Rating Scales (PPRS), could serve as reliable and valid tools for assessing the various dimensions of afterschool setting quality. The observation data of 44 afterschool programs were analyzed using both standard psychometric procedures (i.e., internal consistency, interrater reliability, and factor analysis) and generalizability theory. The results show the potential promise of the instruments, on one hand, and suggest future directions for improvement of measurement design and development of the field, on the other hand. In particular, our findings suggest the importance of addressing the effect of day-to-day fluctuations in observed afterschool quality.
Descriptors: After School Programs, Program Effectiveness, Observation, Rating Scales, Test Reliability, Test Validity, Psychometrics, Generalizability Theory, Interrater Reliability, Factor Analysis
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: email@example.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Sponsor: National Institute on Drug Abuse (DHHS/PHS)
Authoring Institution: N/A
Identifiers - Location: Pennsylvania
Grant or Contract Numbers: R01 DA025187