ERIC Number: ED563416
Record Type: Non-Journal
Publication Date: 2012-Apr-17
Abstractor: As Provided
Reference Count: 7
Multilevel Issues in the Application of Propensity Score Matching: Simulations and Results for Evaluation of the Advanced Placement Program
Patterson, Brian F.
College Board, Slides presented at the Annual Meeting of the American Educational Research Association (AERA) (Vancouver, BC, Apr 17, 2012)
The main goal of this study was to illustrate and provide some direction for dealing with the complexities of propensity score matching within different multilevel contexts. Special attention is given to how procedures typically applied in a non-hierarchical setting may be modified to properly reduce the expected bias in the estimated treatment effect of a high school-level intervention on college-level outcomes. In particular, students self-selected into a high school level intervention and the outcome of interest was observed within the context of the college or university in which students subsequently enrolled. A simulation was prepared to delineate the relevant issues and to demonstrate the effects of ignoring a hierarchical nesting of subjects. An empirical example of an evaluation of a large-scale, national educational program is given.
Descriptors: Probability, Scores, Statistical Bias, High School Students, College Students, Intervention, Simulation, Program Evaluation, Advanced Placement, Advanced Placement Programs, Grades (Scholastic), Multivariate Analysis, Predictor Variables, Academic Achievement
College Board. 250 Vesey Street, New York, NY 10281. Tel: 212-713-8000; e-mail: firstname.lastname@example.org; Web site: http://research.collegeboard.org
Publication Type: Non-Print Media; Reference Materials - General
Education Level: High Schools; Secondary Education; Higher Education; Postsecondary Education
Authoring Institution: College Board