NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ765849
Record Type: Journal
Publication Date: 2007
Pages: 23
Abstractor: Author
Reference Count: 22
ISBN: N/A
ISSN: ISSN-0276-8739
How Close Is Close Enough? Evaluating Propensity Score Matching Using Data from a Class Size Reduction Experiment
Wilde, Elizabeth Ty; Hollister, Robinson
Journal of Policy Analysis and Management, v26 n3 p455-477 Sum 2007
In recent years, propensity score matching (PSM) has gained attention as a potential method for estimating the impact of public policy programs in the absence of experimental evaluations. In this study, we evaluate the usefulness of PSM for estimating the impact of a program change in an educational context (Tennessee's Student Teacher Achievement Ratio Project [Project STAR]). Because Tennessee's Project STAR experiment involved an effective random assignment procedure, the experimental results from this policy intervention can be used as a benchmark, to which we compare the impact estimates produced using propensity score matching methods. We use several different methods to assess these nonexperimental estimates of the impact of the program. We try to determine "how close is close enough," putting greatest emphasis on the question: Would the nonexperimental estimate have led to the wrong decision when compared to the experimental estimate of the program? We find that propensity score methods perform poorly with respect to measuring the impact of a reduction in class size on achievement test scores. We conclude that further research is needed before policymakers rely on PSM as an evaluation tool. (Contains 6 tables and 32 endnotes.)
John Wiley & Sons, Inc. Subscription Department, 111 River Street, Hoboken, NJ 07030-5774. Tel: 800-825-7550; Tel: 201-748-6645; Fax: 201-748-6021; e-mail: subinfo@wiley.com; Web site: http://www3.interscience.wiley.com/browse/?type=JOURNAL
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 1; Grade 2; Grade 3; Kindergarten
Audience: Policymakers
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Tennessee