ERIC Number: ED531795
Record Type: Non-Journal
Publication Date: 2012-Apr-5
Reference Count: 26
Value-Added Estimates for Phase 1 of the Pennsylvania Teacher and Principal Evaluation Pilot. Full Report
Lipscomb, Stephen; Chiang, Hanley; Gill, Brian
Mathematica Policy Research, Inc.
The Commonwealth of Pennsylvania plans to develop a new statewide evaluation system for teachers and principals in its public schools by school year 2013-2014. To inform the development of this evaluation system, the Team Pennsylvania Foundation (Team PA) undertook the first phase of the Pennsylvania Teacher and Principal Evaluation Pilot--henceforth referred to as Phase 1--2010 and 2011 in collaboration with a broad stakeholder group that included leaders from the Pennsylvania Department of Education (PDE), the Pennsylvania State Education Association (PSEA), school districts, and the business community. The purpose of Phase 1 was to develop and implement a pilot set of performance measures to obtain lessons for improving the use of classroom observations and student data in evaluating teacher and principal performance. None of the results from Phase 1 had a bearing on actual evaluations or personnel decisions for any teacher or principal. This report presents findings for the second track of Phase 1. In this track, Mathematica Policy Research used student-level data to develop value-added models (VAMs) for estimating teacher and principal effectiveness. VAMs estimate the effects of educators on student achievement growth. VAMs belong to the class of models that are generally referred to as student growth models, but a VAM estimate is not a measure of student growth; rather, it is an estimate of an educator's or a school's "contribution" to student growth. VAMs can be appropriate for use in teacher or principal evaluations because they produce information about educator effectiveness. Other indicators like student proficiency rates and descriptive measures of student growth might be appropriate as targets for school accountability purposes, but they should not be viewed as indicating what a teacher or school has contributed to student learning. Appended are: (1) Technical Specifications of the VAMS; (2) Data Sources and Sample Characteristics; and (3) Technical Results from Value-Added Analyses. (Contains 34 tables, 9 figures and 52 footnotes.) [For the "Value-Added Estimates for Phase 1 of the Pennsylvania Teacher and Principal Evaluation Pilot. Executive Summary", see ED531803. This report was supported by the Team Pennsylvania Foundation.]
Descriptors: Academic Achievement, Models, Outcomes of Education, Teacher Evaluation, Administrator Evaluation, Test Construction, Observation, Data Collection, Data Analysis, Evaluation Methods, Teacher Effectiveness, Administrator Effectiveness, Principals, Achievement Gains, Teacher Influence, Computation, School Districts, Teaching Methods, Correlation, Scoring Rubrics, Reading Achievement, Mathematics Achievement, School Effectiveness, Rating Scales
Mathematica Policy Research, Inc. P.O. Box 2393, Princeton, NJ 08543-2393. Tel: 609-799-3535; Fax: 609-799-0005; e-mail: firstname.lastname@example.org; Web site: http://www.mathematica-mpr.com
Publication Type: Numerical/Quantitative Data; Reports - Evaluative
Education Level: Elementary Secondary Education
Sponsor: Bill and Melinda Gates Foundation; Pennsylvania Department of Education
Authoring Institution: Mathematica Policy Research, Inc.
Identifiers - Location: Pennsylvania
IES Cited: ED563446; ED545232; ED550494; ED552484