NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ911163
Record Type: Journal
Publication Date: 2011-Feb
Pages: 31
Abstractor: As Provided
Reference Count: 38
ISBN: N/A
ISSN: ISSN-0002-8312
Different Tests, Different Answers: The Stability of Teacher Value-Added Estimates across Outcome Measures
Papay, John P.
American Educational Research Journal, v48 n1 p163-193 Feb 2011
Recently, educational researchers and practitioners have turned to value-added models to evaluate teacher performance. Although value-added estimates depend on the assessment used to measure student achievement, the importance of outcome selection has received scant attention in the literature. Using data from a large, urban school district, I examine whether value-added estimates from three separate reading achievement tests provide similar answers about teacher performance. I find moderate-sized rank correlations, ranging from 0.15 to 0.58, between the estimates derived from different tests. Although the tests vary to some degree in content, scaling, and sample of students, these factors do not explain the differences in teacher effects. Instead, test timing and measurement error contribute substantially to the instability of value-added estimates across tests. (Contains 14 notes, 9 tables, and 2 figures.)
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Elementary Education; Elementary Secondary Education; Grade 3; Grade 4; Grade 5
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Stanford Achievement Tests
IES Cited: ED544797; ED544205; ED544674