NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1205325
Record Type: Journal
Publication Date: 2019
Pages: 24
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0267-1522
EISSN: N/A
'Phantom' Compositional Effects in English School Value-Added Measures: The Consequences of Random Baseline Measurement Error
Perry, Thomas
Research Papers in Education, v34 n2 p239-262 2019
A compositional effect is when pupil attainment is associated with the characteristics of their peers, over and above their own individual characteristics. Pupils at academically selective schools, for example, tend to out-perform similar-ability pupils who are educated with mixed-ability peers. Previous methodological studies however have shown that 'phantom' compositional effects can arise purely from measurement error. Through simulations using English National Pupil Database data, this paper demonstrates that moderate rates of measurement error in baseline scores can produce a systemic bias in value-added ('Progress') scores that favours higher ability pupils. This bias is large enough to explain the ostensibly superior performance of selective 'grammar' schools that is seen in the English data and create an appreciable bias across the school performance distribution. This paper describes how such biases can arise from 'regression attenuation' and discusses the more general methodological implications of the results. The paper concludes that the consequences of baseline measurement error on school value-added scores is greatly mitigated by controls for school-level prior attainment, but that the English 'Progress' value-added measures, as they do not control for prior attainment at school-level, are seriously biased and that the observed 'grammar school effect' is likely to be largely or wholly spurious.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Descriptive
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom (England)
Grant or Contract Numbers: N/A