ERIC Number: EJ1192535
Record Type: Journal
Publication Date: 2018-Oct
Pages: 23
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0141-1926
EISSN: N/A
Testing The Validity of Value-Added Measures of Educational Progress With Genetic Data
British Educational Research Journal, v44 n5 p725-747 Oct 2018
Value-added measures of educational progress have been used by education researchers and policy-makers to assess the performance of teachers and schools, contributing to performance-related pay and position in school league tables. They are designed to control for all underlying differences between pupils and should therefore provide unbiased measures of school and teacher influence on pupil progress, however, their effectiveness has been questioned. We exploit genetic data from a UK birth cohort to investigate how successfully value-added measures control for genetic differences between pupils. We use raw value-added, contextual value-added (which additionally controls for background characteristics) and teacher-reported value-added measures built from data at ages 11, 14 and 16. Sample sizes for analyses range from 4,600 to 6,518. Our findings demonstrate that genetic differences between pupils explain little variation in raw value-added measures but explain up to 20% of the variation in contextual value-added measures (95% CI = 6.06% to 35.71%). Value-added measures built from teacher-rated ability have a greater proportion of variance explained by genetic differences between pupils, with 36.3% of their cross-sectional variation being statistically accounted for by genetics (95% CI = 22.8% to 49.8%). By contrast, a far greater proportion of variance is explained by genetic differences for raw test scores at each age of at least 47.3% (95% CI: 35.9 to 58.7). These findings provide evidence that value-added measures of educational progress can be influenced by genetic differences between pupils, and therefore may provide a biased measure of school and teacher performance. We include a glossary of genetic terms for educational researchers interested in the use of genetic data in educational research.
Descriptors: Validity, Value Added Models, Genetics, Foreign Countries, Teacher Effectiveness, School Effectiveness, Teacher Attitudes, Teacher Salaries, Academic Achievement, Correlation, Context Effect, Academic Ability, Case Studies, Cognitive Ability, Bias, Data Analysis, Secondary School Students, Secondary School Teachers
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom
Grant or Contract Numbers: N/A