ERIC Number: EJ1067107
Record Type: Journal
Publication Date: 2013
Pages: 9
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1913-9020
EISSN: N/A
Available Date: N/A
How Unstable Are "School Effects" Assessed by a Value-Added Technique?
Gorad, Stephen; Hordosy, Rita; Siddiqui, Nadia
International Education Studies, v6 n1 p1-9 2013
This paper re-considers the widespread use of value-added approaches to estimate school "effects", and shows the results to be very unstable over time. The paper uses as an example the contextualised value-added scores of all secondary schools in England. The study asks how many schools with at least 99% of their pupils included in the VA calculations, and with data for all years, had VA measures that were clearly positive for five years. The answer is--none. Whatever it is that VA is measuring, if it is measuring anything at all, it is not a consistent characteristic of schools. To find no schools with five successive years of positive VA means that parents could not use it as a way of judging how well their primary age children would do at age 16 in their future secondary school. Contextualised value-added (CVA) is used here for the calculations because there is good data covering five years that allows judgement of its consistency as a purported school characteristic. However, what is true of CVA is almost certainly true of VA approaches more generally, whether for schools, colleges, departments or individual teachers, in England and everywhere else. Until their problems have been resolved by further development to handle missing and erroneous data, value-added models should not be used in practice. Commentators, policy-makers, educators and families need to be warned. If value-added scores are as meaningless as they appear to be, there is a serious ethical issue wherever they have been or continue to be used to reward and punish schools or make policy decisions.
Descriptors: Foreign Countries, Outcomes of Education, Secondary Education, Educational Testing, Scores, Achievement Gains, Computation, Predictor Variables, Error of Measurement, Data, School Effectiveness, Ethics, Correlation
Canadian Center of Science and Education. 1120 Finch Avenue West Suite 701-309, Toronto, ON M3J 3H7, Canada. Tel: 416-642-2606 Ext 206; Fax: 416-642-2608; e-mail: ies@ccsenet.org; Web site: http://www.ccsenet.org/journal/index.php/es
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom (England)
Grant or Contract Numbers: N/A
Author Affiliations: N/A