ERIC Number: EJ1171991
Record Type: Journal
Publication Date: 2018
Pages: 12
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1543-4303
EISSN: N/A
Teachers' Judgement Accuracy Concerning CEFR Levels of Prospective University Students
Fleckenstein, Johanna; Leucht, Michael; Köller, Olaf
Language Assessment Quarterly, v15 n1 p90-101 2018
Most English-medium programs at European universities require prospective students to take standardised tests for English as a foreign language (EFL) to be admitted. However, there are contexts in which individual teachers' judgements serve the same function, thus having high-stakes consequences for the higher education entrance of their students. The present study investigates the accuracy of CEFR-based judgements of upper secondary school EFL teachers in Germany and compares it to the accuracy of conventional grading. Seventy-three teachers located each of the students in their EFL class onto a CEFR level. Teachers' judgements were compared to the CEFR levels estimated from the TOEFL ITP using level, differentiation, and ranking component as indicators of judgement accuracy. Findings show that while CEFR-based judgements of relative EFL proficiency within classes (rank component) are rather appropriate, teachers substantially overestimate the total level of their students' achievement (level component). Compared to conventional grading, however, CEFR-based judgements lead to more accurate estimations of variance between students in a class (differentiation component). The findings are discussed with particular reference to the consequences for higher education entrance policy concerning CEFR levels B2 and C1 as relevant benchmarks.
Descriptors: Guidelines, Rating Scales, Language Proficiency, Second Language Learning, Accuracy, Foreign Countries, International Organizations, English (Second Language), College Admission, Language of Instruction, Language Tests, Student Mobility, International Cooperation, Educational Cooperation, Study Abroad, Admission Criteria, Decision Making, Grading, Academic Achievement, Benchmarking, Secondary School Students, Second Language Instruction, Statistical Analysis
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Europe; Germany
Identifiers - Assessments and Surveys: Test of English as a Foreign Language
Grant or Contract Numbers: N/A