ERIC Number: EJ1081205
Record Type: Journal
Publication Date: 2015-Oct
Pages: 20
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0265-5322
EISSN: N/A
Available Date: N/A
Validating the Slovenian National Alignment to CEFR: The Case of the B2 Reading Comprehension Examination in English
Ilc, Gašper; Stopar, Andrej
Language Testing, v32 n4 p443-462 Oct 2015
The paper examines the results of the CEFR alignment project for the Slovenian national examinations in English. The authors aim to validate externally the standard-setting procedures by adopting a socio-cognitive model of validation (Khalifa & Weir, 2009; Weir, 2005) to analyse the scoring, context and cognitive validity of three reading subtests: the Slovenian B2 national examination and the international examinations FCE and CAE, aligned with B2 and C1 respectively. The relative comparability between the three subtests is determined by analysing the results of tests that have been administered to a group of 80 test-takers (expected CEFR level: B2). The placement of the test-takers also reveals to what extent the judgements of the Slovenian panellists about CEFR levels coincide with those reported for FCE and CAE. The study thus also explores whether the high degree of agreement between the judges on the alignment panel can be solely attributed to their adequate and precise understanding of CEFR descriptors--which is directly mirrored in their setting of the cut scores and relating the examination to relevant CEFR levels--or whether it can also be ascribed to their shared educational, national and cultural background. The answers to these questions are paramount because they reveal the descriptive adequacy of CEFR descriptors and because different interpretations of CEFR levels can significantly affect national testing policies and, consequently, language teaching and testing.
Descriptors: Foreign Countries, English (Second Language), Second Language Instruction, Second Language Learning, Alignment (Education), Reading Comprehension, Standards, Language Tests, Social Cognition, Cutting Scores, Test Validity, Language Proficiency, Measures (Individuals)
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Slovenia
Grant or Contract Numbers: N/A
Author Affiliations: N/A