NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1014792
Record Type: Journal
Publication Date: 2013-Jun
Pages: 11
Abstractor: As Provided
ISSN: ISSN-0731-1745
Setting Standards for English Foreign Language Assessment: Methodology, Validation, and a Degree of Arbitrariness
Tiffin-Richards, Simon P.; Pant, Hans Anand; Koller, Olaf
Educational Measurement: Issues and Practice, v32 n2 p15-25 Jun 2013
Cut-scores were set by expert judges on assessments of reading and listening comprehension of English as a foreign language (EFL), using the bookmark standard-setting method to differentiate proficiency levels defined by the Common European Framework of Reference (CEFR). Assessments contained stratified item samples drawn from extensive item pools, calibrated using Rasch models on the basis of examinee responses of a German nationwide assessment of secondary school language performance. The results suggest significant effects of item sampling strategies for the bookmark method on cut-score recommendations, as well as significant cut-score judgment revision over cut-score placement rounds. Results are discussed within a framework of establishing validity evidence supporting cut-score recommendations using the widely employed bookmark method. (Contains 3 tables, 2 figures, and 3 notes.)
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Germany
Grant or Contract Numbers: N/A