NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ914486
Record Type: Journal
Publication Date: 2011
Pages: 19
Abstractor: As Provided
Reference Count: 56
ISSN: ISSN-1543-4303
Item Writer Judgments of Item Difficulty versus Actual Item Difficulty: A Case Study
Sydorenko, Tetyana
Language Assessment Quarterly, v8 n1 p34-52 2011
This study investigates how accurate one item writer can be on item difficulty estimates and whether factors affecting item writer judgments correspond to predictors of actual item difficulty. The items were based on conversational dialogs (presented as videos online) that focus on pragmatic functions. Thirty-five 2nd-, 3rd-, and 4th-year learners of Russian participated. The results indicated that the hypothesized item difficulty was a weak, although significant, predictor of actual item difficulty. Intermediate and advanced items did not differ in difficulty, which may suggest that it is more challenging to predict higher level item difficulty or to design higher level items. In general, the item writer was accurate on predictions involving linguistic focus and response format. However, the effect of topical knowledge was not accounted for. This study provides implications for training item writers and for conducting future studies on item difficulty estimation. (Contains 9 tables and 6 footnotes.)
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A