NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1296853
Record Type: Journal
Publication Date: 2021
Pages: 7
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1916-4742
EISSN: N/A
Identifying Guessing in English Language Tests via Rasch Fit Statistics: An Exploratory Study
Coniam, David; Lee, Tony; Lampropoulou, Leda
English Language Teaching, v14 n5 p23-29 2021
This article explores the issue of identifying guessers -- with a specific focus on multiple-choice tests. Guessing has long been considered a problem due to the fact that it compromises validity. A test taker scoring higher than they should through guessing does not provide a picture of their actual ability. After an initial description of issues associated with guessing, the article then outlines approaches which have been taken to either discourage test takers from guessing or which attempt statistically to handle the problem. From this, the article moves to a novel way of identifying potential guessers: from the post hoc use of Rasch fit statistics. Two datasets, each consisting of approximately 200 beginner level English language test takers were split into two. In each dataset, half the test takers' answers were randomised -- to approximate guessing. Results obtained via a Rasch analysis of the data was then passed to an analyst who used the Rasch fit statistics to identify possible guessers. On each dataset, 80% of guessers were identified.
Canadian Center of Science and Education. 1595 Sixteenth Ave Suite 301, Richmond Hill, Ontario, L4B 3N9 Canada. Tel: 416-642-2606; Fax: 416-642-2608; e-mail: elt@ccsenet.org; Web site: http://www.ccsenet.org/journal/index.php/elt
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A