ERIC Number: EJ1238513
Record Type: Journal
Publication Date: 2019-Dec
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2330-8516
EISSN: N/A
Does Rearranging Multiple-Choice Item Response Options Affect Item and Test Performance? Research Report. ETS RR-19-02
Wang, Lin
ETS Research Report Series, Dec 2019
Rearranging response options in different versions of a test of multiple-choice items can be an effective strategy against cheating on the test. This study investigated if rearranging response options would affect item performance and test score comparability. A study test was assembled as the base version from which 3 variant versions were created by rearranging the response options of the items. The 4 versions were administered to randomly equivalent samples of approximately 1,200 test takers in an operational administration. The weighted root mean squared difference and the test characteristic curves were computed from the data to assess the differences between the base and its variant versions. The item-level and test-level results show very small differences between the base and the 3 variant versions.
Descriptors: Multiple Choice Tests, Test Items, Test Format, Scores, Test Construction, Differences, Item Response Theory
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A

Peer reviewed
