ERIC Number: EJ1231639
Record Type: Journal
Publication Date: 2019
Pages: 16
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2165-8714
EISSN: N/A
Implementation of the Omega (?) Index to Detect Large-Scale Systematic Cheating
Vista, Alvin
European Journal of Educational Research, v8 n4 p1307-1322 2019
Cheating detection is an important issue in standardized testing, especially in large-scale settings. Statistical approaches are often computationally intensive and require specialised software to conduct. We present a two-stage approach that quickly filters suspected groups using statistical testing on an IRT-based answer-copying index. We also present an approach to mitigate data contamination and improve the performance of the index. The computation of the index was implemented through a modified version of an open source R package, thus enabling wider access to the method. Using data from PIRLS 2011 (N=64,232) we conduct a simulation to demonstrate our approach. Type I error was well-controlled and no control group was falsely flagged for cheating, while 16 (combined n=12,569) of the 18 (combined n=14,149) simulated groups were detected. Implications for system-level cheating detection and further improvements of the approach were discussed.
Descriptors: Cheating, Identification, Computer Software, Standardized Tests, Item Response Theory, Multiple Choice Tests, Achievement Tests, International Assessment, Reading Achievement, Reading Tests, Grade 4, Foreign Countries
Eurasian Society of Educational Research Association. Ataturk District 70.Str. No:15 Gaziantep, Turkey 27260. Tel: +90-342-2116792; Fax: +90-342-2116677; e-mail: editor@eu-jer.com; Web site: http://www.eu-jer.com
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education; Grade 4; Intermediate Grades
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Progress in International Reading Literacy Study
Grant or Contract Numbers: N/A