NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1231639
Record Type: Journal
Publication Date: 2019
Pages: 16
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2165-8714
EISSN: N/A
Implementation of the Omega (?) Index to Detect Large-Scale Systematic Cheating
Vista, Alvin
European Journal of Educational Research, v8 n4 p1307-1322 2019
Cheating detection is an important issue in standardized testing, especially in large-scale settings. Statistical approaches are often computationally intensive and require specialised software to conduct. We present a two-stage approach that quickly filters suspected groups using statistical testing on an IRT-based answer-copying index. We also present an approach to mitigate data contamination and improve the performance of the index. The computation of the index was implemented through a modified version of an open source R package, thus enabling wider access to the method. Using data from PIRLS 2011 (N=64,232) we conduct a simulation to demonstrate our approach. Type I error was well-controlled and no control group was falsely flagged for cheating, while 16 (combined n=12,569) of the 18 (combined n=14,149) simulated groups were detected. Implications for system-level cheating detection and further improvements of the approach were discussed.
Eurasian Society of Educational Research Association. Ataturk District 70.Str. No:15 Gaziantep, Turkey 27260. Tel: +90-342-2116792; Fax: +90-342-2116677; e-mail: editor@eu-jer.com; Web site: http://www.eu-jer.com
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education; Grade 4; Intermediate Grades
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Progress in International Reading Literacy Study
Grant or Contract Numbers: N/A