NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1014581
Record Type: Journal
Publication Date: 2013
Pages: 23
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-0655
EISSN: N/A
Detection of Test Collusion via Kullback-Leibler Divergence
Belov, Dmitry I.
Journal of Educational Measurement, v50 n2 p141-163 Sum 2013
The development of statistical methods for detecting test collusion is a new research direction in the area of test security. Test collusion may be described as large-scale sharing of test materials, including answers to test items. Current methods of detecting test collusion are based on statistics also used in answer-copying detection. Therefore, in computerized adaptive testing (CAT) these methods lose power because the actual test varies across examinees. This article addresses that problem by introducing a new approach that works in two stages: in Stage 1, test centers with an unusual distribution of a person-fit statistic are identified via Kullback-Leibler divergence; in Stage 2, examinees from identified test centers are analyzed further using the person-fit statistic, where the critical value is computed without data from the identified test centers. The approach is extremely flexible. One can employ any existing person-fit statistic. The approach can be applied to all major testing programs: paper-and-pencil testing (P&P), computer-based testing (CBT), multiple-stage testing (MST), and CAT. Also, the definition of test center is not limited by the geographic location (room, class, college) and can be extended to support various relations between examinees (from the same undergraduate college, from the same test-prep center, from the same group at a social network). The suggested approach was found to be effective in CAT for detecting groups of examinees with item pre-knowledge, meaning those with access (possibly unknown to us) to one or more subsets of items prior to the exam. (Contains 1 table and 13 figures.)
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA/
Publication Type: Reports - Research; Journal Articles
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Law School Admission Test
Grant or Contract Numbers: N/A