ERIC Number: ED421547
Record Type: Non-Journal
Publication Date: 1998
Reference Count: N/A
Statistical Tests for Person Misfit in Computerized Adaptive Testing. Research Report 98-01.
Glas, Cees A. W.; Meijer, Rob R.; van Krimpen-Stoop, Edith M. L. A.
Recently, several person-fit statistics have been proposed to detect nonfitting response patterns. This study is designed to generalize an approach followed by Klauer (1995) to an adaptive testing system using the two-parameter logistic model (2PL) as a null model. The approach developed by Klauer is described, and some difficulties in generalizing it to a computerized adaptive testing model are explored. Alternative approaches are presented, and the results of a power study and the consequences for person-fit measurement in adaptive testing situations are discussed. The first part of the simulation concerns the ability to ignore the process that causes missing data and the impact of the fact that data in adaptive testing are not observed at random. Then the power of the proposed three tests is studied. Results suggest that tests against local independence in the 2PL have little power, but that the power for testing against nonvariant abilities is relatively larger but still low. (Contains 4 tables and 18 references.) (SLD)
Descriptors: Adaptive Testing, Computer Assisted Testing, Foreign Countries, Power (Statistics), Responses, Testing Problems
Faculty of Educational Science and Technology, University of Twente, P.O. Box 217, 7500 AE Enschede, The Netherlands.
Publication Type: Reports - Evaluative
Education Level: N/A
Authoring Institution: Twente Univ., Enschede (Netherlands). Faculty of Educational Science and Technology.