NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ948212
Record Type: Journal
Publication Date: 2011-Dec
Pages: 19
Abstractor: As Provided
Reference Count: 17
ISBN: N/A
ISSN: ISSN-1076-9986
Multimodal Likelihoods in Educational Assessment: Will the Real Maximum Likelihood Score Please Stand up?
Wothke, Werner; Burket, George; Chen, Li-Sue; Gao, Furong; Shu, Lianghua; Chia, Mike
Journal of Educational and Behavioral Statistics, v36 n6 p736-754 Dec 2011
It has been known for some time that item response theory (IRT) models may exhibit a likelihood function of a respondent's ability which may have multiple modes, flat modes, or both. These conditions, often associated with guessing of multiple-choice (MC) questions, can introduce uncertainty and bias to ability estimation by maximum likelihood (ML) when standard Newton solutions are used. This article evaluates the performance of several maximization methods, including initial (grid) searches probing the function slopes, simulated annealing, exhaustive likelihood evaluation, and the standard Newton algorithm. In extensive studies, involving several million records of both generated and real data, the algorithms were evaluated with respect to precision and speed. Two methods, exhaustive search and grid search, followed by Newton steps, all yielded ML estimates at the required precision. At today's computer speeds, either of these algorithms may be considered for high-volume response pattern scoring. (Contains 2 tables and 10 figures.)
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A