ERIC Number: EJ1100461
Record Type: Journal
Publication Date: 2016-Jun
Pages: 26
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1076-9986
EISSN: N/A
Grade of Membership Response Time Model for Detecting Guessing Behaviors
Pokropek, Artur
Journal of Educational and Behavioral Statistics, v41 n3 p300-325 Jun 2016
A response model that is able to detect guessing behaviors and produce unbiased estimates in low-stake conditions using timing information is proposed. The model is a special case of the grade of membership model in which responses are modeled as partial members of a class that is affected by motivation and a class that responds only according to the level of ability. Monte Carlo simulations were conducted to compare the proposed model with an approach that ignored guessing and an approach based on item filtering. In each simulated condition, the proposed model outperformed the other approaches by showing the lowest level of bias and the highest precision of item and persons estimates. Finally, the model was estimated using real life data from Programme for the International Assessment of Adult Competencies research (PIAAC). The results showed slight but expected corrections for the levels of proficiency in all countries.
Descriptors: Reaction Time, Models, Guessing (Tests), Computation, Group Membership, Classification, Motivation, Ability, Monte Carlo Methods, Comparative Analysis, Bias, International Assessment, Foreign Countries, Maximum Likelihood Statistics
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Australia; Austria; Belgium; Canada; Cyprus; Czech Republic; Denmark; Estonia; Finland; France; Germany; Ireland; Italy; Japan; Netherlands; Poland; Slovakia; South Korea; Spain; Sweden; United Kingdom (England); United Kingdom (Northern Ireland); United States
Grant or Contract Numbers: N/A