ERIC Number: EJ769057
Record Type: Journal
Publication Date: 2007
Pages: 14
Abstractor: Author
ISBN: N/A
ISSN: ISSN-0013-1644
EISSN: N/A
Setting the Response Time Threshold Parameter to Differentiate Solution Behavior from Rapid-Guessing Behavior
Kong, Xiaojing J.; Wise, Steven L.; Bhola, Dennison S.
Educational and Psychological Measurement, v67 n4 p606-619 2007
This study compared four methods for setting item response time thresholds to differentiate rapid-guessing behavior from solution behavior. Thresholds were either (a) common for all test items, (b) based on item surface features such as the amount of reading required, (c) based on visually inspecting response time frequency distributions, or (d) statistically estimated using a two-state mixture model. The thresholds were compared using the criteria proposed by Wise and Kong to establish the reliability and validity of response time effort scores, which were generated on the basis of the specified threshold values. The four methods yielded very similar results, indicating that response time effort is not very sensitive to the particular threshold identification method used. Recommendations are given regarding use of the various methods. (Contains 5 tables and 1 figure.)
Descriptors: Test Items, Reaction Time, Timed Tests, Item Response Theory, Multidimensional Scaling, Test Validity, Test Reliability, Response Style (Tests), Undergraduate Students, Psychometrics, Multitrait Multimethod Techniques, Comparative Testing, Research Methodology
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A