NotesFAQContact Us
Search Tips
ERIC Number: ED490202
Record Type: Non-Journal
Publication Date: 2005-Apr
Pages: 16
Abstractor: Author
Setting the Response Time Threshold Parameter to Differentiate Solution Behavior from Rapid-Guessing Behavior
Kong, Xiaojing J.; Bhola, Dennison S.; Wise, Steven L.
Online Submission, Paper presented at Annual Meeting of the National Council on Measurement in Education (Montreal, Canada, Apr, 2005)
In this study four methods were compared for setting a response time threshold that differentiates rapid-guessing behavior from solution behavior when examinees are obliged to complete a low-stakes test. The four methods examined were: (1) a fixed threshold for all test items; (2) thresholds based on item surface features such as the amount of reading required; (3) thresholds based on visually inspecting response time distributions; (4) thresholds statistically generated based on a two-state mixture model (Schnipke & Scrams, 1997; 2002). To compare the sets of threshold parameters, we used the method designed by Wise and Kong (2005) to assess the reliability and validity of response time effort scores, which were generated on the basis of the specified threshold values. The results showed only minor differences among the four threshold identification methods. Recommendations were given regarding the uses of the methods. (Contains tables and 2 figures.)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A