ERIC Number: ED453259
Record Type: Non-Journal
Publication Date: 2001-Apr-12
Reference Count: N/A
Number Correct Scoring: Comparison between Classical True Score Theory and Multidimensional Item Response Theory.
Rotou, Ourania; Elmore, Patricia B.; Headrick, Todd C.
This study investigated the number-correct scoring method based on different theories (classical true-score theory and multidimensional item response theory) when a standardized test requires more than one ability for an examinee to get a correct response. The number-correct scoring procedure that is widely used is the one that is defined in classical true-score theory (CTT). In CTT, a test score is equal to the number of items an examinee answered, so that all items are weighted "one." It is also possible to use a form of number-correct scoring in which the weights of items are different. In this study, the accuracy of estimated number-correct scores relative to true number-correct scores under CTT, multidimensional item response theory (MIRT) and both MIRT and CTT were studied using simulated data for a standardized test in which true scores and estimated scores were known. A method in which item weights were based on MIRT and test scores based on CTT (MIX method) was found to be the most accurate method used to estimate the true score on an examinee. This MIX method was also significantly different from the other three scoring methods using the bootstrap analysis. An appendix contains definitions of the notations representing the various parameters and approaches. (Contains 20 references.) (SLD)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A