NotesFAQContact Us
Collection
Advanced
Search Tips
ERIC Number: ED476148
Record Type: Non-Journal
Publication Date: 2003
Pages: 40
Abstractor: N/A
Reference Count: N/A
ISBN: N/A
ISSN: N/A
Scoring Multiple True False Items: A Comparison of Summed Scores and Response Pattern Scores at Item and Test Levels.
Wu, Brad C.
The additive and response patterns scoring methods within and between multiple true-false (MTF) items were examined using data for 5,000 students for each of 2 years from the mathematics portion of the national college entrance examination in Taiwan. For additive scoring at item level, response to each option was scored dichotomously and added up to make an item clustered score, while at test level response to each item was scored dichotomously or polytomously by applying four methods, and then adding to sum of item score. For response patterns scoring the item response theory (IRT) ability estimated were estimated through the expected a posteriori procedure. The within-item IRT ability estimates were compared to the sum of the item scores at test level. Correlations between item clustered scores and within-item ability estimates were significant for all 10 items examined; correlations between sum of item scores and between-item ability estimates were also significant for all four scoring methods in two sets of tests. The results suggest that even at the risk of losing information, the use of item clustered scores and sum of item scores as estimates of the latent trait is reasonable, although the appropriateness of the item clustered scores should be examined prior to the test level estimation. The IRT ability estimates can be more informative when variation of discrimination parameters within items is large. The influence of item parameters on the IRT ability estimates was also discussed. (Contains 2 figures, 7 tables, and 39 references.) (Author/SLD)
Publication Type: Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Taiwan