NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ942268
Record Type: Journal
Publication Date: 2011-Oct
Pages: 6
Abstractor: As Provided
Reference Count: 6
ISSN: ISSN-0146-6216
Comparing Methods for Item Analysis: The Impact of Different Item-Selection Statistics on Test Difficulty
Jones, Andrew T.
Applied Psychological Measurement, v35 n7 p566-571 Oct 2011
Practitioners often depend on item analysis to select items for exam forms and have a variety of options available to them. These include the point-biserial correlation, the agreement statistic, the B index, and the phi coefficient. Although research has demonstrated that these statistics can be useful for item selection, no research as of yet has compared the difficulty of the items that these statistics will select in test development. The purpose of this research was to compare the difficulty of the items that these statistics would select for a test form and how the difficulty of item selection might vary, depending on the cut score. Results showed that considerable variability existed between the difficulty levels of the items selected by each of the statistics. The difference in difficulty depended on the location of the cut score. The agreement statistic tended to select the easiest items, whereas the point-biserial correlation selected items near the mean. Other results showed that the phi index tended to select items near the value of the cut score, whereas the B index followed this pattern to a lesser extent. (Contains 1 figure and 1 table.)
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A