ERIC Number: ED395030
Record Type: Non-Journal
Publication Date: 1994-Apr
Reference Count: N/A
Dealing with Uncertainty about Item Parameters: Expected Response Functions.
Mislevy, Robert J.; And Others
It is a common practice in item response theory (IRT) to treat estimates of item parameters, say "B" circumflex, as if they were the known, true quantities, "B." However, ignoring the uncertainty associated with item parameters can lead to biases and over-confidence in subsequent inferences such as ability estimation, especially when item-calibration samples are small. This paper demonstrates how to incorporate uncertainty about "B" with Lewis's "expected response functions" (ERFs), pointwise expected values of item response conditional on examinee proficiency averaged over posterior distributions of item parameters. This paper presents ERFs, outlines procedures for computing them and using them in practical work, and gives an illustration with data from the National Assessment of Educational Progress. Advantages of approximating ERFs response curves with members of familiar parametric families of IRT curves are noted. Two appendices present work on pseudolikelihood estimations and program documentation for two computer programs: EXPRESFN and PLOTIRF. (Contains 3 figures, 3 tables, and 18 references.) (Author/SLD)
Publication Type: Reports - Evaluative
Education Level: N/A
Sponsor: Office of Naval Research, Arlington, VA. Cognitive and Neural Sciences Div.
Authoring Institution: Educational Testing Service, Princeton, NJ.
Identifiers - Assessments and Surveys: National Assessment of Educational Progress