ERIC Number: ED177196
Record Type: RIE
Publication Date: 1979-Apr
Reference Count: 0
Problems in Application of Latent Trait Models to Tailored Testing.
Koch, William R.; Reckase, Mark D.
Tailored testing procedures for achievement testing were applied in a situation that failed to meet some of the specifications generally considered to be necessary for tailored testing. Discrepancies from the appropriate conditions included the use of small samples for calibrating items, and the use of an item pool that was not designed to be homogeneous in content. The item pool contained 180 items concerning educational measurement that were calibrated separately by a one-parameter logistic model and by a three-parameter logistic model. The 110 undergraduate students were each tested at two sessions a week apart with both one-parameter and three-parameter tailored tests at each session. All tests were administered on a computer terminal. The results were studied for several characteristics including: goodness of fit of the observed responses to those predicted by each model; the information function of each test compared to a fifty-item traditional paper-and-pencil test; the reliabilities of the tailored tests; and the content validities of the tailored tests. A unidimensional tailored test of vocabulary was also administered, with satisfactory results. The achievement tests generally produced unsatisfactory results, presumably because of the discrepancies from appropriate conditions. (CTM)
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Sponsor: Office of Naval Research, Washington, DC. Personnel and Training Branch.
Authoring Institution: Missouri Univ., Columbia.
Identifiers: Computer Assisted Test Construction; Latent Trait Models; One Parameter Model; Three Parameter Model
Note: Paper presented at the Annual Meeting of the National Council on Measurement in Education (San Francisco, California, April 9-11, 1979)