ERIC Number: ED395960
Record Type: RIE
Publication Date: 1989-Sep
Reference Count: N/A
A Consideration for Variable Length Adaptive Tests.
Wingersky, Marilyn S.
In a variable-length adaptive test with a stopping rule that relied on the asymptotic standard error of measurement of the examinee's estimated true score, M. S. Stocking (1987) discovered that it was sufficient to know the examinee's true score and the number of items administered to predict with some accuracy whether an examinee's true score was over- or underestimated. She theorized that this result might be due to the standard error being correct only asymptotically. J. B. Sympson (1985) recommended two Bayesian stopping rules that do not rely on asymptotic properties. This paper replicates the Stocking study using one of the variable-length adaptive testing procedures recommended by Sympson to see whether that procedure gives the same results as the Stocking study. The Sympson procedure uses a stopping rule that relies on the posterior standard deviation of the number-right true score on a criterion test. In both the Stocking study and Sympson procedure, knowing the examinee's true score and the number of items administered is sufficient for predicting whether the estimated true score is over- or underestimated. This is due to the fact that the magnitude of both the asymptotic standard error of measurement of the estimated scores and the posterior standard deviation of the true score varies as the estimated true score varies. (Contains two tables, three figures, and five references.) (Author/SLD)
Publication Type: Reports - Evaluative
Education Level: N/A
Authoring Institution: Educational Testing Service, Princeton, NJ.
Identifiers: Asymptotic Standard Errors; Research Replication; Stopping Rules