ERIC Number: ED121819
Record Type: Non-Journal
Publication Date: 1976-Mar
Reference Count: N/A
Some Properties of a Bayesian Adaptive Ability Testing Strategy.
McBride, James R.; Weiss, David J.
Four monte carlo simulation studies of Owen's Bayesian sequential procedure for adaptive mental testing were conducted. Whereas previous simulation studies of this procedure have concentrated on evaluating it in terms of the correlation of its test scores with simulated ability in a normal population, these four studies explored a number of additional properties, both in a normally distributed population and in a distribution-free context. Study 1 replicated previous studies with finite item pools, but examined such properties as the bias of estimate, mean absolute error, and correlation of test length with ability. Studies 2 and 3 examined the same variables in a number of hypothetical infinite item pools, investigating the effects of item discriminating power, guessing, and variable vs. fixed test length. Study 4 investigated some properties of the Bayesian test scores as latent trait estimators, under three different configurations (regressions of item discrimination on item difficulty) of item pools. The properties of interest included the regression of latent trait estimates on actual trait levels, the conditional bias of such estimates, the information curve of the trait estimates, and the relationship of test length to ability level. The results of these studies indicated that the ability estimates derived from the Bayesian test strategy were highly correlated with ability level. However, the ability estimates were also highly correlated with number of items administered, were nonlinearly biased, and provided measurements which were not of equal precision at all levels of ability. (Author)
Publication Type: Reports - Research
Education Level: N/A
Sponsor: Office of Naval Research, Arlington, VA. Personnel and Training Research Programs Office.
Authoring Institution: Minnesota Univ., Minneapolis. Dept. of Psychology.