This essay describes the problems involved in developing a comprehensive multiple choice exam in macroeconomics. It also attempts to promote dialogue about the testing instruments used to satisfy institutional effectiveness requirements. One section briefly compares the advantages and disadvantages of using essays instead of multiple choice exams.…

Multiple group factor analysis is described and illustrated through a simulation involving 5,000 examinees. The estimation process of the group factors were implemented using the TESTFACT program of Wilson and others (1987). Group factor analysis is described as a special case of confirmatory factor analysis. Group factors can be computed based on…

Procedures for correcting for guessing and for assessing partial knowledge (correction-for-guessing, three-decision scoring, elimination/inclusion scoring, and confidence or probabilistic scoring) are discussed. Mean scores and internal consistency reliability estimates were compared across three administration and scoring procedures for…

A classical problem in mastery testing is the choice of passing score and test length so that the mastery decisions are optimal. This problem has been addressed several times from a variety of viewpoints. In this paper, the usual indifference zone approach is adopted, with a new criterion for optimizing the passing score. Specifically,…

Occasionally, situations arise where mixtures of two binomials with one known success parameter are met. An example in educational testing is the mastery or random guessing model in which an examinee is supposed either to master the items or not to master them and to guess blindly. This paper gives moment estimators for such mixtures and presents…

One means of learning about the processes operating in a multiple choice test is to include some test items, called nonsense items, which have no correct answer. This paper compares two versions of a mathematical model of test performance to interpret test data that includes both genuine and nonsense items. One formula is based on the usual…

The aim of this study was to show that the superiority of corrected-for-guessing scores over number right scores as true score estimates depends on the ability of examinees to recognize situations where they can eliminate one or more alternatives as incorrect and to omit items where they would only be guessing randomly. Previous investigations…

The purpose of this paper is to derive explicit estimates of the parameters of a latent structure model when the skills represented by the test items are hierarchically related. Two special cases are described, which may be used as an approximation to the Dayton and Macready model and also provide initial estimates in an iterative estimation…

Because motivational factors and test wiseness can contaminate testing used for needs assessments or evaluation purposes, techniques for increasing student and teacher motivation are discussed. Guidelines concerning guessing are also presented. While guessing is encouraged on program evaluation or screening tests, it is not advocated for…

An attempt is made to explore the use of subjective probabilities in the analysis of item data, especially criterion-referenced item data. Two assumptions are implicit: (1) one wants to obtain a maximum amount of information with respect to an item using a minimum number of subjects; and (2) once the item is validated, it may well be administered…

This paper provides substantial evidence in favor of the continued use of conventional objective testing procedures in lieu of either the Coombs' cross-out technique or the Dressel and Schmid free-choice response procedure. From the studies presented in this paper, the tendency is for the cross-out and the free choice methods to yield a decrement…

Two basic issues are discussed that involve the Carver model of the relationship between test score and knowledge. The first of these concerns different types of tests which have different probabilities of obtaining the correct answer due to guessing. A derivation is shown which places different test types "on-a-par"--meaning that two tests are…

Different forms of a vocabulary test were administered to college students. Results indicated that as the frequency of specific determiners increased, they formed increasingly strong but differential guessing response sets in high and low scoring groups; however, the magnitude of the effect was much stronger for position specific determiners.…

Provides a sampling of recent program development ideas that show the varied nature of test wiseness instruction. Warns that teachers are unsophisticated test writers. (ARH)