Data from a large-scale performance assessment (N = 105,731) were analyzed with five differential item functioning (DIF) detection methods for polytomous items to examine the congruence among the DIF detection methods. Two different versions of the item response theory (IRT) model-based likelihood ratio test, the logistic regression likelihood…

Based on a previously validated cognitive processing model of reading comprehension, this study experimentally examines potential generative components of text-based multiple-choice reading comprehension test questions. Previous research (Embretson & Wetzel, 1987; Gorin & Embretson, 2005; Sheehan & Ginther, 2001) shows text encoding and decision…

In test assembly, a fundamental difference exists between algorithms that select a test sequentially or simultaneously. Sequential assembly allows us to optimize an objective function at the examinee's ability estimate, such as the test information function in computerized adaptive testing. But it leads to the non-trivial problem of how to realize…

Reviews the criticisms of sampling assumptions in generalizability theory (and in reliability theory) and examines the feasibility of using representative sampling, stratification, homogeneity assumptions, and replications to address these criticisms. Suggests some general outlines for the conduct of generalizability theory studies. (SLD)

Reviews research literature on comparability issues in computerized adaptive testing (CAT) and synthesizes issues specific to comparability and test security. Develops a framework for evaluating comparability that contains three categories of criteria: (1) validity; (2) psychometric property/reliability; and (3) statistical assumption/test…

Reviews important milestones in the history of reliability, current issues related to reliability, and likely prospects for reliability from the perspective of what constitutes a replication of a measurement procedure. Pays special attention to the fixed/random aspects of facets that characterize replications. (SLD)

The inclusion of "purpose questions" before passages in reading comprehension tests is evaluated in light of recent research related to schema theory and adjunct questions. While research supports the use of purpose questions, gaps and weaknesses in the available data exist. Suggestions for further study are provided. (Author/LMO)

A literature review and a proposed means of measuring face validity, a test's appearance of being valid, are presented. Empirical evidence from examinees' perceptions of a college entrance examination support the reliability of measuring face validity. (GDC)

The Stanford Achievement Test Forms E and F were judged to be one of the best achievement batteries for assessing basic skills taught in grades one through nine. The test publisher provides several booklets in addition to the administration manual. These include the Norms Booklet, Handbook of Instructional Strategies, and Guide to Classroom…

The 12 subtests of the Ball Aptitude Battery (BAB) listed in the administration manual were described. The reviewer believes this aptitude battery, designed for use with high school students and adults in job selection and placement, needs major improvements. It is suggested that the BAB be used solely for research purposes. (DWH)

Two traditional equating schemes and seven item response theory equating schemes were compared. Data used came from the 1978 equating project of the Iowa Tests of Educational Development. The study entailed both the equating of forms of similar difficulty and the equating of levels of differing difficulty. (Arthor/RL)

The rationale for use of instructional sensitivity in the empirical review of test items is examined, and the results of a study that distinguishes instructional sensitivity from other item concepts are presented. Research is reviewed which indicates the existence of instructional sensitivity as a unique criterion-referenced test item concept. (RL)

This overview of the problem of linking testing and instruction describes two general policy areas which have focused attention on these links: studies of school effectiveness and minimum competency testing. Techniques used to investigate links between tests and instruction and policy issues that must be addressed are also discussed. (Author/CM)

The history of the relation between achievement tests and curriculum programs is reviewed, and it is concluded that content specialists are best qualified as sources of curricular goals to specify content, kinds of attainment, and standards. The specification of instructional intents is also considered from the perspective of modern cognition…

The implications that cognitive approaches to the study of reading can have for the assessment of reading achievement are discussed. Research in word decoding, semantic access, sentence processing, and discourse analysis is summarized with emphasis on processing efficiency required in one area affecting performance in another area. (Author/CM)