The validity and reliability of the Technological Pedagogical Content Knowledge (TPACK) framework to measure the extent to which teachers can teach with technology, hinges on the ability to aggregate results across empirical studies. We synthesized mean difference effect sizes resulting from university classroom studies, which used a survey of…

Methodology for making cross-national comparisons is an area of increasing interest in social and public health related research. When studying socio-economic differences in health outcomes cross-nationally, there are several methodological issues of concern, especially when data is derived from self-reported questionnaires. Health Behaviour in…

The discussion here covers five articles that are linked in the sense that they all treat population invariance. This discussion of population invariance is a somewhat broader treatment of the subject than simply a discussion of these five articles. In particular, occasional reference is made to publications other than those in this issue. The…

This article discusses the five studies included in this issue. Each article addressed the same topic, population invariance of equating. They all used data from major standardized testing programs, and they all used essentially the same statistics to evaluate their results, namely, the root mean square difference and root expected mean square…

This paper discusses the four major types of test equating: (1) mean; (2) linear; (3) equipercentile; and (4) item response theory. The single-group, equivalent-group, and anchor-test data collection designs are presented as methods used for test equating. Issues related to assumptions and equating error are also addressed. The advantages and…

Two traditional equating schemes and seven item response theory equating schemes were compared. Data used came from the 1978 equating project of the Iowa Tests of Educational Development. The study entailed both the equating of forms of similar difficulty and the equating of levels of differing difficulty. (Arthor/RL)

Presents an overview of linking methods applied to performance assessment and discusses major issues and recent developments in linking performance assessments. Compares three common linking designs and two major linking methodologies (classical and item response theory (IRT)). Describes two classical equating methods and several IRT equating…

This paper summarizes some of the basic concepts in test equating. Various types of equating methods, as well as data collection designs, are outlined, with attempts to provide insight into preferred methods and techniques. Test equating describes a group of methods that enable test constructors and users to compare scores from two different forms…

The central idea in building and maintaining an item bank is to calibrate all the items onto a "common variable." The arithmetic involved in the calibration process is presented. It is recommended that an analysis of fit be done in every application to verify that the estimates of item difficulties are in fact sample-free. These…

Functional-level testing is fundamental to the evaluation models of the Elementary Secondary Education Act Title I Evaluation and Reporting System, although criteria for determining what is a functional-level test are unclear. Reliability and validity of test scores in the range of chance is at issue. (Author/RL)

In this article, the history of linking is summarized, and current linking frameworks that have been proposed are considered. Key publications discussed include Flanagan (1951), Angoff (1971), Linn (1993), Mislevy (1992), and Feuer, Holland, Green, Bertenthal, and Hemphill (1999). The article further focuses on the concordance situation for…

Equating studies using item response theory (IRT) are reviewed. The most well-known papers, as well as a sampling of lesser-known studies, are included. Accompanying tables list the papers and classify them according to the test used, models used, test length and type, sample size and type, method of assessment, equating design, and kinds of…

Criteria used in the equating process proposed in the literature are reviewed. The discussion begins by examining how equating is defined. The controversy over the best criterion, the utility of some, and whether a criterion is needed at all means that much work needs to be done in this area. (SLD)

The Maryland Functional Testing Program (MFTP) uses the Rasch model as the statistical framework for the analysis of test items and scores. This paper is designed to assist the reader in developing an understanding of the fit statistics in the Rasch model. Background materials on application of the Rasch model in statistical analysis of the MFTP…

The purposes of this paper are: (1) to review some of the major studies of applications of item response theory (IRT) methodology to test equating and synthesize their results; (2) to discuss what questions are as yet unanswered and what problems exist with research methodology; and (3) to provide direction for future research. (Author/LMO)