A major challenge that decisions makers face in multi-national organizations is how to compare managers from different parts of the globe. This challenge is both psychometric and practical. We draw on the cross-cultural psychology literature to propose a three-step framework to compare personality data from different countries. The first step…

As with any test administered across linguistically and culturally diverse groups, evidence suggesting the equivalence of score meaning across countries is needed for valid comparisons. The current study examines the cross-cultural equivalence of score interpretations from the Trends in International Mathematics and Science Study (TIMSS)-1999 from…

"Item models" (LaDuca, Staples, Templeton, & Holzman, 1986) are classes from which it is possible to generate items that are equivalent/isomorphic to other items from the same model (e.g., Bejar, 1996, 2002). They have the potential to produce large numbers of high-quality items at reduced cost. This article introduces data from an application of…

In this study, we examined the presence of differential item functioning (DIF) among groups of students who were tested in their native language or in a different language when participating in the 1999 Trends in International Mathematics and Science Study. Data from 18,837 examinees from three countries (Singapore, United States, and Iran) were…

In most operational computerized adaptive testing (CAT) programs, the Sympson-Hetter (SH) method is used to control the exposure of the items. Several modifications and improvements of the original method have been proposed. The Stocking and Lewis (1998) version of the method uses a multinomial experiment to select items. For severely constrained…

The range of response options has been shown to influence the answers given in self-report instruments that measure behaviors ranging from television viewing to sexual partners. The current research extends this line of inquiry to 36 quantitative items extracted from a biographical inventory used in personnel selection. A total of 92…

Tests often are used to assist in assessing common childhood disabilities and disorders (e.g., mental retardation). Learning disabilities and difficulties (LD) constitute the plurality, even the majority, of school-related disorders in many countries. However, tests and other assessment methods to assess LD are not available universally and, among…

There has been considerable research regarding the extent to which psychometric sound assessments sometimes yield individual score estimates that are inconsistent with the response patterns of the individual. It has been suggested that individual response patterns may differ from expectations for a number of reasons, including subject motivation,…

Ethics codes are designed to protect the public by prescribing behaviors professionals are expected to exhibit. Although test use is universal, albeit reflecting strong Western influences, previous studies that examine the degree issues pertaining to test development and use and that are addressed in ethics codes of national psychological…

This report shows a classification of differential item functioning (DIF) sources that have an effect on the adaptation of tests. This classification is based on linguistic and cultural criteria. Four general DIF sources are distinguished: cultural relevance, translation problems, morph syntactical differences, and semantic differences. The…

This study compares five scoring approaches for a test of clinical reasoning skills. All of the approaches incorporate information about the correct item responses selected and the errors, such as selecting too many responses or selecting a response that is inappropriate and/or harmful to the patient. The approaches are combinations of theoretical…

One of the most revolutionary advances in psychometric research during the last decades has been the systematic development of statistical models that allow for cognitive psychometric research (CPR) to be conducted. Many of the models currently available for such purposes are extensions of basic latent variable models in item response theory…

Studies of test dimensionality indicate that many large-scale science assessments measure multiple dimensions. These findings have reinforced the perspective that science achievement is an inherently dynamic process and that there is benefit in reporting subscores in science. A limitation with some of these studies is that they fail to indicate…

Recent data from 12 pairs of tests representing eight standardization samples show that American IQ gains have occurred at a rate of 0.308 points per year from 1972 to 2002. Linked with earlier IQ gains, Americans have gained about 22 points over the 70 years between 1932 and 2002. Comparing the new WISC-IV (2002) and the old WISC-III (1989) shows…

Prior research regarding practice effects on ability tests has focused primarily on the differences in average score gains across different types of preparation (e.g., test retaking vs. focused item practice vs. coaching). In contrast, there has been little concerted effort towards understanding the significant variance in score gains across…