A 2-facet measurement model is identified, and its coefficient of generalizability (CG) is examined. Three other multifaceted measurement models and their CGs are identified. An empirical investigation of all four procedures is conducted using data from a study of the psychopathology of 71 prison inmates. (SLD)

Develops basic concepts of generalizability theory using hypothetical study of reliability of scores of vocational interest inventory. Asserts that generalizability theory makes it possible to consider all possible sources of unreliability simultaneously and to design optimal decision-making study. (NB)

Items previously described as "negatively worded" are redefined as "connotatively inconsistent" because this term has a broader base for generalization. Using generalizability theory with a sample of 102 graduate students, the study showed that connotatively consistent and reversed connotatively inconsistent items were not…

This rejoinder to criticism of a previous article defends the Columbus Group definition of giftedness and talent by comparing and contrasting this definition with Gagne's Differentiated Model of Giftedness and Talent. Thresholds of giftedness and talent, including generalizability and clinical experience that support the Columbus Group definition,…

Evaluated Angoff ratings from eight different occupational licensing examinations through generalizability theory to estimate the optimal number of raters. Results indicate that approximately 10 to 15 raters is an optimal target range. (SLD)

The current study extended previous research on curriculum-based measurement in mathematics (M-CBM) assessments. The purpose was to examine the generalizability and dependability of multiple-skill M-CBM computation assessments across various assessment durations (1, 2, 3, 4, 5, and 6 minutes). Results of generalizability and dependability studies…

In this study, two approaches are used to assess the stability of Myers-Briggs Type Indicator scores across 3 administrations (N = 231): longitudinal configural frequency analysis with categorical scores and generalizability theory with the Preference Clarity Indices and continuous scores. The results are generally positive. Evaluation of…

This is a construct validation study of a second language speaking assessment that reported a language profile based on analytic rating scales and a composite score. The study addressed three key issues: score dependability, convergent/discriminant validity of analytic rating scales and the weighting of analytic ratings in the composite score.…

Arguments are presented for conceptualizing validity within a postmodern approach. Validity, reliability, and generalizability have been a holy trinity of social science research, and standard definitions of validity have been taken from criteria developed for psychometric tests. From a postmodern point of view, validity is sometimes discarded as…

Generalizability or invariance procedures have been known for over three decades. Through the years, these procedures have not been widely discussed or employed. One reason for the lack of use is that most of the articles on invariance procedures have been mathematically oriented. The mathematical orientation of research articles and the lack of…

Generalizability theory was used in this study of the Group Embedded Figures Test, which was administered to undergraduates in a mathematics course. Results indicated that the test has desirable psychometric characteristics, including test and item difficulty and item discrimination coefficients. (Author/GDC)

Despite much evidence that the Jenkins Activity Survey Type A (JAS Type A) scale is lacking in essential psychometric properties, it continues to be widely used for measuring coronary-prone behavior. Four psychometric properties of the scale were assessed. The scale failed to satisfy accepted reliability and validity criteria. (Author/JAZ)

The problem of predicting universe scores for samples of examinees based on their responses to samples of items is treated. The measurement model categorizes items according to the cells of a table of test specifications, and the linear function derived for minimizing error variance in prediction uses responses to these categories. (Author/JKS)

These analyses suggest that if a criterion-referenced test had a reliability (defined in terms of internal consistency) below 0.5, a simple a priori procedure would provide better estimates of students' universe scores than would individual observed scores. (Author/LMO)

A methodology for determining the optimal number of observations to use in a measurement design when resource constraints are imposed is presented. Two- and three-facet designs are outlined. Parallel closed form formulae can easily be determined for other designs. (TJH)