Outlines methods in Rasch measurement that are used to gather evidence for reliability and validity and attempts to articulate how these methods may be linked with current views of reliability and validity. (SLD)

Explored the possibility of developing a common metric for measuring goal orientation by simultaneously calibrating four commonly used goal orientation scales to see if item responses met the unidimensionality requirement. Results for 305 psychology students in France yield a common metric for interpretation and statistical analyses. (SLD)

Applied the rating scale model (D. Andrich, 1978) to data from a survey of student satisfaction with college services using data from a single college with item samples sizes ranging from 2 to 355. Compared to items' average ratings, item parameter estimates in the rating scale model did a better job of predicting the item receiving the higher…

Used Monte Carlo simulation to compare the relative measurement efficiency of polytomous modeling and dichotomous modeling under different scoring schemes and termination criteria. Results suggest that polytomous computerized adaptive testing (CAT) yields marginal gains over dichotomous CAT when termination criteria are more stringent. Discusses…

Compared holistic and analytic scoring methods to explore how the alternative scorings can make differences for performance assessment using the many-faceted Rasch model. Results based on social studies responses of 43 students show that scoring rubrics could be improved by investigating rating scale categories. Discusses implications of scoring…

Describes similarities and differences between additive conjoint measurement and the Rasch model, and formalizes some new nonparametric item response models that are, in a sense, probabilistic measurement theory models. Applies these new models to published and simulated data. (SLD)

Undertook two studies (n=113 and n=55) a year apart, to create an instrument that measures nutritional competence and self-efficacy among prospective physicians. Results using Rasch modeling demonstrate the reliability and validity of the scale for assessing mastery of applied nutrition among prospective physicians. (SLD)

Studied item exposure in a computerized adaptive test when the item selection algorithm presents examinees with questions they were asked in a previous test administration. Results with 178 repeat examinees on a medical technologists' test indicate that the combined use of an adaptive algorithm to select items and latent trait theory to estimate…

Offers a critical analysis of the residual fit statistics of the Rasch model, demonstrating that Rasch fit analysis is not as simple as it appears to be. Calls for the use of residual-free Rasch fit statistics that are based on the number of Guttman response errors or indices that are optimal statistically for detecting measurement disturbances.…

Validated data from a developmental mathematics assessment using classical and three-faceted Rasch measurement methods. Analysis of field test data for 289 elementary school students suggested that a unidimensional construct was being measured, as defined by Rasch criteria. Discusses limitations in confirming content-related validity of the…

Explores the nature of fit and provides a historical overview of fit indices. Focuses on a family of fit indices based on the Pearsonian chi-square approach to fit to show why it is necessary to use a family of standardized indices to understand the relationship between the data and the model. (Author/SLD)

Developed an instrument to measure invasive plant environmentalism (knowledge and attitudes concerning non-native plant invasions). Scaled responses of 237 plant nursery customers to a 17-item standardized interview using the partial credit model. Results indicate that the instrument measured the construct of invasive plant environmentalism…

Proposes a factorial procedure for investigating differential distractor functioning in multiple choice items that models each distractor with a distinct distractibility parameter. Results of a simulation study show that the parameters of the proposed modeling were recovered very well. Analysis of 10 4-choice items from a college entrance…

Studied the interactive effect of instructional strategies enhanced with text-plus-textual metaphors or text-plus-graphical metaphors and cognitive style on the acquisition of programming concepts using a measure of cognitive style and the QUEST Interactive Test Analysis System. Results for 203 undergraduates support the reliability of the…

Developed a computerized adaptive language proficiency test for a community college in Quebec, Canada and obtained item response theory calibrations on the items from 700 to 800 administrations. Describes projected efforts to detect instances in which "cheating low" (answering incorrectly deliberately) occurs. (SLD)