The San Francisco Unified School District (SFUSD) uses the Language and Literacy Assessment Rubric (LALAR) as the secondary measurement required by the No Child Left Behind (NCLB) Act to measure English proficiency of English language learners (ELLs). In this analysis, the Rasch model is used to identify whether the LALAR is a valid measurement…

Students' evaluations of teaching staff can be considered high-stakes, as they are often used to determine promotion, reappointment, and merit pay to academics. Using Facets, the reliability and validity of one student rating questionnaire is analysed. A total of 13,940 respondents of the Human Science Division of International Islamic University…

Traditionally, women and minorities have not been fully represented in science and engineering. Numerous studies have attributed these differences to gaps in science achievement as measured by various standardized tests. Rather than describe mean group differences in science achievement across multiple cultures, this study focused on an in-depth…

This study presents a systematic investigation concerning the performance of different rating scales used in the English section of a university entrance examination to assess 1,287 Japanese test takers' ability to write a third-person introduction speech. Although the rating scales did not conform to all of the expectations of the Rasch model,…

In this study, the Rasch rating scale model (Andrich, 1978) was applied to college grades of four freshman cohorts from a large public university. After editing, the data represented approximately 34,000 students, 1,700 courses and 119 departments. The rating scale model analysis yielded measures of student achievement and course difficulty.…

The desirability of test equating to maintain the same criterion standard from test administration to test administration has long been accepted for multiple choice tests. The same consistency of expectations is desirable for performance tests, especially if they are part of a licensure or certification process or used for other high stakes…

Examined the Type I error rate and the power of the Stout T procedure (DIMTEST) (W. Stout, 19987, 1990) and the Holland-Rosenbaum procedure (P. Holland and P. Rosenbaum, 1986) for normal and nonnormal data sets through a Monte Carlo study. Both procedures performed adequately under some conditions, but the Stout T procedure showed adequate power…

Tested the metric properties of a Spanish version of the Assessment of Growth Hormone Deficiency in Adults (AGHDA) questionnaire through Rasch analysis with a sample of 356 adult patients in Spain. Results suggest that the Spanish AGHDA could be a useful complement of the clinical evaluation of growth hormone deficiency patients at group and…

Used Monte Carlo simulation to compare the relative measurement efficiency of polytomous modeling and dichotomous modeling under different scoring schemes and termination criteria. Results suggest that polytomous computerized adaptive testing (CAT) yields marginal gains over dichotomous CAT when termination criteria are more stringent. Discusses…

Offers a critical analysis of the residual fit statistics of the Rasch model, demonstrating that Rasch fit analysis is not as simple as it appears to be. Calls for the use of residual-free Rasch fit statistics that are based on the number of Guttman response errors or indices that are optimal statistically for detecting measurement disturbances.…

Proposes a factorial procedure for investigating differential distractor functioning in multiple choice items that models each distractor with a distinct distractibility parameter. Results of a simulation study show that the parameters of the proposed modeling were recovered very well. Analysis of 10 4-choice items from a college entrance…

Describes problems in score reporting with the True Score model, defines the Rasch measurement unit (the logit), reviews transformations of the logit metric, and provides examples of score reporting procedures. Uses dichotomous data from an examination taken by 126 Ph.D. students and polychotomous data from a self-efficacy assessment completed by…

Re-examined the 13-year lifespan study of moral and evaluative reasoning conducted by C. Armon, who interviewed 23 females and 19 males ranging in age from 5 at first test time (1977) to 86 at the fourth interview (1989). Rasch analysis of Armon's data show that the measures used tap a single underlying dimension of reasoning. Discusses results…