Students' evaluations of teaching staff can be considered high-stakes, as they are often used to determine promotion, reappointment, and merit pay to academics. Using Facets, the reliability and validity of one student rating questionnaire is analysed. A total of 13,940 respondents of the Human Science Division of International Islamic University…

This article describes the development of a ten-item scale to assess biology majors' self-efficacy towards the critical thinking and data analysis skills taught in an upper-division cell biology course. The original seven-item scale was expanded to include three additional items based on the results of item analysis. Evidence of reliability and…

Proposes formulas for expected true-score measures and reliability of binary items as a function of their Rasch difficulty when the trait (ability) distribution is normal or logistic. Provides an illustrative example for using the proposed formulas. (SLD)

Developed and validated an instrument designed to measure the perceived measurability and importance of the National Athletic Trainers' Association Athletic Training Educational Competencies. Data from 931 athletic trainers and sport medicine physicians support 6 constructs, each of which demonstrates high reliability. (SLD)

Evaluated the alternate forms reliability of new versus old tasks of the Assessment of Motor and Process Skills (AMPS) (A. Fisher, 1993). Participants were 44 persons from the AMPS database. Results support good alternate forms reliability of the motor and process ability measures and suggest that the newly calibrated tasks can be used reliably in…

Explored the measurement issues in a two-stage evaluation for an outstanding faculty award. Thirty college teachers were rated by 293 students using a newly developed inventory. Items fit a Rasch model fairly well, and the separation reliability for the teachers was high. A cut score was established, and a short version was developed. (SLD)

Applied a procedure to assess measurement invariance across cultures developed by J. Steenkamp and H. Baumgartner (1998) to a scale to measure cognitive age using data collected in India (n=195), China (n=250), and Korea (n=251). Results from confirmatory factor analyses indicate that the technique provides a valuable tool to assess measurement…

Outlines methods in Rasch measurement that are used to gather evidence for reliability and validity and attempts to articulate how these methods may be linked with current views of reliability and validity. (SLD)

Undertook two studies (n=113 and n=55) a year apart, to create an instrument that measures nutritional competence and self-efficacy among prospective physicians. Results using Rasch modeling demonstrate the reliability and validity of the scale for assessing mastery of applied nutrition among prospective physicians. (SLD)

Studied the interactive effect of instructional strategies enhanced with text-plus-textual metaphors or text-plus-graphical metaphors and cognitive style on the acquisition of programming concepts using a measure of cognitive style and the QUEST Interactive Test Analysis System. Results for 203 undergraduates support the reliability of the…