Outcomes assessments are gaining great attention in higher education because of increased demand for accountability. These assessments are widely used by U.S. higher education institutions to measure students' college-level knowledge and skills, including students who speak English as a second language (ESL). For the past decade, the increasing…

Estimation problems associated with the correlated-trait correlated-method (CTCM) parameterization of a multitrait-multimethod (MTMM) matrix are widely documented: the model often fails to converge; even when convergence is achieved, one or more of the parameter estimates are outside the admissible parameter space. In this study, the authors…

Questionnaire instruments are frequently administered in digital formats, largely web-based, without much systematic investigation of possible effects from these administration methods. Furthermore, little attention has been given to the contextual lack of control for extraneous factors that may influence user responses. In this study, 263…

The use of confidence intervals (CIs) as an addition or as an alternative to null hypothesis significance testing (NHST) has been promoted as a means to make researchers more aware of the uncertainty that is inherent in statistical inference. Little is known, however, about whether presenting results via CIs affects how readers judge the…

This study examined discrepant high school grade point average (HSGPA) and SAT performance as measured by the difference between a student's standardized SAT composite score and standardized HSGPA. The SAT-HSGPA discrepancy measure was used to examine whether certain students are more likely to exhibit discrepant performance and in what direction.…

This research provides a demonstration of the utility of mixture Rasch models. Specifically, a model capable of estimating a mixture partial credit model using joint maximum likelihood is presented. Like the partial credit model, the mixture partial credit model has the beneficial feature of being appropriate for analysis of assessment data…

The Hong Psychological Reactance Scale (HPRS) purports to measure reactance: a motivational state experienced when a behavioral freedom is threatened with elimination. To date, five studies have examined the psychometric properties of the HPRS, but reached different conclusions regarding its factor structure. The current study further investigated…

Typical validation studies on standard setting models, most notably the Angoff and modified Angoff models, have ignored construct development, a critical aspect associated with all conceptualizations of measurement processes. Stone compared the Angoff and objective standard setting (OSS) models and found that Angoff failed to define a legitimate…

In response to the low standards in short form development, Smith, McCarthy, and Anderson (2000) introduced a set of guidelines for the construction and evaluation of short forms of psychological tests. One of their recommendations requires researches to show that the variance overlap between the short form and its long form is adequate. This…

This article describes the development, validation, and measurement invariance of scores from a survey designed to measure preservice teachers' reported acceptance of technology. Drawing from conceptual models in the areas of information systems and technology acceptance, a five-factor Technology Acceptance Measure for Preservice Teachers (TAMPST)…

Hope is a motivational/cognitive attribute that is theoretically necessary to initiate and sustain action toward goal attainment. The Herth Hope Scale (HHS) not only appears to tap into some of the same Agency and Pathways content of the commonly used Adult Hope Scale developed by Snyder et al. but also contains some more spiritual and social…

The authors investigated the factor structure of the Schutte Self-Report Emotional Intelligence (SSREI) scale on international students. Via confirmatory factor analysis, the authors tested the fit of the models reported by Schutte et al. and five other studies to data from 640 international students in the United States. Results show that…

A major stumbling block for emotional intelligence (EI) research has been the lack of adequate evidence for discriminant validity. In a sample of 280 dyads, self- and peer-reports of EI and Big Five personality traits were used to confirm an a priori four-factor model for the Wong and Law Emotional Intelligence Scale (WLEIS) and a five-factor…

Three studies were conducted to develop and validate scores on a new measure appropriate for assessing adolescents' situational interest (SI) across various academic settings. In Study 1 (n = 858), a self-report questionnaire was administered to undergraduates in introductory psychology. Confirmatory factor analyses (CFA) supported a three-factor…

Random responding to psychological inventories is a long-standing concern among clinical practitioners and researchers interested in interpreting idiographic data, but it is typically viewed as having only a minor impact on the statistical inferences drawn from nomothetic data. This article explores the impact of random responding on the size and…