Purpose: This paper explores the school leadership career outcomes, timing and educator evaluation of those who complete the Massachusetts Performance Assessment for Leaders (PAL) in comparison with others who did not. It also compares outcomes for those with different PAL score completion requirements. Design/methodology/approach: Using PAL…

Males are more likely to be diagnosed with autism than females, and at earlier ages, yet few studies examine sex differences in screening. This study explored sex differences in psychometric properties, recommended cutoff scores, and overall scores of the Modified Checklist for Autism in Toddlers, Revised, with Follow-Up. Participants were 28,088…

The Autism Mental Status exam (AMSE) has demonstrated excellent sensitivity and specificity in Western high-risk population with suspected autism spectrum disorder (ASD). This study aimed to evaluate the psychometric properties of the AMSE in a sample of high-risk Chinese children, and to determine the optimal cutoff score of the Chinese version…

Evidence of the internal consistency of standard-setting judgments is a critical part of the validity argument for tests used to make classification decisions. The bookmark standard-setting procedure is a popular approach to establishing performance standards, but there is relatively little research that reflects on the internal consistency of the…

One commonly used compromise standard-setting method is the Beuk (1984) method. A key assumption of the Beuk method is that the emphasis given to the pass rate and the percent correct ratings should be proportional to the extent that the panelists agree on their ratings. However, whether the slope of Beuk line reflects the emphasis that panelists…

This article compares cut scores from two variations of the Hofstee and Beuk methods, which determine cut scores by resolving inconsistencies in panelists' judgments about cut scores and pass rates, with the Angoff method. The first variation uses responses to the Hofstee and Beuk percentage correct and pass rate questions to calculate cut scores.…

This study used the standard setting to establish cutscores for the fidelity of implementation of an evidence-based intervention, the Self-Determined Learning Model of Instruction (SDLMI) designed to enhance goal-directed actions in secondary students with and without disabilities. Cutscores were then applied to fidelity data from a large,…

We investigated the validity and screening effectiveness of the PHQ-2 and PHQ-9 scores in 229 college students in a cross-sectional design. PHQ associations with Minnesota Multiphasic Personality Inventory-3 internalizing scales suggest PHQ scores are effective screening tools for college students and may aid in effective triage and service needs.

A questionnaire was recently developed for the use with the Spanish-speaking, and evidence have been provided about the construct internal validity by means of structural equation modelling. In this paper, two research questions were considered: (i) What new evidence does application of the Rasch model provide regarding the validity of this…

Classification measures and entropy variants can be used as indicators of model fit for logistic regression. These measures rely on a cut-point, "c," to determine predicted group membership. While recommendations exist for determining the location of the cut-point, these methods are primarily anecdotal. The current study used Monte Carlo…

Autism spectrum disorder (ASD) and ASD symptoms are overrepresented among gender-diverse youth across studies. Gender-diverse and ASD youth are at risk for anxiety, but anxiety is unclear among gender-diverse youth with ASD. The Social Communication Questionnaire (SCQ) is a commonly used ASD screener, including in multidisciplinary…

This study provides a preliminary validation of a Greek Sentence Repetition Task (SRT) with a sample of 110 monolingual and bilingual typically developing (TLD) children and examines the test's ability to distinguish between Greek monolingual children and age-matched Albanian-Greek bilinguals using a Receiver Operating Characteristics (ROC)…

To evaluate the fit of a confirmatory factor analysis model, researchers often rely on fit indices such as SRMR, RMSEA, and CFI. These indices are frequently compared to benchmark values of 0.08, 0.06, and 0.96, respectively, established by Hu and Bentler (1999). However, these indices are affected by model characteristics and their sensitivity to…

Originality is scored based on standard zero-originality lists (ZOLs) in the Torrance Tests of Creative Thinking (TTCT). The applicability of those ZOLs to diverse groups has not been examined. We examined the consistency of TTCT-Figural's sample-based (SB) ZOLs and the published ZOLs based on a sample of predominantly African American college…

In test-centered standard-setting methods, borderline performance can be represented by many different profiles of strengths and weaknesses. As a result, asking panelists to estimate item or test performance for a hypothetical group study of borderline examinees, or a typical borderline examinee, may be an extremely difficult task and one that can…