The redesigned "TOEIC Bridge"® tests are designed to measure the reading, listening, speaking, and writing proficiency of beginning to low-intermediate English learners in the context of everyday adult life. This report describes the comprehensive and multifaceted process used to enhance the meaningfulness of TOEIC Bridge test score…

Scholars have long explored the lack of diversity in gifted-and-talented education and specifically the role that gifted-and-talented test performance plays as a barrier to access. However, there is limited work, particularly quantitative work, examining the ways in which policies perpetuate racial/ethnic and socioeconomic inequalities within the…

Background: Stakeholders' interpretations of the findings of large-scale educational assessments can influence important decisions. In the context of educational assessment, standard-setting remains an especially critical element, because it is complex and largely unstandardized. Instruments established by means of standard-setting procedures such…

An Angoff standard setting study generally yields judgments on a number of items by a number of judges (who may or may not be nested in panels). Variability associated with judges (and possibly panels) contributes error to the resulting cut score. The variability associated with items plays a more complicated role. To the extent that the mean item…

The present longitudinal study examined the utility of the screening tool for autism in 2-year-olds (STAT) in detecting autism spectrum disorder (ASD) in toddlers who are less than 24 months of age. The study sample, which consisted of 119 toddlers with developmental problems, were assessed when they were between 16 and 24 months of age (Time 1)…

In this study, the efficiency of various random sampling methods to reduce the number of items rated by judges in an Angoff standard-setting study was examined and the methods were compared with each other. Firstly, the full-length test was formed by combining Placement Test 2012 and 2013 mathematics subsets. After then, simple random sampling…

This paper presents research and provides a method to ensure that parallel assessments, that are generated from a large test-item database, maintain equitable difficulty and content coverage each time the assessment is presented. To maintain fairness and validity it is important that all instances of an assessment, that is intended to test the…

Identification of cardiometabolic risk (CMR) in U.S. younger population by assessing muscular strength via handgrip (HG) dynamometry may aid in prevention efforts. Currently, no nationally representative HG cut-points are available for identifying increased CMR in U.S. adolescents or young adults. In this study, we propose normalized grip strength…

An important consideration in standard setting is recruiting a group of panelists with different experiences and backgrounds to serve on the standard-setting panel. This study uses data from 14 different Angoff standard settings from a variety of medical imaging credentialing programs to examine whether people with different professional roles and…

Purpose: This research aimed to identify reliable tasks discriminating French-speaking adolescents with developmental language disorder (DLD) from their peers with typical language (TL) and to assess which linguistic domains represent areas of particular weakness in DLD. Unlike English, morphosyntax has not been identified as a special area of…

Research on the use of standardized test scores in higher education reveals significant variations in attitudes and perceptions of language proficiency tests among test score users. Most test score users have limited knowledge about test score interpretations in terms of what English as additional language (EAL) students typically know and can do…

The aim of this study was to compare, by simulation, the accuracy of mapping a cut-score from one test to another by expert judgement (using the Angoff method) versus the accuracy with a small-sample equating method (chained linear equating). As expected, the standard-setting method resulted in more accurate equating when we assumed a higher level…

Setting performance standards is a judgmental process involving human opinions and values as well as technical and empirical considerations. Although all cut score decisions are by nature somewhat arbitrary, they should not be capricious. Judges selected for standard-setting panels should have the proper qualifications to make the judgments asked…

Despite concerns about their validity, self-report surveys remain the primary data collection method in the research of self-regulated learning (SRL). To address some of these concerns, we took a data set comprised of college students' self-reported beliefs and behaviours related to SRL, assessed across three surveys, and examined it for instances…

This study examined the performance of the First Year Inventory (FYI; version 2.0), a community-normed parent-reported screening instrument, in a high-risk (HR) sample of 12-month-olds with older siblings diagnosed with autism spectrum disorder (ASD). The FYI 2.0 was completed by parents of 86 HR infants and 35 low-risk control infants at age…