This study investigates how sensitively the current grit measure (Grit-S) is able to reflect the differences between individuals (i.e. item discrimination) and change within individuals (i.e. sensitivity to change of items) using longitudinal data. Data from the Korean Children and Youth Panel Study 2018 of elementary (fourth grade) and middle…

A better understanding of how distractor features influence the plausibility of distractors is essential for an efficient multiple-choice (MC) item construction in educational assessment. The plausibility of distractors has a major influence on the psychometric characteristics of MC items. Our analysis utilizes the nominal categories model to…

Using expert reviews and item response theory (IRT), this study evaluated the language- and culture-related construct-irrelevant variance and reliability of the 2019 TIMSS sense of school belonging scale (SSBS) for grades 4 and 8. The five items of the SSBS, which were identical for both grades, were reviewed for the language- and culture-related…

School connectedness plays a critical role in multiple aspects of child development. The purpose of this study was to operationalize school connectedness as a multidimensional construct and further assess whether this construct was measured similarly across gender and grade level among a sample of upper elementary school children (age M = 9.57; N…

The factor structure of the measure of school engagement 'Engagement Versus Disaffection with Learning: Teacher Report' was investigated in the sample of 360 Swedish 6th graders. Confirmatory factor analyses showed no support for the suggested four-factor structure including behavioural engagement, emotional engagement, behavioural disaffection…

Today, emoji have become a popular option for anchoring the categories of Likert-type scales applied to not only adults but also children. The aim of this study was to investigate the effects of category labeling with emoji by comparing the psychometric properties of the emoji- and verbal-anchored versions of the mathematics motivation scale…

Star Math (SM) is a popular computer adaptive test (CAT) schools use to screen students for academic risk. Despite its popularity, few independent investigations of its diagnostic accuracy have been conducted. We evaluated the diagnostic accuracy of SM based upon vendor provided cut-scores (25th and 40th percentiles nationally) in predicting…

The relationship between latent trait and test-taking speed is an important area of study in assessment research. In addition to contributions of such studies to psychometrics, the factors that affect both ability and speed have implications for test development and have policy consequences especially if the tests are high stakes. This study…

This study analyzed the relationship between benchmark scores from the newly published Dynamic Indicators of Basic Early Literacy Skills Math (i.e., Acadience™) math probes and student performance on math and reading sections of a state-mandated high-stakes test. Participants were 420 students enrolled in third, fourth, and fifth grades in a rural…

Measurement limitations have hindered research on learned helplessness (LH) and mastery orientation (MO) in the classroom. We reduced the 24-item Student Behavior Checklist to a 6-item scale and tested the abbreviated measure for evidence of reliability and validity in a sample of 5th and 6th graders (N = 299). We then replicated findings in an…

This study explored the underlying latent structure of items on the Mindset Assessment Profile (MAP) tool, explored whether subgroups of students exist based on the latent structure of MAP items, and tested whether subgroups were differentiated on standardized measures of reading comprehension, vocabulary, and word reading. Participants included…

School-based universal screening for behavioral/emotional risk is a necessary first step in the identification of students who might need services within a behavioral response to intervention model. When choosing among the available screening measures, psychometric information such as reliability and validity of the scores is critical to inform…

We provide evidence of validity for a newly developed diagnostic competence model of operation sense, by both (a) describing the theoretically substantiated development of the competence model in close association with its use within a large-scale formative assessment and (b) providing empirical evidence for the theoretically described cognitive…

Universal screening for behavioral and emotional risk is an important part of implementing multi-tiered behavioral supports in schools. The current study adds to our understanding of universal screening by examining teacher and student reports of behavioral and emotional risk. Participants included 73 fourth-grade students and 4 teachers in an…

We used multilevel factor analyses to investigate the structure of the Teacher as Social Context Questionnaire (TASCQ)-short form--a prominent measure of teacher practices that promote student motivation to learn. Based on Self-Determination Theory (SDT), the TASCQ contains three scales: Autonomy Support, Structure, and Involvement. Few studies…