IXL is an end-to-end teaching and learning solution that engages learners in grades Pre-K through 12 with a comprehensive curriculum and a first-of-its-kind assessment suite. A core component of IXL's assessment suite is the IXL Diagnostic, an interim assessment designed by a team of educators and mathematicians that uses Item Response Theory…

Assessment for learning emphasizes the importance of feedback to promote learning. To explore whether cognitive diagnostic feedback (CDF) promotes learning and whether it is more effective than traditional feedback in promoting learning, this study conducted a quasi-experiment by utilizing a longitudinal cognitive diagnostic assessment to compare…

The present study compared the diagnostic accuracy of a single computer adaptive test (CAT), Star Reading or Star Math, and a combination of the two in a gated screening framework to predict end-of-year proficiency in reading and math. Participants included 13,009 students in Grades 3-8 who had at least one fall screening score and end-of-year…

This article provides a process to carefully evaluate the suitability of a content domain for which diagnostic classification models (DCMs) could be applicable and then optimized steps for constructing a test blueprint for applying DCMs and a real-life example illustrating this process. The content domains were carefully evaluated using a set of…

This study was conducted at a college in Ontario with a sample of students from the Game Development program for 5 intake years: 2014-2018, with the purpose of determining the validity of the Mathematics Diagnostic Test used to place 1st semester college students directly into an advanced math course (Math 10), or to leave them in the introductory…

In this study, we developed machine learning algorithms to automatically score students' written arguments and then applied the cognitive diagnostic modeling (CDM) approach to examine students' cognitive patterns of scientific argumentation. We abstracted three types of skills (i.e., attributes) critical for successful argumentation practice:…

This dissertation provides a start-to-finish description of development, administration, and validation for an online middle-school physics test using a DCM framework with response-time. The first paper illustrated the process of implementing DCM with a careful selection of the content domain and a simulation approach for a Q-matrix construction.…

Purpose: The current study aimed to understand the clinical decision-making skills of school-based speech-language pathologists (SLPs) using narrative and expository discourse information from three sources: perception of language through listening to language alone, standardized criterion-referenced narrative assessment data, and word- and…

Computational thinking (CT) is a set of cognitive skills that every child should acquire. K-12 classrooms are expected to provide students opportunities (tasks) to think computationally. We introduce a CT competency assessment for middle school students. The assessment design process started by establishing a cognitive model of CT domain mastery,…

Diagnostic assessments are intended to support teachers' instructional decision making by providing instructionally relevant information. In this article, we propose that using cognitive theories of learning to design diagnostic assessments can provide teachers with two diagnostic outcomes: (a) the location of a student's thinking within the…

Providing diagnostic feedback about growth is crucial to formative decisions such as targeted remedial instructions or interventions. This article proposed a longitudinal higher-order diagnostic classification modeling approach for measuring growth. The new modeling approach is able to provide quantitative values of overall and individual growth…

The study was designed as a linked two-phase investigation, aiming to psychometrically develop and validate a Chinese version of the "Organizational Climate Diagnostic Instrument for Junior High Schools" (OCDI-JH) for use in Taiwan. Through extensive literature reviews, the complex phenomena of school climate were decomposed into a…

The relation between academic achievement and various measurements of cognitive abilities, problem-solving skills and self-managed learning has been established in the research before the COVID-19 pandemic and distance learning. The aim of the current research was to analyze the extent to which these aspects predicted the educational achievement…

The present study performed a systematic comparison of DSM-5 and ICD-11 diagnostic criteria for reading disability. We quantitatively investigated the consequences of using DSM-5 or ICD-11, and of the different ways of implementing each diagnostic criterion on the prevalence of reading disability. We did so in a representative sample of the…

In cognitive diagnosis assessment (CDA), the impact of misspecified item-attribute relations (or "Q-matrix") designed by subject-matter experts has been a great challenge to real-world applications. This study examined parameter estimation of the CDA with the expert-designed Q-matrix and two refined Q-matrices for international…