Recent developments have enabled the modeling of longitudinal assessment data in a diagnostic classification model (DCM) framework. These longitudinal DCMs were developed to provide measures of student growth on a discrete scale in the form of attribute mastery transitions, thereby supporting categorical and criterion-referenced interpretations of…

Frontiers pioneered an alternative model of publishing: Rather than libraries paying subscription fees to publishers to give library communities access to journals full of articles written, reviewed and edited (at no or modest cost to the publishers) by their own faculty, they instead charge the authors to publish articles that are then made…

This paper presents a tool for creating student models in logistic regression. Creating student models has typically been done by expert selection of the appropriate terms, beginning with models as simple as IRT or AFM but more recently with highly complex models like BestLR. While alternative methods exist to select the appropriate predictors for…

Multiple choice questions are traditionally expensive to produce. Recent advances in large language models (LLMs) have led to fine-tuned LLMs that generate questions competitive with human-authored questions. However, the relative capabilities of ChatGPT-family models have not yet been established for this task. We present a carefully-controlled…

This study used standards setting to establish cutscores for the fidelity of implementation of an evidence-based intervention, the Self-Determined Learning Model of Instruction, designed to enhance goal-directed actions in secondary students with and without disabilities. Cutscores were then applied to a fidelity data from a large, randomized…

Schools are increasingly turning towards restorative practices as a pathway to building schools with stronger relationships, justice, and equity. While effectiveness studies are increasing, too little attention is focused on evaluating implementation. This resources is for audiences who evaluate implementation of whole school restorative practices…

Age of Acquisition (AoA) scores approximate the age at which a language speaker fully understands a word's semantic meaning and represent a quantitative measure of the relative difficulty of words in a language. AoA word lists exist across various languages, with English having the most complete lists that capture the largest percentage of the…

Coaching is an essential component of supporting teachers to implement evidence-based practices (EBPs) in classrooms. The Self-Determined Learning Model of Instruction (SDLMI), an EBP designed to promote student self-determination, uses a research-based coaching model with six guiding principles. This qualitative study analyzed the content of…

Missing data are exceedingly common across a variety of disciplines, such as educational, social, and behavioral science areas. Missing not at random (MNAR) mechanism where missingness is related to unobserved data is widespread in real data and has detrimental consequence. However, the existing MNAR-based methods have potential problems such as…

The purpose of this paper is to demonstrate and evaluate the use of "Bayesian dynamic borrowing"(Viele et al, in Pharm Stat 13:41-54, 2014) as a means of systematically utilizing historical information with specific applications to large-scale educational assessments. Dynamic borrowing via Bayesian hierarchical models is a special case…

An important component of many Adaptive Instructional Systems (AIS) is a 'Learner Model' intended to track student learning and predict future performance. Predictions from learner models are frequently used in combination with mastery criterion decision rules to make pedagogical decisions. Important aspects of learner models, such as learning…

Automated scoring of student language is a complex task that requires systems to emulate complex and multi-faceted human evaluation criteria. Summary scoring brings an additional layer of complexity to automated scoring because it involves two texts of differing lengths that must be compared. In this study, we present our approach to automate…

A longstanding goal of learner modeling and educational data mining is to improve the domain model of knowledge that is used to make inferences about learning and performance. In this report we present a tool for finding domain models that is built into an existing modeling framework, logistic knowledge tracing (LKT). LKT allows the flexible…

Cloze items are a foundational approach to assessing readability. However, they require human data collection, thus making them impractical in automated metrics. The present study revisits the idea of assessing readability with cloze items and compares human cloze scores and readability judgments with predictions made by T5, a popular deep…

Multi-angle question answering models have recently been proposed that promise to perform related tasks like question generation. However, performance on related tasks has not been thoroughly studied. We investigate a leading model called Macaw on the task of multiple choice question generation and evaluate its performance on three angles that…