The multiple-choice (MC) item format has been widely used in educational assessments across diverse content domains. MC items purportedly allow for collecting richer diagnostic information. The effectiveness and economy of administering MC items may have further contributed to their popularity not just in educational assessment. The MC item format…

The certainty of response index (CRI) measures respondents' confidence level when answering an item. In conjunction with the answers to the items, previous studies have used descriptive statistics and arbitrary thresholds to identify student knowledge profiles with the CRIs. Whereas this approach overlooked the measurement error of the observed…

The biology education literature includes compelling assertions that unfamiliar problems are especially useful for revealing students' true understanding of biology. However, there is only limited evidence that such novel problems have different cognitive requirements than more familiar problems. Here, we sought additional evidence by using…

Teacher certification exams are supposed to assess if a student is likely to succeed in teaching. What if an exam seems to be inappropriate? This article is an inquiry of the New York State Content Specialty Test for Early Childhood Candidates, particularly the math section. It raises the issue of whether we are asking the right questions and…

There has been increasing interest in applying integrative data analysis (IDA) to analyze data across multiple studies to increase sample size and statistical power. Measures of a construct are frequently not consistent across studies. This article provides a tutorial on the complex decisions that occur when conducting harmonization of measures…

Tests are designed as an integral part of the teaching process, necessarily including stakeholders from the onset of preparations to grade allocation, the administration of the test, and the interpretation of the results. The process commences with selecting content to evaluate, deciding upon the skills to be tested, and to meet course objectives…

Organic chemistry is a class well known to be difficult and necessary for many careers in the sciences, and as a result, has garnered interest in researching ways to improve student learning and comprehension. One potential way involves using eye tracking techniques to understand how students visually examine questions. Organic chemistry involves…

Purpose: Relying on a design science paradigm, the purpose of this paper is to describe the development and evaluation of items for an ICT artefact that supports the assessment of transversal professional competences within the validation of prior learning (VPL). To do so, the authors build a conceptual bridge between the Occupational Information…

Using classical test theory and item response theory, this study applied sequential procedures to a real operational item pool in a variable-length computerized adaptive testing (CAT) to detect items whose security may be compromised. Moreover, this study proposed a hybrid threshold approach to improve the detection power of the sequential…

This study examines the psychometric properties of the Autism Diagnostic Interview-Revised (ADI-R) in the context of DSM-5 in a sample of Chinese children. Using re-mapped ADI-R items and algorithms matched to DSM-5 criteria, and administering to children with autism spectrum disorder (ASD) with and without intellectual disability,…

Some previous studies have shown that increased stress hormone levels have beneficial effects on memory encoding; however, there is no clear consensus on which encoding-related processes are affected by stress hormones. In the present study, we investigated the relationship between interindividual differences in neuroendocrine response to acute…

Test fairness is critical to the validity of group comparisons involving gender, ethnicities, culture, or treatment conditions. Detection of differential item functioning (DIF) is one component of efforts to ensure test fairness. The current study compared four treatments for items that have been identified as showing DIF: deleting, ignoring,…

Objectives: The aim of this study was to develop a scale measuring inclusive school quality from parents' perceptions (Parents' perceptions of Inclusive School Quality, PISQ) and investigate the perceptions of Chinese parents of children with disabilities of inclusive school quality using the PISQ scale. Method: The data for 78 parents of children…

Computational thinking is recognized as a vital skill related to problem-solving in technological and non-technological fields. The existence of different sub-domains related to this skill has been pointed out. Therefore, there is a need for tools that measure these different sub-domains. Because of its structure that includes different skills,…

Despite consistent calls for authentic stimuli in listening tests for better construct representation, unscripted texts have been rarely adopted in high-stakes listening tests due to perceived inefficiency. This study details how a local academic listening test was developed using authentic unscripted audio-visual texts from the local target…