One of the most important, and neglected, aspects of the school assessment process is the feedback phase. The purpose of this exploratory study was to examine the extent to which feedback is being conducted, training in feedback, and the types of feedback practices used in school settings. One hundred thirty-two school assessment professionals…

Validity is a fundamental consideration of test development and test evaluation. The purpose of this study is to define and reify three key aspects of validity and validation, namely test-score interpretation, test-score use, and the claims supporting interpretation and use. This study employed a Delphi methodology to explore how experts in…

Primary school teachers in England are responsible for the statutory assessment of writing, using a set of criteria. The aim of this research was to analyse the responses of teachers to the criteria "at the expected" standard. An elicitation exercise with 10 primary school teachers was conducted, where teachers talked through their…

The most common effect size when using a multiple-group confirmatory factor analysis approach to measurement invariance is [delta]CFI and [delta]TLI with a cutoff value of 0.01. However, this recommended cutoff value may not be ubiquitously appropriate and may be of limited application for some tests (e.g., measures using dichotomous items or…

In automated essay scoring (AES), essays are automatically graded without human raters. Many AES models based on various manually designed features or various architectures of deep neural networks (DNNs) have been proposed over the past few decades. Each AES model has unique advantages and characteristics. Therefore, rather than using a single-AES…

Traditionally, most autism assessment instruments are based on medical models and designed to identify social communication deficits and behavioral abnormality in an individual. However, as more autistic narratives reveal the insider views of autists, some scholars and autistic activists support the neurodiversity model and assert the acceptance…

Understanding the response process used by test takers when responding to multiple-choice questions (MCQs) is particularly important in evaluating the validity of score interpretations. Previous authors have recommended eye-tracking technology as a useful approach for collecting data on the processes test taker's use to respond to test questions.…

Subscore added value analyses assume invariance across test taking populations; however, this assumption may be untenable in practice as differential subdomain relationships may be present among subgroups. The purpose of this simulation study was to understand the conditions associated with subscore added value noninvariance when manipulating: (1)…

Purpose: Dyslexia, a neurobiological phonological processing deficit, can be identified early; however, there is a substantial variation between and within states regarding who makes this diagnosis and when. Dyslexia evaluations are often challenging to obtain and very expensive for families who need to seek them outside of the school setting. The…

Validity in psychometrics refers to the degree to which evidence and theory supports the interpretations drawn from a test, and Messick's Contemporary Validity Theory (1994) includes several facets with well-established evidence collection methods. However, there is a lack of consensus on appropriate methods of evaluating the facet of…

An area of particular importance when examining index scores on the Wechsler Intelligence Scale for Children--Fifth Edition (WISC-V) is the utilization and interpretation of critical values and base rates associated with differences between an individual's subtest scaled score and the individual's mean scaled score for an index. For the WISC-V,…

Many prominent intelligence tests (e.g., Wechsler Intelligence Scale for Children, Fifth Edition [WISC-V] and Reynolds Intellectual Abilities Scale, Second Edition [RIAS-2]) offer methods for computing subtest- and composite-level difference scores. This study uses data provided in the technical manual of the WISC-V and RIAS-2 to calculate…

Equating methods are designed to adjust between alternate versions of assessments targeting the same content at the same level, with the aim that scores from the different versions can be used interchangeably. The statistical processes used in equating have, however, been extended to statistically "link" assessments that differ, such as…

Human raters' assessment of interpreting is a complex process. Previous researchers have mainly relied on verbal reports to examine this process. To advance our understanding, we conducted an empirical study, collecting raters' eye-movement and retrospection data in a computerised interpreting assessment in which three groups of raters (n = 35)…

This article explores the ethical use of assessments in leadership training, education, and development. From the importance of having well-trained facilitators to the consideration of power and social identity in the interpretation of individual results, this article advocates for approaching the use of leadership assessments and inventories with…