Research has postulated a link between teachers' beliefs and agentic decisions. This study sought to investigate 215 Iranian EFL preservice teachers' conceptions of assessment, assessment agency, and the interrelationship between these two constructs. Using structural equation modeling, the results revealed that collaboration and reflection…

This quasi-experimental study examines the impact of a diagnosis-based pedagogical intervention on the development of micro English as a foreign language (EFL) reading abilities over time. Specifically, 105 first-year graduate students in a Chinese university completed three diagnostic reading assessments at the beginning, middle, and end of a…

The Korean College Scholastic Ability Test (CSAT) aims to assess Korean high school students' scholastic ability required for college readiness. As a high-stakes test, the examination serves as a pivotal hurdle for university admission and exerts a strong washback effect on the educational system in Korea. The present study set out to investigate…

Because of the need to provide fine-grained longitudinal diagnostic feedback, longitudinal cognitive diagnosis is an emerging approach that integrates cross-sectional cognitive diagnosis models (CDM) with longitudinal data analysis techniques. By adopting the generalized longitudinal higher-order log-linear CDM, this study attempted to track the…

This study introduces the first Arabic Vocabulary Levels Test (Arabic-VLT), created for foreign learners of Arabic. We present compelling evidence to substantiate its validity and reliability. The Arabic-VLT was developed according to five levels, beginning with the most frequently used words (Level 1) to the least frequently used ones (Level 5),…

This article compares two methods for detecting local item dependence (LID): residual correlation examination and Rasch testlet modeling (RTM), in a commonly used 3:6 matching format and an extended matching test (EMT) format. The two formats are hypothesized to facilitate different levels of item dependency due to differences in the number of…

This study investigated potential item bias in a large-scale grade 3 reading achievement test, specifically against culturally diverse students with limited familiarity with mainstream Canadian culture. Students were classified based on their first language and length of residence in Canada, which was used as a proxy for cultural familiarity. A…

Despite the growing interest in AI for language assessment, there remains a significant research gap regarding its usefulness for assessing less proficient language skills, particularly those of learners of English as a second or foreign language (S/FL). AI models often prioritize proficient writing, neglecting the intricacies of learner language.…

There has been much debate in assessment research about the inclusion of Global English accents in high-stakes listening tests. This study explored test-takers' attitudes toward the inclusion of different English accents in the Duolingo English Test (DET) 2021 test version and their associations with listening test scores. One hundred sixty…

This paper explores what the measures of utterance fluency typically employed in Automatic Speech Evaluation (ASE), i.e. automated speaking assessments, tell us about oral proficiency. 60 Chinese learners of English completed the second part of the speaking section of IELTS and six tasks designed to measure the linguistic knowledge and processing…

There is a lack of tests available for assessing sign language proficiency among L2 learners. We have therefore developed a sign repetition test, SignRepL2, with a specific focus on the phonological features of signs. This paper describes the two phases of developing this test. In the first phase, content was developed in the form of 50 items with…

While several studies support the appropriateness of tasks delivered through Spoken Dialog Systems (SDSs) for L2 oral communication assessment, few studies have explored the construct of interactional competence (IC) as measured by such tasks. This study aims to address this gap in the literature by investigating the use of IC features by high-…

In sociolinguistic contexts where standardized languages coexist with regional dialects, the study of differential item functioning is a valuable tool for examining certain linguistic uses or varieties as threats to score validity. From an ecological perspective, this paper describes three stages in the study of differential item functioning…

Recent literature in the field of L2 vocabulary assessment has advocated for the development of written receptive vocabulary tests such as Vocabulary Levels Tests (VLTs) that use: (a) meaning-recall item formats, (b) a minimum of 40 item counts per 1,000-frequency band to improve level estimates, and (c) lemmas (not word-families) as the lexical…

Lexical diversity (LD) is an important indicator of second language lexical development. Much research has investigated LD indices, with a focus on learners of English. However, further research is needed in languages that are typologically distinct from English, such as Korean. In this study, we evaluated the reliability and validity of LD…