The interaction between language proficiency and discipline-related background knowledge is an important feature of LSAP (Languages for Specific Academic Purposes) tests and is viewed as a necessity in these tests unlike general purpose language tests which try to diminish the potential effect of discipline-related knowledge. Therefore, variables…

This study examines the relationships among various major factors that may affect the difficulty level of language tests in an attempt to enhance the robustness of item difficulty estimation, which constitutes a crucial factor ensuring the equivalency of high-stakes tests. The observed difficulties of the reading and listening sections of two EFL…

Many second language (L2) learners utilize writing resources (e.g., linguistic tools that help check their language, search engines, and websites) when writing in their L2. Nevertheless, these tools and resources are prohibited in most writing assessments based on the assumption that using them provides an inaccurate or unfair measure of…

Previous studies examined the association between motivational characteristics and language learning achievement, but considerably less is known about young language learners' task-specific motivation in assessment contexts. Our study investigated the task motivation of young learners of English when completing computer-administered integrated…

While scholars have proposed different models of language assessment literacy (LAL), these models have mostly comprised prescribed sets of components based on principles of good practice. As such, these models remain theoretical in nature, and represent the perspectives of language assessment researchers rather than stakeholders themselves. The…

The Common European Framework of Reference (CEFR), with its illustrative scales and salient features of spoken language at the reference levels, is widely used as the base for rating scales for performance testing. If practitioners want to measure and report even small gains in proficiency, they need to adapt the descriptors to their local context…

The conceptualization of language assessment literacy (LAL) is currently a subject of debate in the language testing community, especially with regard to the role language components play in this construct. This is part of a broader discussion of generic and discipline-specific assessment literacy. Previous research on language teachers' LAL aimed…

Recently, many universities in Vietnam have adopted the TOEIC (Test of English for International Communication) Listening and Reading test as a language exit test for non-English major students. This study aimed at examining the perceived impact of the TOEIC Listening and Reading test on English teaching and the mechanism by which this test impact…

This article reports on a study that was carried out to explore the factors that contribute to a negative washback effect on English language teaching (ELT) in secondary schools in Bangladesh. Twelve secondary school teachers were interviewed to understand their perspectives on which factors influenced their pedagogical choices. The interview data…

This article describes the steps we went through in designing and validating an item bank to diagnose linguistic problems in the English academic writing of university students in Hong Kong. Test items adopt traditional item formats (e.g., MCQ, grammatical judgment tasks, and error correction) but are based on authentic language materials…

This article presents a critical review of the Texas English Language Proficiency Assessment System (TELPAS), a large scale standardized English language proficiency (ELP) assessment developed by the Texas Education Agency (TEA) and administered since 2004. TELPAS is used as an annual summative assessment for all English Learners (ELs) in grades…

With the advancement of Cognitive Diagnostic Assessment (CDA) and the pertinent statistical models, different domains of large-scale testing and assessment have been examined for the sake of reporting more diagnostic information. Applying the generalized deterministic input, noisy, "and" gate (G-DINA) model, the current study analyzed a…

This article describes the development and validation of the new CATSS (Computer Adaptive Test of Size and Strength), which measures vocabulary knowledge in four modalities -- productive recall, receptive recall, productive recognition, and receptive recognition. In the first part of the paper we present the assumptions that underlie the test --…

The Ministry of Education in Taiwan encourages universities to adopt English ability as an exit requirement for graduates. Nearly 65% of universities use the General English Proficiency Test (GEPT) or other compatible standardized tests as an exit test for university graduates. However, it remains unclear what level of vocabulary knowledge a…

Adopting Linacre's guidelines for evaluating rating scale effectiveness, we examined whether and how a six-point rating scale functioned differently across raters, speech acts, and second language (L2) proficiency levels. We developed a 12-item Computerized Oral Discourse Completion Task (CODCT) for assessing the production of requests, refusals,…