Differential item functioning (DIF) analysis is a way of determining whether test items function differently across subgroups of test takers after controlling for ability level. DIF results are used to evaluate tests' validity arguments. This study uses Rasch measurement to examine the Michigan English Language Assessment Battery listening test…

The International Civil Aviation Association has developed a set of Language Proficiency Requirements (LPRs) and a Language Proficiency Rating Scale, which seeks to define proficiency in the language needed for aviation purposes at six different levels. Pilots, air traffic controllers and aeronautical station operators are required to achieve at…

This article reports on a study conducted with 42 participants from a Chilean university, which aimed to determine the effect of mode of response on test performance and test-taker perception of test features by comparing a semidirect online version and a direct face-to-face version of a speaking test. Candidate performances on both test versions…

Opinions differ on the importance of the native speaker's concept for language teaching and testing. This Commentary maintains that it is important and seeks to explain why. Three types of grammar are distinguished, the individual's, the community's and the human faculty of language. For first language teaching and testing it is the community's…

This study examined the role of domain-general and domain-specific linguistic knowledge in the assessment of academic English language proficiency using a latent variable modeling approach. The goal of the study was to examine if modeling of domain-specific variance results in improved model fit and well-defined latent factors. Analyses were…

Lyle F. Bachman is Professor, Department of Applied Linguistics, University of California, Los Angeles. He is a past president of the American Association for Applied Linguistics and of the International Language Testing Association. He has published numerous articles and books in the areas of language testing, program evaluation, and second…

This article addresses the question of what language proficiency (LP) is, both theoretically and empirically. It does so by making a distinction, on one hand, between "basic" and "higher language cognition" and, on the other hand, between "core" and "peripheral components" of LP. The article furthermore critically examines the notion of "level" in…

Despite the recent increase of structural equation modeling (SEM) in language testing and learning research and Kunnan's (1998) call for the proper use of SEM to produce useful findings, there seem to be no reviews about how SEM is applied in these areas or about the extent to which the current application accords with appropriate practices. To…

A revised schoolwide curriculum for New Zealand was implemented in 2010. This new curriculum has placed a new and strong emphasis on foreign language (L2) learning and has precipitated a reevaluation of high-stakes assessment practices to ensure that senior school assessments will be aligned to new curriculum requirements. The reevaluation has led…

This article investigates assessor decision making when using and applying a marking guide for a note-taking task in a specific purpose English language listening test. In contexts where note-taking items are used, a marking guide is intended to stipulate what kind of response should be accepted as evidence of the ability under test. However,…

This commentary reviews recent literature on a number of problematic issues arising from the use of English proficiency tests by registration bodies as the sole assessment of the professional communication skills of overseas qualified health professionals from non-English-speaking backgrounds. It discusses differences between the assessment…

Paired speaking tests are now commonly used in both high-stakes testing and classroom assessment contexts. The co-construction of discourse by candidates is regarded as a strength of paired speaking tests, as candidates have the opportunity to display a wider range of interactional competencies, including turn taking, initiating topics, and…

This article proposes a distinction between "fairness" and "justice" in relation to language tests. Basing its discussion on the validity theory of Samuel Messick, it discusses the way in which these terms have been used in the existing literature, and their relationship to the concept of validity. Fairness, broadly speaking, refers to the…

Although English is widely used by Indigenous Australians as the main means of communication, national testing has consistently raised questions as to the level of their English language and literacy achievement. This article examines contextual factors (historical, linguistic, cultural, socio-political and educational) which underlie this…

In recent years there has been growing theoretical interest in exploring the relationship between the interpretation and use of high-stakes proficiency test scores. In these discussions, the role of institutional test users (or test score consumers) has received only limited attention. This may be due, at least in part, to the lack of consensus in…