This article begins by defining "world Englishes" (WEs) and the related paradigm of inner-, outer-, and expanding-circle English(es). The discussion then turns to the central concerns of the WEs and language testing (LT) communities with regard to how English tests can best be constructed to include various WEs by discussing (a) what…

A central issue in language testing is the choice of norms, and the need to reconcile notions of "standard" English with local language norms and features. Data from studies of international intelligibility indicate that some features of "standard" language descriptions, based on native-speaker language use, are not essential…

Current assessment practices in the United States are not able to accurately capture the total linguistic, cognitive, and achievement abilities of bilingual learners. There are psychometric complexities involved when assessing and interpreting test results of bilingual students, which impact the validity of this practice. Further, the compromise…

This article discusses the implications of "multicompetence" (Cook, 1991), defined as an individual's knowledge of more than one language, for language assessment. The growing psycholinguistic evidence highlighting variability in native speaker performance as a result of multicompetence is reviewed, evidence that further questions the validity of…

This mixed-methods study examines the effects of rating scale length and rater experience on listeners' judgments of second-language (L2) speech. Twenty experienced and 20 novice raters, who were randomly assigned to 5-point or 9-point rating scale conditions, judged speech samples of 38 newcomers to Canada on numerical rating scales for…

This study investigates aspects of validity of an alternative measure of productive vocabulary. Lex30, developed by Meara and Fitzpatrick, is a word association task that claims to give an indication of productive vocabulary knowledge. Previous studies of Lex30 have assessed test-retest reliability, performance against native speaker norms,…

Health literacy, defined as an individual's capacity to process health information in order to make appropriate health decisions, is the focus of increasing attention in medical fields due to growing awareness that suboptimal health literacy is associated with poorer health outcomes. To explore this issue, a number of instruments, reported to have…

Listening comprehension tests typically include both monologic and dialogic input to measure listening ability. However, research as to which type of input is more challenging for examinees remains limited and has provided inconclusive results (Brindley & Slatyer, 2002; Read, 2002; Shohamy & Inbar, 1991). A better understanding of the comparative…

This article reports on the development and validation of the English Diagnostic Test of Grammar (EDiT Grammar) for Japanese learners of English. From among the many aspects of grammar, this test focuses on the knowledge of basic English noun phrases (NPs), especially their internal structures, because previous research has indicated the…

This study investigates how accurate one item writer can be on item difficulty estimates and whether factors affecting item writer judgments correspond to predictors of actual item difficulty. The items were based on conversational dialogs (presented as videos online) that focus on pragmatic functions. Thirty-five 2nd-, 3rd-, and 4th-year learners…

Opinions differ on the importance of the native speaker's concept for language teaching and testing. This Commentary maintains that it is important and seeks to explain why. Three types of grammar are distinguished, the individual's, the community's and the human faculty of language. For first language teaching and testing it is the community's…

This article addresses the question of what language proficiency (LP) is, both theoretically and empirically. It does so by making a distinction, on one hand, between "basic" and "higher language cognition" and, on the other hand, between "core" and "peripheral components" of LP. The article furthermore critically examines the notion of "level" in…

This study examines score variations and differences in the reliability of ratings between English-as-a-second-language (ESL) and native English (NE) authored papers in a graduate course. Generalizability (G-) theory was used as a framework for analysis because it is powerful in detecting rater variability and the relative contributions of…

This article discusses a case study on an item writing process that reflects on our practical experience in an item development project. The purpose of the article is to share our lessons from the experience aiming to demystify item writing process. The study investigated three issues that naturally emerged during the project: how item writers use…

Differential item functioning (DIF) analysis can be used to great advantage in second language (L2) assessments. This study examined the differences in performance on L2 test items between groups from different first language backgrounds and suggested ways of improving L2 assessments. The study examined DIF on L2 (Hebrew) test items for two…