This article presents a case study incorporating English teachers' perspectives into the development of a large-scale international English assessment, the recently developed "TOEFL Junior"® Comprehensive test. It discusses how stakeholder feedback gathered during test development supports the validity argument for score…

Test takers should have a voice in testing practices (Mathew, 2004). However, when incorporating their input, systematic processes to ensure the validity of testing practices must be followed. Such processes allow for test development to be a more democratic process (Shohamy, 2001), without sacrificing the value of the resulting inferences made…

A central issue in language testing is the choice of norms, and the need to reconcile notions of "standard" English with local language norms and features. Data from studies of international intelligibility indicate that some features of "standard" language descriptions, based on native-speaker language use, are not essential…

This article reports on the development and piloting of a vocabulary recognition test designed for Indigenous Australian children. The research is both application oriented and development oriented. The aims of the article are to determine how well the test is used as a test instrument and the extent to which children recognize vocabulary items in…

Many children around the globe are learning English as a foreign language, especially in Asia. Numbers of participants and development of programs are increasing rapidly, as is a commercial testing movement targeted toward assessing this group of young learners. For example, the popular Cambridge Young Learners English test series has had more…

This study investigates how accurate one item writer can be on item difficulty estimates and whether factors affecting item writer judgments correspond to predictors of actual item difficulty. The items were based on conversational dialogs (presented as videos online) that focus on pragmatic functions. Thirty-five 2nd-, 3rd-, and 4th-year learners…

Within the context of Taiwan, where growing numbers of universities seek teaching excellence and better English learning outcomes, passing a designated English test has been imposed on thousands of university students as one of their degree requirements. This educational policy has become feasible only after the debut of the indigenous General…

Communicative and task-based teaching hold central places in contemporary language pedagogy, yet their feasibility as pedagogic innovations in Chinese contexts remains open to question. Examinations are generally perceived as a particular factor militating against the implementation of communicative approaches. This study uses four case studies of…

This article discusses a case study on an item writing process that reflects on our practical experience in an item development project. The purpose of the article is to share our lessons from the experience aiming to demystify item writing process. The study investigated three issues that naturally emerged during the project: how item writers use…

While research into classroom language assessment has expanded in recent years, the nature of thought processes used by teachers when conducting such assessment has received less attention. This article reports on research that explored these cognitions through case studies of two instructors teaching an EAP (English for Academic Purposes) course…

This article describes an alternative approach to setting standards for performance assessments. The procedure was designed for use in low-budget, relatively low-stakes contexts where it is not possible to bring expert judges together. The procedure that allowed participant judges to work individually throughout the process was an effort to…

The notion of language dominance is often defined in terms of proficiency. We distinguish dominance, as a property of the bilingual mind and a concept of language knowledge, from proficiency, as a concept of language use. We discuss ways in which language dominance may be assessed, with a focus on measures of mean length of utterance (MLU).…

The fields of language testing and educational and psychological measurement have not, as yet, developed a set of principles and procedures for linking test scores and score-based inferences to test use and the consequences of test use. Although Messick (1989) discusses test use and consequences, his framework provides virtually no guidance on how…

In this article, we will first focus on how starting from the stakeholders' needs has led to the construction of examinations based on a theory of functional language performance assessment in which, not general, but domain-specific language use plays a central role. Second, we will describe how we aim to infer real-life performance on the basis…