Newer statistical procedures are typically introduced to help address the limitations of those already in practice or to deal with emerging research needs. Quantile regression (QR) is introduced in this paper as a relatively new methodology, which is intended to overcome some of the limitations of least squares mean regression (LMR). QR is more…

The 33rd Language Testing Research Colloquium (LTRC), held in June 2011 in Ann Arbor, Michigan, included a conference symposium on the topic of "assessment literacy." This event brought together a group of four presenters from different parts of the world, each of whom reported on their recent research in this area. Presentations were…

The "Language Proficiency Assessment for Teachers of English" (LPATE) is a test of standards of English language ability for Hong Kong primary and secondary school teachers of English. The impetus for the creation of the LPATE arose, in 1996, because of concerns in business and education communities over falling English language standards among…

The argument-based approach to validation involves two steps; specification of the proposed interpretations and uses of the test scores as an interpretive argument, and the evaluation of the plausibility of the proposed interpretive argument. More ambitious interpretations and uses tend to involve an extended network of inferences and assumptions…

The No Child Left Behind (NCLB) Act (US Government, 2001), the current iteration of the Elementary and Secondary Education Act of 1965, makes it clear that states, districts, schools and teachers are accountable for the education of English language learners (ELLs), as well as all other students. To implement an accountability system, NCLB…

This paper provides a summary of a novel and integrated way to think about the item response models (most often used in measurement applications in social science areas such as psychology, education, and especially testing of various kinds) from the viewpoint of the statistical theory of generalized linear and nonlinear mixed models. In addition,…

The purpose of the Test for English Majors (TEM) is to measure the English proficiency of Chinese university undergraduates majoring in English Language and Literature and to examine whether these students meet the required levels of English language abilities as specified in the National College English Teaching Syllabus for English Majors…

E-rater[R] is an automated essay scoring system that uses natural language processing techniques to extract features from essays and to model statistically human holistic ratings. Educational Testing Service has investigated the use of e-rater, in conjunction with human ratings, to score one of the two writing tasks on the TOEFL-iBT[R] writing…

Advances in natural language processing (NLP) and automatic speech recognition and processing technologies offer new opportunities for language testing. Despite their potential uses on a range of language test item types, relatively little work has been done in this area, and it is therefore not well understood by test developers, researchers or…

The assessment of so-called depth of word knowledge has been the focus of research for some years now. In this article the construct of deep word knowledge is further specified as the decontextualized knowledge of word meanings and word associations. Most studies so far have involved adolescent and adult second language learners. In this article,…

In the present study I describe the 150-year history of school-based English language assessment in Japan. The history is divided into four major periods according to the purposes of English language education set by the government in the different periods: (1) 1860 to 1945, when English was first introduced and taught in schools mainly for elite…

English is the associate official language in India and serves as a unifying force in this multilingual country. The teaching of English in K-12 settings focuses on the skills of reading and writing. Listening and speaking skills are not awarded much time, if any, in most classrooms or test settings; only two Boards of Examinations mandate their…

The competencies required for conducting assessment in the educational context have recently been reformulated in view of social constructivist perspectives and the acknowledgement of the role of classroom assessment in promoting learning. These changes have impacted the knowledge base language assessors need to obtain, and hence the contents of…

The article examines changes in language testing textbooks in English since Lado (1961) and proposes that two trends may be discerned. The first shows how the growing professionalism of the field has required an expansion in teaching materials to meet the need for new training programmes. What the expansion also shows is the desire, again a mark…

Two kinds of scoring templates were empirically derived from summaries written by experts and students to evaluate the quality of summaries written by the students. This paper reports students' attitudes towards the use of the two templates and its differential statistical effects on the judgment of students' summarization performance. It was…