Language tools are reflections of the academic traditions of assessment developers, as well as the perceptions of language quality as held by a society. The certification of Quebec's teachers offers an interesting case in point: the Québec Government's "ministère de l'Éducation, du Loisir et du Sport" (MELS) requires that…

In Quebec the high-stakes Secondary Five ESL exit writing exam developed by the Education Ministry (MELS) is administered and corrected by classroom teachers. In this distinctive situation, the MELS works toward aligning classroom-based assessment (CBA) and the writing exam by making ongoing teacher involvement part of its development and…

This article draws on Kane's (2006) argument-based validation framework to synthesize evidence derived from a large-scale, mixed-method explanatory study on the impact of the Ontario Secondary School Literacy Test (OSSLT) on second language (L2) students. The purpose of the OSSLT is to ensure that students have acquired the essential reading…

Research in the study of students' writing concludes that vocabulary use is a key variable in determining the holistic quality of the writing. In the present study, 77 writing samples from a mixed group of Grade 3 children were analyzed for features of linguistic diversity using public domain vocabulary-profiling software. The writing was…

Research on issues concerning the assessment of school-age English language learners (ELLs) in curriculum-learning contexts has been relatively less productive than assessment of adult language learners. A growing demand for assessing school-age ELLs has led to the development of assessment frameworks that provide the opportunity to examine the…

Diagnostic assessment is increasingly being recognized as a potentially beneficial tool for teaching and learning (Jang, 2012). There have been calls in the research literature for students to receive diagnostic feedback and for researchers to investigate how such feedback is used by students. Therefore, this study examined how students…

This study investigates the relationships between test takers' metacognitive and cognitive strategy use through a questionnaire and their test performance on an English as a Foreign Language reading test. A total of 593 Chinese college test takers responded to a 38-item metacognitive and cognitive strategy questionnaire and a 50-item reading…

Despite the popularity of task-based language teaching (TBLT) in foreign language (FL) education at elementary school, it remains unclear how young learners' FL abilities can best be evaluated with tasks. The present study seeks to understand developmental differences in interactions among elementary-school students during task-based language…

There has been a growing interest in the use of integrated tasks in the field of second language testing to enhance the authenticity of language tests. However, the role of text integration in test takers' performance has not been widely investigated. The purpose of the current study is to examine the effects of text-based relational (i.e.,…

This article presents a case study incorporating English teachers' perspectives into the development of a large-scale international English assessment, the recently developed "TOEFL Junior"® Comprehensive test. It discusses how stakeholder feedback gathered during test development supports the validity argument for score…

Common estimators of interrater reliability include Pearson product-moment correlation coefficients, Spearman rank-order correlations, and the generalizability coefficient. The purpose of this study was to examine the accuracy of estimators of interrater reliability when varying the true reliability, number of scale categories, and number of…

In this study we compare test takers' performance on the Speaking section of the TOEFL iBT™and their performances during their real-life academic studies. Thirty international graduate students from mixed language backgrounds in two different disciplines (Sciences and Social Sciences) responded to two independent and four integrated speaking…

This study explores the construct of a summarization test task by means of single-group and multigroup structural equation modeling (SEM). It examines the interrelationships between strategy use and performance, drawing on data from 298 Taiwanese undergraduates' summary essays and their self-reported strategy use. Single-group SEM analyses…

Training of pre- and in-service teachers constitutes one of the most important aspects in the quality assurance of language testing and assessment (LTA). For instance, foreign language (FL) teachers have to deal with standardised tests as well as their own classroom-based assessment procedures. This means they need the necessary expertise that can…

This article critiques traditional single-level statistical approaches (e.g., multiple regression analysis) to examining relationships between language test scores and variables in the assessment setting. It highlights the conceptual, methodological, and statistical problems associated with these techniques in dealing with multilevel or nested…