This study investigates the relationships between test takers' metacognitive and cognitive strategy use through a questionnaire and their test performance on an English as a Foreign Language reading test. A total of 593 Chinese college test takers responded to a 38-item metacognitive and cognitive strategy questionnaire and a 50-item reading…

In this study we compare test takers' performance on the Speaking section of the TOEFL iBT™and their performances during their real-life academic studies. Thirty international graduate students from mixed language backgrounds in two different disciplines (Sciences and Social Sciences) responded to two independent and four integrated speaking…

Training of pre- and in-service teachers constitutes one of the most important aspects in the quality assurance of language testing and assessment (LTA). For instance, foreign language (FL) teachers have to deal with standardised tests as well as their own classroom-based assessment procedures. This means they need the necessary expertise that can…

In recognition of the rating scale as a crucial tool of performance assessment, this study aims to establish a rating scale suitable for a Story Retelling Speaking Test (SRST), which is a semidirect test of speaking ability in English as a foreign language for classroom use. To identify an appropriate scale, three rating scales, all of which have…

Feedback to the test taker is a defining characteristic of diagnostic language testing (Alderson, 2005). This article reports on a study that investigated how much and in what ways students at a Taiwan university perceived the feedback to be useful on an online multiple-choice diagnostic English grammar test, both in general and by students of…

Researchers of high-stakes, subjectively scored writing assessments have done much work to better understand the process that raters go through in applying a rating scale to a language performance to arrive at a score. However, there is still unexplained, systematic variability in rater scoring that resists rater training (see Hoyt & Kerns, 1999;…

This study investigates how accurate one item writer can be on item difficulty estimates and whether factors affecting item writer judgments correspond to predictors of actual item difficulty. The items were based on conversational dialogs (presented as videos online) that focus on pragmatic functions. Thirty-five 2nd-, 3rd-, and 4th-year learners…

The International Civil Aviation Association has developed a set of Language Proficiency Requirements (LPRs) and a Language Proficiency Rating Scale, which seeks to define proficiency in the language needed for aviation purposes at six different levels. Pilots, air traffic controllers and aeronautical station operators are required to achieve at…

This article reports on a study conducted with 42 participants from a Chilean university, which aimed to determine the effect of mode of response on test performance and test-taker perception of test features by comparing a semidirect online version and a direct face-to-face version of a speaking test. Candidate performances on both test versions…

Comparability studies on computer- and paper-based reading tests have focused on short texts and selected-response items via almost exclusively statistical modeling of test performance. The psychological effects of presentation mode and computer familiarity on individual students are under-researched. In this study, 157 students read extended…

In recent years, the emphasis in second language (L2) oral proficiency assessment has shifted from linguistic accuracy to discourse strategies such as the ability to initiate, respond, and negotiate meaning. This has resulted in a growing interest in the discourse analysis of students' performance in different oral proficiency assessment formats.…

This article reports on two related studies carried out to link the State examination of Dutch as a second language to the Common European Framework of Reference for languages (CEFR). In the first study, key persons from institutions for higher education were asked to determine the minimally required language level of beginning students. In the…

This article presents a test development project for classroom speaking assessment. With the aim of enhancing and specifically easing the process of test preparation and administration and generating positive washback effects on learning, we developed a semi-direct speaking test called the Story Retelling Speaking Test (SRST). Although a story…

This article reports on an empirical study that tests a fourth-order factor model of strategic competence through the use of structural equation modeling (SEM). The study examines the hierarchical relationship of strategic competence to (a) strategic knowledge of cognitive and metacognitive strategy use in general (i.e., trait) and (b) strategic…

From June to November 2003 an exploratory survey was made of the assessment of written English in a small sample of English language degrees in Europe. All programmes had similar components, the study of English language and literature, cultural or area studies, and English language development. Some involved the study of another language.…