We investigated if instruction on a Table of Specifications (TOS) would influence the quality of classroom test construction. Results should prove informative for educational researchers, teacher educators, and practising teachers interested in evidenced-based strategies that may improve assessment-related practices. Fifty-three college…

This paper starts with an analysis of the twin purposes of an examination reform programme originally launched in Kenya during the 1970s: first, to broaden the spectrum of cognitive skills being tested; and second, to set up a feedback system based on the performance profiles, providing schools and teachers with guidance as to how pedagogy and…

The process of constructing assessment scales for performance testing is complex and multi-dimensional. As a result, a number of different approaches, both empirically and intuitively based, are open to developers. In this paper we outline the approach taken in the revision of a set of assessment scales used with speaking tests, and present the…

Automated scoring of constructed responses is already operational in several testing programmes. However, as the methodology matures and the demand for the utilisation of constructed responses increases, the volume of automated scoring is likely to increase at a fast pace. Quality assurance and control of the scoring process will likely be more…

At the heart of most assessments lies a set of questions, and those who write them must achieve "two" things. Not only must they ensure that each question elicits the kind of performance that shows how "good" pupils are at the subject, but they must also ensure that each mark scheme gives more marks to those who are "better" at it. We outline a…

Classroom teachers are in the front line of introducing students to formal learning, including assessments, which can be assumed to continue for students should they extend their schooling past the expected mandatory 12 years. The purpose of the present investigation was to survey secondary teachers' beliefs of classroom and large-scale tests for…

The aim of this study was to investigate whether, in the Hong Kong context, self- and peer-assessment promote students' self-reflection and enable students to understand their own strengths and weaknesses better. A three-stage assessment strategy was employed in three Science courses at The Chinese University of Hong Kong: (1) students developing…

While international comparisons such as those provided by PISA may be meaningful in terms of overall judgements about the performance of educational systems, caution is needed in terms of more fine-grained judgements. In particular it is argued that the results of PISA to draw conclusions about the quality of instruction in different systems is…

Within the context of increasing numbers of second language (L2) learners in Canadian schools and expanding standards-driven testing frameworks, a passing score on the Ontario Secondary School Literacy Test (OSSLT) is a recently imposed secondary school graduation requirement in Ontario. There is evidence, however, that tests designed on the basis…

High-stakes tests have been employed widely to engineer curriculum innovation, or achieve intended washback in education. But our understanding of the role of high-stakes tests as an agent for change is limited due to the small number of empirical studies available on this issue. This paper reports on a washback study which focuses on the writing…

The purpose of this article is to discuss the role of "baseline studies" in investigations of test impact and to illustrate the type of thinking underlying the design and implementation of such studies by reference to a recent study relating to a high-stakes test of English language proficiency. Baseline studies are used to describe an educational…

This study investigated whether dedicated test preparation classes gave learners an advantage in improving their writing test scores. Score gains following instruction on a measure of academic writing skills--the International English Language Testing System (IELTS) academic writing test--were compared across language courses of three types; all…

Setting examination questions in real-world contexts is widespread. However, when students are reading contextualized questions there is a risk that the cognitive processes provoked by the context can interfere with their understanding of the concepts in the question. Validity may then be compromised. We introduce the concept of "focus": a…

Driven largely by calls for accountability, the use of large-scale testing is expanding in terms of the number and purposes of testing programmes. At the same time, financial constraints have resulted in attempts to reduce the lengths of such examinations. An examination of the 1994/1995 and 1995/1996 British Columbia Scholarship programme…

This paper is about fairness (equity) in large-scale assessment systems within multicultural societies. It makes the key assumptions that fairness is fundamentally a sociocultural, rather than a technical, issue and that fair assessment cannot be considered in isolation from both the curriculum and the educational opportunities of the students.…