Score reports have one or more intended audiences: the people who use the reports to make decisions about test takers, including teachers, administrators, parents and test takers. Attention to audience when designing a score report supports assessment validity by increasing the likelihood that score users will interpret and use assessment results…

Student examinees are key stakeholders in large-scale, high-stakes, public examination systems. How they perceive the purpose, comprehend the technical characteristics of testing and how they interpret scores influence their response to the system demands and their preparation for the examinations; this information relates to intended and…

Long-standing concerns within the field of educational assessment consider the impact of assessment policy and practice as matters of equity, inequality and social justice. Yet educational assessment policy and practice continues to have powerful social consequences for key users such as children and young people. This paper re-positions these…

It is important for educational assessment bodies to demonstrate how they are seeking to meet the demands of validity. The approach to validity taken here assumes a "consequentialist" view where the appropriacy of the inferences made on the basis of assessment results is seen as central. This paper describes the development of a systematic…

The focus of this study is gendered differences and similarities in the distribution of individual education plan (IEP) targets given to pupils in Swedish schools. IEP writing is seen as part of teachers' formal assessment practice. Through qualitative content analysis of data, two main target types emerged: "learning targets," related to school…

Automated scoring of constructed responses is already operational in several testing programmes. However, as the methodology matures and the demand for the utilisation of constructed responses increases, the volume of automated scoring is likely to increase at a fast pace. Quality assurance and control of the scoring process will likely be more…

At the heart of most assessments lies a set of questions, and those who write them must achieve "two" things. Not only must they ensure that each question elicits the kind of performance that shows how "good" pupils are at the subject, but they must also ensure that each mark scheme gives more marks to those who are "better" at it. We outline a…

Researchers have developed indices to identify persons whose test results "misfit" and are considered statistically "aberrant" or "unexpected" and whose measures are consequently potentially invalid, drawing the test's validity into question. This study draws on interviews of pupils and their teachers, using a sample of 31 10-year-olds who were…

An achievement test score can be viewed as a joint function of skill and will, of knowledge and motivation. However, when interpreting and using test scores, the "will" part is not always acknowledged and scores are mostly interpreted and used as pure measures of student knowledge. This paper argues that students' motivation to do their best on…

The two most common models for assessment involve measuring "how well" students perform on a task (the "quality model"), and "how difficult" a task students can succeed on (the "difficulty model"). By exploiting the interactive potential of computers we may be able to use a third model: measuring "how much help" a student needs to complete a task.…

Self-determination theory provides an integrated conception of school- and academic motivation. The theory proposes a continuum comprising three types of motivation: intrinsic motivation (IM), extrinsic motivation (EM), and amotivation (AM), characterised by seven dimensions (IM = to know, to accomplish and to experience stimulation, EM = external…

In their reactions to my paper, the four authors provide comments that are illuminating and helpful for continuing discussions of the nature and utility of quantitative, comparative, international studies of educational achievement. In this response, I comment further on the issues of test characteristics, sample design, culture and causation.

Within the context of increasing numbers of second language (L2) learners in Canadian schools and expanding standards-driven testing frameworks, a passing score on the Ontario Secondary School Literacy Test (OSSLT) is a recently imposed secondary school graduation requirement in Ontario. There is evidence, however, that tests designed on the basis…

This study considered middle school mathematics teachers use of rubrics to score non-traditional tasks. A group of eighth-grade teachers attended a two-day workshop where they evaluated assessment tasks and discussed the use of an associated scoring rubric. Scored samples of student work submitted by the teachers indicated that they had difficulty…

The validity of the Norwegian university grading standard has been called into serious question. The implicit standards used for assessing exams and the reliability of that understanding among examiners and psychology students were investigated in three studies. Studies 1 and 2 investigated the implicit standards that examiners used when assessing…