The vast majority of the research on student evaluation of instruction has assessed the reliability of groups of courses and yielded either a single reliability coefficient for the entire group, or grouped reliability coefficients for each student evaluation of teaching (SET) item. This manuscript argues that these practices constitute a form of…

This paper illustrates the application of existing guidelines to develop a test grounded in theoretical perspectives and empirical findings in the area of problem solving. By documenting this process, the paper outlines the challenges test developers face when seeking to construct a theory/research-driven test, discusses the decisions made at…

Many innovation-oriented concepts have recently been discussed as means to improve science education and instruction as well as the corresponding tests and exit exams. So far, empirical evidence of whether these new concepts for exam tasks actually find their way into the exam practice is still pending. This contribution takes up this desideratum…

The idea that assessment is intrinsic to effective instruction is traced from early experiments in the individualization of learning through the work of Benjamin Bloom to reviews of the impact of feedback on learners in classrooms. While many of these reviews detailed the adverse impact of assessment on learning, they also indicated that under…

The requirements for valid assessment for learning and assessment of learning are reviewed and then the tensions between these two purposes of assessment are explored, first in general and then within two areas of the New Zealand education system. First, the nature of assessment for learning in primary schools is discussed and how it is, or might…

The interest in "assessment for learning" (AfL) has resulted in a search for new modes of assessment that are better aligned to students' learning how to learn. However, with the introduction of new assessment tools, also questions arose with respect to the quality of its measurement. On the one hand, the appropriateness of traditional,…

Hundreds of millions of dollars in public and private funding have been spent to develop, research, and evaluate the assessment system of the National Board for Professional Teaching Standards (NBPTS). In an effort to determine if this has been money well spent, the U.S. Congress commissioned the National Research Council (NRC) to develop a…

Assessment-led reform is now one of the most widely favored strategies to promote higher standards of teaching, more powerful learning and more credible forms of public accountability. Within this context of change, higher education in many countries is increasingly subjected to demands to implement alternative assessment strategies that provide…

To date, hardly any evidence is available on the quality of adult education programs for vulnerable adults. Evaluation instruments or models mostly focussed on regular education and less on programs of adult education aiming to enhance social inclusion. This study presents a first exploration of the construct validity of a newly developed…

The study analyzes the effects of grade repetition on science and mathematics achievement and on self-concept in mathematics using longitudinal data from a representative sample of 9th graders in Germany. Same-age comparisons were applied between three groups: (a) the retained students, (b) a matched group of promoted students, and (c) the entire…

This article focuses on school self-evaluations (SSE). It addresses whether SSE meets quality indicators and whether differences can be found between the quality judgments of school principals and inspectors. Data stem from two complementary data collections: population data of school inspections and a survey of a representative sample of school…

To what extent does the intense and direct involvement of internal stakeholders, such as program managers and staff members, play a significant role toward evaluation use? Stakeholder involvement is a key element in evaluation and evaluation use is considered within a broader sense that includes organizational knowledge, individual skills, and…

This study is an evaluation of a systemic, two-year, whole-school bullying intervention initiative that was implemented in a US public high school. Students and staff members were anonymously surveyed before and after the intervention. The goals of the initiative were to reduce bullying and victimization, increase disclosure, increase intervention…

The aim of the present study is to examine the relation between stakeholders as internal evaluators and their systemic positions in light of construal level theory. The study examines the two samples of county representatives, teachers and principals who answered the questionnaire regarding evaluation of the Norwegian assessment program. In…

This study examines how different stakeholders experience the quality of a nationally developed assessment framework for summative, competence-based assessment (CBA) in AVET, which aims to reflect theoretical characteristics of high quality CBAs. The quality of two summative CBAs, based on this national framework, is evaluated along an extensive,…