There are numerous statistical procedures for detecting items that function differently across subgroups of examinees that take a test or survey. However, in endeavouring to detect items that may function differentially, selection of the statistical method is only one of many important decisions. In this article, we discuss the important decisions…

In the attempt to identify or prevent unfair tests, both quantitative analyses and logical evaluation are often used. For the most part, fairness evaluation is a pragmatic attempt at determining whether procedural or substantive due process has been accorded to either a group of test takers or an individual. In both the individual and comparative…

This article discusses learning that occurred during primary school visits to the UK National Marine Aquarium (Aquarium). Before visiting, children were asked to independently create a drawing of marine life off the Devon coast and a drawing of tropical reef marine life, allowing an assessment of prior knowledge. Post-visit, children created…

The aim of this study was to evaluate possible consequences of using unidimensional item response theory (UIRT) on a multidimensional college admission test. The test consists of 5 subscales and can be divided into two sections, that is, it can be considered both as a unidimensional and a multidimensional test. The test was examined with both UIRT…

This article reports a quasi-experimental study on the effects of multimedia teaching and learning in English Literature--a subject which places high cognitive load on students. A large-scale study was conducted in 4 high-achieving secondary schools to examine the differences made to students' learning and performance by the use of multimedia and…

This article reports the results of the first systematic, though only exploratory, study that assesses the effectiveness of the Philosophy for Children (commonly known as P4C) programme in promoting children's critical thinking in Hong Kong. Forty-two Secondary 1 students volunteered for this study, from whom 28 students were randomly selected and…

In the UK and elsewhere, large-scale educational assessment agencies are shifting the mode of school examination marking towards having examiners mark examination scripts on screen rather than on paper. This shift has prompted questions about whether the mode of marking might influence examiner marking accuracy, particularly in relation to…

Research has found that grades are the most valid instruments for predicting educational success. Why grades have better predictive validity than, for example, standardized tests is not yet fully understood. One possible explanation is that grades reflect not only subject-specific knowledge and skills but also individual differences in other…

Cross-age peer mentoring is an educational model that builds on peer support and mentoring to assist young people to enhance social relationships, develop cognitive skills, and promote positive identity development. In this article, we outline the evaluation process of a cross-age peer-mentoring program implemented in an Australian secondary…

Comparability between different educational qualifications is an important issue within policy discourse in the UK. In this context, the comparability of qualification demands has been explored through the use of expert human judgement. The involvement of human judgement in estimating assessment demands has consequences for methodology. This…

Evaluators are frequently asked to assess the effectiveness of school programs implemented to improve academic achievement. School connectedness has been shown to be directly related to academic achievement (McNeely, Nonnemaker, & Blum, 2002) and is therefore of interest to evaluators. The construct of school connectedness has been shown to…

The purpose of this study was to design and validate the Assessing Quality Teaching Rubrics (AQTR) that assesses the pre-service teachers' quality teaching practices in a live lesson or a videotaped lesson. Twenty-one lessons taught by 13 Physical Education Teacher Education (PETE) students were videotaped. The videotaped lessons were evaluated…

Educational achievement is a very important issue for parents, teachers, and the government. An accurate measurement plays a very important role in evaluating achievement fairly, and, therefore, analysis methods have been developed considerably in recent years. Education based on long-time learning processes forms a fruitful base for item tests,…

If classification in a limited number of categories is the purpose of testing, computerized adaptive tests (CATs) with algorithms based on sequential statistical testing perform better than estimation-based CATs (e.g., Eggen & Straetmans, 2000). In these computerized classification tests (CCTs), the Sequential Probability Ratio Test (SPRT) (Wald,…

Several current international comparative large-scale assessments of educational achievement (ICLSA) make use of "Rasch models", to address functions essential for valid cross-cultural comparisons. From a historical perspective, ICLSA and Georg Rasch's "models for measurement" emerged at about the same time, half a century ago. However, the…