When students fail an examination at the end of their first year, they are offered a resit examination, which they merely need to pass to progress into the second year. These resits anecdotally provide a dual purpose of testing that students have achieved the required level of attainment to progress, and incentivising additional effort. This paper…

A group of postgraduate accounting and finance students were asked to participate in a three-phase exercise: sit an unseen past examination question; mark a fully anonymised previous student solution (exemplar); and then mark their own work. The marking process was facilitated by explaining and discussing the marking guide, assessment systems and…

Background/Context: The target of assessment validation is not an assessment but the use of an assessment for a purpose. Although the validation literature often provides examples of assessment purposes, comprehensive reviews of these purposes are rare. Additionally, assessment purposes posed for validation are generally described as discrete and…

Background/Context: Principles of evidential reasoning have often been discussed in the context of educational and psychological measurement with respect to construct validity and validity arguments. More recently, Mislevy proposed the metaphor of assessment as an evidentiary argument about students' learning and abilities given their…

Any examination that involves moderate to high stakes implications for examinees should be psychometrically sound and legally defensible. Currently, there are two broad and competing families of test theories that are used to score examination data. The majority of instructors outside the high-stakes testing arena rely on classical test theory…

We followed established best practices in concept inventory design and developed a 12-item inventory to assess student ability in statistical reasoning in biology (Statistical Reasoning in Biology Concept Inventory [SRBCI]). It is important to assess student thinking in this conceptual area, because it is a fundamental requirement of being…

Ten years of College Student Inventory (CSI) data from one Midwestern public land-grant university were used to study the role of motivational factors in predicting academic success and college student retention. Academic success was defined as cumulative grade point average (GPA), cumulative course load capacity (i.e., the number of credits…

Researchers in the medical domain consider the double-blind placebo controlled clinical trial the gold standard. The data for these clinical trials are collected for a specifically defined hypothesis and there is very little in the realm of secondary data analyses conducted. The underlying purpose of this work is to demonstrate the value and…

Although prior studies have documented a positive association between religiosity and sense of meaning in life, the role of specific religious beliefs is currently unclear. Past research on images of God suggests that loving images of God will positively correlate with a sense of meaning and purpose. Mechanisms for this hypothesized relationship…

As of September 2012, only Alaska, Minnesota, Nebraska, Texas, and Virginia had not adopted the Common Core State Standards (CCSS). Yet empirical evidence that demonstrates the efficacy of the initiative remains elusive. The Emperor has no clothes (Tienken 2011a). This latest installment of standardization and centralization of curriculum and…

This study proposes robust means modeling (RMM) approaches for hypothesis testing of mean differences for between-subjects designs in order to control the biasing effects of nonnormality and variance inequality. Drawing from structural equation modeling (SEM), the RMM approaches make no assumption of variance homogeneity and employ robust…

Analysts of institutional performance have occasionally used a peer grouping approach in which they compared institutions only to other institutions with similar characteristics. Because analysts historically have used cluster analysis to define peer groups (i.e., the group of comparable institutions), the author proposes and demonstrates with…

Research finds that small high schools deliver better outcomes than large high schools for urban students. An important outstanding question is whether this better performance is gained at the expense of losses elsewhere: Does small school reform lift the whole district? We explore New York City's small high school reform in which hundreds of new…

The effects of high- versus low-quality child care during 2 developmental periods (infant-toddlerhood and preschool) were examined using data from the National Institute of Child Health and Human Development Study of Early Child Care. Propensity score matching was used to account for differences in families who used different combinations of child…

Dual Process Theories (DPT) of reasoning posit that judgments are mediated by both fast, automatic processes and more deliberate, analytic ones. A critical, but unanswered question concerns the issue of monitoring and control: When do reasoners rely on the first, intuitive output and when do they engage more effortful thinking? We hypothesised…