Sample size can be chosen to achieve a specified width in a confidence interval. The probability of obtaining a narrow width given that the confidence interval includes the population parameter is defined as the power of the confidence interval, a concept unfamiliar to many practitioners. This article shows how to utilize the Statistical Analysis…

This study explored undergraduate students' understanding of the chemistry topic of thermodynamics using a 4-tier diagnostic instrument, comprising 30 questions, and follow-up interviews. An additional objective of the study was to assess the utility of the 4-tier instrument for use in studies on alternative conceptions (ACs) as there has…

Research on haptic feedback has demonstrated limited empirical evidence of its positive learning effects. This research contrasts supportive anecdotal evidence and reports of increased motivation. In an attempt to unify these contrasting results we attempted to identify empirical evidence supporting haptic feedback's effect on learning by…

In this paper, we report on a study to quantify the impact on student learning and on student assessment literacy of a brief assessment literacy intervention. We first define "assessment literacy" then report on the development and validation of an assessment literacy measurement instrument. Using a pseudo-experimental design, we quantified the…

We report on a concept inventory for special relativity: the development process, data analysis methods, and results from an introductory relativity class. The Relativity Concept Inventory tests understanding of relativistic concepts. An unusual feature is confidence testing for each question. This can provide additional information; for example,…

The study investigated whether activation of inaccurate prior knowledge before study contributes to primary-school children's commission errors and overconfidence in these errors when learning new concepts. Findings indicate that inaccurate prior knowledge affects children's learning and calibration. The level of children's judgments of learning…

A single experiment is reported in which introductory psychology students were administered a multiple-choice test on psychology with either 4 (n = 78) or 5 alternatives (n = 92) prior to any lectures being delivered. Two answers were generated for each question: a small answer consisting of their favorite alternative, and a large answer…

Although calibration has been widely studied, questions remain about how best to capture confidence ratings, how to calculate continuous variable calibration indices, and on what exactly students base their reported confidence ratings. Undergraduates in a research methods class completed a prior knowledge assessment, two sets of readings and…

One of the key feedback questions is "where to next?" and this article provides some directions as to where to next for research based on a review of the five articles in this special issue. The directions relate to the critical importance of calibration, the multidimensionality of calibration, the relation of calibration to self-regulation…

This proposal advocates the position that the use of confidence wagering (CW) during testing can predict the accuracy of a student's test answer selection during between-subject assessments. Data revealed female students were more favorable to taking risks when making CW and less inclined toward risk aversion than their male counterparts. Student…

This proposal presents the results of a case study involving five 8th grade Taiwanese classes, two mathematics and three science classes. These classes used a new method of testing called confidence wagering. This paper advocates the position that confidence wagering can predict the accuracy of a student's test answer selection during…

This paper introduces a utilitarian confidence testing statistic called Risk Inclination Model (RIM) which indexes all possible confidence wagering combinations within the confines of a defined symmetrically point-balanced test environment. This paper presents the theoretical underpinnings, a formal derivation, a hypothetical application, and…

This paper describes the use of existing confidence and performance data to provide feedback by first demonstrating the data's fit to a simple linear model. The paper continues by showing how the model's use as a benchmark provides feedback to allow current or future students to infer either the difficulty or the degree of under or over…

This paper reports a quantitative study on gender differences in attitudes when learning oral skills via technology. The study was conducted at Tafila Technical University, Jordan, with 70 female and 30 male students, to find out if female students are better and faster in learning a language than male. Specifically, it seeks to investigate…

Testing Theory-based Quantitative Predictions (TTQP) represents an alternative to traditional Null Hypothesis Significance Testing (NHST) procedures and is more appropriate for theory testing. The theory generates explicit effect size predictions and these effect size estimates, with related confidence intervals, are used to test the predictions.…