Two-alternative, forced-choice tests are commonly used to assess cooperation in examinations of neurocognitive functioning. Most commercially available tests do not primarily depend on comparing the total correct responses to the number expected by guessing. Nevertheless, the tests afford an opportunity to make stronger judgments about the…

According to the recent Nation's Report Card, 12th-graders failed to produce gains on the 2005 National Assessment of Educational Progress (NAEP) despite earning better grades on average. One possible explanation is that 12th-graders were not motivated taking the NAEP, which is a low-stakes test. We develop three Bayesian IRT mixture models to…

Elementary school children's word guessing is studied, and the results from individual and collective testing conditions are compared. The participants are 764 students from the second, third, and fourth grades (ages 8-11, 541 students from mainstream regular classes and 223 students with learning disabilities). About half of these students are…

During the English language learning, it is common for Chinese students to have to guess the meaning of new word groups or phrases. The guessing ability may be related to the cognitive sameness and differences between Chinese and English people. In order to validate this hypothesis, the author carried out a research by having students doing test…

The present study examined the relation between self-reported confidence ratings, performance on the Mental Rotations Test (MRT), and guessing behavior on the MRT. Eighty undergraduate students (40 males, 40 females) completed the MRT while rating their confidence in the accuracy of their answers for each item. As expected, gender differences in…

The reasoning behind popular methods for analysing the raw data generated by multiple choice question (MCQ) tests is not always appreciated, occasionally with disastrous results. This article discusses and analyses three options for processing the raw data produced by MCQ tests. The article shows that one extreme option is not to penalize a…

Language teachers often encourage L2 readers to guess the meaning of unknown words in texts. This paper argues that before any statements about the value of guessing can be made, it is necessary to show how reliable learners' guesses are. To this end, the present study investigates how accurately EFL learners assess their understanding of unknown…

The purpose of this study was to examine whether the efficiency, precision, and validity of computerized adaptive testing (CAT) could be improved by assessing confidence differences in knowledge that examinees possessed. We proposed a novel polytomous CAT model called the confidence-weighting computerized adaptive testing (CWCAT), which combined a…

The relationships among verbal skills of primary school students with learning disabilities and a typically developing comparison group were studied and compared with written tasks carried out in Estonian classrooms. Word defining, categorising/justifying, guessing, and memorising tasks were used. The participants were 251 students in Grades 2-4;…

This Monte Carlo study compares the ability of the parametric bootstrap version of DIMTEST with three goodness-of-fit tests calculated from a fitted NOHARM model to detect violations of the assumption of unidimensionality in testing data. The effectiveness of the procedures was evaluated for different numbers of items, numbers of examinees,…

This educational software was developed to aid teachers and students in their understanding of how the process of identifying the most likely quantitative trait loci (QTL) position is determined between two flanking DNA markers. The objective of the software that we developed was to: (1) show how a QTL is mapped to a position on a chromosome using…

In the standard Iowa Gambling Task (IGT), participants have to choose repeatedly from four options. Each option is characterized by a constant gain, and by the frequency and amount of a probabilistic loss. Crone and van der Molen (2004) reported that school-aged children and even adolescents show marked deficits in IGT performance. In this study,…

The study investigated the comparison of the difficulty and discrimination incides of three multiple choice tests using the confidence scoring procedure (CSP). The study was also set to determine whether or not the difficulty and discrimination indices would be improved, if the tests were scored by the confidence scoring procedure. Two null…

This article investigates several methods of identifying individual guessers from their response data. Both the posterior probability method and the likelihood ratio method are based on the two-state mixture modeling approach to response times. The accuracy method is based on response accuracy data. Results from the simulation study showed that…

We focus on the problem of ignoring statistical independence. A binomial experiment is used to determine whether judges could match, based on looks alone, dogs to their owners. The experimental design introduces dependencies such that the probability of a given judge correctly matching a dog and an owner changes from trial to trial. We show how…