The purpose of test directions is to familiarize examinees with a test so that they respond to items in the manner intended. However, changes in educational measurement as well as the U.S. student population present new challenges to test directions and increase the impact that differential familiarity could have on the validity of test score…

This study investigates the relationships between test takers' metacognitive and cognitive strategy use through a questionnaire and their test performance on an English as a Foreign Language reading test. A total of 593 Chinese college test takers responded to a 38-item metacognitive and cognitive strategy questionnaire and a 50-item reading…

Sometimes, test-takers may not be able to attempt all items to the best of their ability (with full effort) due to personal factors (e.g., low motivation) or testing conditions (e.g., time limit), resulting in poor performances on certain items, especially those located toward the end of a test. Standard item response theory (IRT) models fail to…

This investigation explored the use of strategic instruction to improve the essay-test taking skills of young adults who were enrolled in a campus-based, post-secondary education program for individuals with developmental disabilities. A random assignment to treatment or control groups and a pre- and posttest design was used. The participants…

For a number of years now, South Africa, like many other countries, has been debating a major paradigm shift in education, a shift from learning and teaching, which focused primarily on content to learning and teaching focused on outcomes. One of the most dramatic trends in education over the past decade has been the shift towards the use of…

This study examined the empirical differences between the tendency to omit items and reading ability by applying tree-based item response (IRTree) models to the Japanese data of the Programme for International Student Assessment (PISA) held in 2009. For this purpose, existing IRTree models were expanded to contain predictors and to handle…

Chemistry faculty members are highly skilled in obtaining, analyzing, and interpreting physical measurements, but often they are less skilled in measuring student learning. This work provides guidance for chemistry faculty from the research literature on multiple-choice item development in chemistry. Areas covered include content, stem, and…

As methods for automated scoring of constructed-response items become more widely adopted in state assessments, and are used in more consequential operational configurations, it is critical that their susceptibility to gaming behavior be investigated and managed. This article provides a review of research relevant to how construct-irrelevant…

Trying out a "Beyond the Bubble" assessment in a social studies methods classroom revealed that the assessment worked much better than any multiple choice item while retaining great ease in marking. However, as discussion of the item showed, the rubrics for the item apply the "sourcing" heuristic so literally that it loses some…

Preparing at-risk youth and students with mild disabilities for state and district tests is important for improving their test performance, and basic instruction in test preparation can significantly improve student test performance. The article defines noncognitive variables that adversely affect test-taker performance. The article also describes…

This study examined the predictive validity of a teacher rating scale called the Self-Regulation Strategy Inventory-Teacher Rating Scale (SRSI-TRS) and its level of convergence with several student self-report measures of self-regulated learning (SRL). Eighty-seven high school students enrolled in one of four sections of a mathematics course in an…

Learning Analytics (LA) has been identified as one of the top technology trends in higher education today (Johnson et al., 2013). LA is based on the idea that datasets generated through normal administrative, teaching, or learning activities--such as registrar data or interactions with learning management systems--can be analyzed to enhance…

Testing aids, including student-prepared testing aids (a.k.a., cheat sheets or crib notes) and open-textbook exams, are common practice in post-secondary assessment. There is a considerable amount of published research that discusses and investigates the impact of these testing aids. However, the findings of this research are contradictory and…

This article provides recommendations for teachers to better prepare 3rd through 12th grade students with learning disabilities for large-scale writing assessments. The variation across large-scale writing assessments and the multiple needs of struggling writers indicate the need for test preparation to be embedded within a comprehensive,…

The importance of testing, especially certification and high-stakes testing, has increased substantially over the past decade. Building on the "serious gaming" literature and the psychology "priming" literature, we developed a computer game designed to improve test-taking performance using psychological priming. The game primed…