The Maine Legislature requested the Maine Education Policy Research Institute (MEPRI) to conduct an assessment of standardized testing in Maine schools to understand the amount, cost, and usefulness of it. This report summarizes the resulting effort, which included a literature scan, document analysis, and surveys of two groups of school…

This article examines the impact of the reading assessment, DIBELS (Dynamic Indicators of Basic Early Literacy Skills), on literacy education through the Habermasian lens. It argues that DIBELS, along with other systemic forces, has surged beyond its domain as a mere assessment and colonized the lifeworld of literacy education by distorting the…

Language tests are increasingly being used as gatekeeping tools in a globalised world. This article examines the processes of linguistic gatekeeping by the use of language tests in the context of migration. We draw on half a dozen cases of test-takers of the International English Language Testing System (IELTS) test who applied for entry into…

This paper presents the author's critique to Paul E. Newton's article titled "Clarifying the consensus definition of validity." In his article, Newton not only clarifies but also redefines the consensus definition of validity. In this redefinition he omits the term "construct" and introduces the term "measurement." Both omission and introduction…

According to Kane (2006), the argument-based framework is quite simple and involves two steps. First, specify the proposed interpretations and uses of the scores in some detail. Second, evaluate the overall plausibility of the proposed interpretations and uses. Based on experience gained in developing that validity argument, Chapelle, Enright, and…

In order to construct and evaluate the validity argument for the Objective Structured Assessment of Technical Skills (OSATS), based on Kane's framework, we conducted a systematic review. We searched MEDLINE, EMBASE, CINAHL, PsycINFO, ERIC, Web of Science, Scopus, and selected reference lists through February 2013. Working in duplicate, we selected…

The ubiquitous use of standardized test results to make varied judgments about educators, students, and schools within the public school system raises concerns of validity. If the test results have not been validated for making multiple determinations, then the decisions made about educators, students, schools, and school districts based on the…

The goal of this paper was to critically review and evaluate five common social-emotional and behavioral screeners: Behavioral and Emotional Screening System (Kamphaus and Reynolds 2007), Behavior Intervention Monitoring Assessment System (McDougal et al. 2011), Social Skills Improvement System Performance Screening Guide (Elliott and Gresham…

When student affairs professionals assess their work, they often employ some type of survey. The use of surveys stems from a desire to objectively measure outcomes, a demand from someone else (e.g., supervisor, accreditation committee) for data, or the feeling that numbers can provide an aura of competence. Although surveys are effective tools for…

States increasingly are incorporating Kindergarten Entry Assessments (KEAs) into their comprehensive assessment systems with the goal of helping educators identify gaps in children's competencies, target instruction to children's individual needs, engage parents to better support their child's learning, and identify needs for expanding and…

States increasingly are incorporating Kindergarten Entry Assessments (KEAs) into their comprehensive assessment systems with the goal of helping educators identify gaps in children's competencies, target instruction to children's individual needs, engage parents to better support their child's learning, and identify needs for expanding and…

This paper reports on the perceptions and experiences of primary school teachers of the challenges they faced and the prospects of using data from the Annual National Assessments (ANAs). While the majority stated that information from the ANAs can assist teachers to improve learning, responses on the use of the ANAs in the classroom were mixed,…

Although the speaking section of the "TOEFL iBT"® test is used by many universities to determine if international teaching assistants (ITAs) have the oral proficiency necessary to be classroom instructors, relatively few studies have investigated the validity of using TOEFL iBT scores for ITA screening. The primary purpose of this study…

This article draws on Kane's (2006) argument-based validation framework to synthesize evidence derived from a large-scale, mixed-method explanatory study on the impact of the Ontario Secondary School Literacy Test (OSSLT) on second language (L2) students. The purpose of the OSSLT is to ensure that students have acquired the essential reading and…

This article is motivated by interest in the deployment of massive numerical information produced by national examinations in the practices of control and steering. It examines how data generated in the compulsory school graduation examination in the Russian Federation connect together different actors within the education system and beyond, and…