Test scores matter these days. Test-takers want to understand how they performed, and test score reports, particularly those for individual examinees, are the vehicles by which most people get the bulk of this information. Historically, score reports have not always met the examinees' information or usability needs, but this is clearly changing…

The measurement community needs to better understand how to interact with the media to effectively disseminate important findings from educational testing efforts. To this end, the current paper will review media coverage of educational testing and related issues and elaborate on areas of concern and opportunities for improved communication…

The purpose of this ITEMS module is to provide an introduction to subscores. First, examples of subscores from an operational test are provided. Then, a review of methods that can be used to examine if subscores have adequate psychometric quality is provided. It is demonstrated, using results from operational and simulated data, that subscores…

Over the past few decades, those who take tests in the United States have exhibited increasing diversity with respect to native language. Standard psychometric procedures for ensuring item and test fairness that have existed for some time were developed when test-taking groups were predominantly native English speakers. A better understanding of…

"Scaling" is the process of constructing a score scale that associates numbers or other ordered indicators with the performance of examinees. Scaling typically is conducted to aid users in interpreting test results. This module describes different types of raw scores and scale scores, illustrates how to incorporate various sources of information…

Examinees who take high-stakes assessments are usually given an opportunity to repeat the test if they are unsuccessful on their initial attempt. To prevent examinees from obtaining unfair score increases by memorizing the content of specific test items, testing agencies usually assign a different test form to repeat examinees. The use of multiple…

In the current No Child Left Behind era, K-12 teachers and principals are expected to have a sophisticated understanding of standardized test results, use them to improve instruction, and communicate them to others. The goal of our project, funded by the National Science Foundation, was to develop and evaluate three Web-based instructional modules…

State test score trends are widely interpreted as indicators of educational improvement. To validate these interpretations, state test score trends are often compared to trends on other tests such as the National Assessment of Educational Progress (NAEP). These comparisons raise serious technical and substantive concerns. Technically, the most…

Discusses three common misconceptions about achievement testing: (1) the idea that men generally outscore women; (2) the notion that the primary role of norms is to compare one student to another; and (3) the misconception that it is not possible to measure the achievement of kindergarten and primary grade students with group tests. (SLD)

Studied students' erasure behavior on a standardized (low stakes) test. Results for 5,641 students in grades 4, 8, and 11 suggest that students do change their responses at an average of 6 to 7% of the tested items and that overall achievement appears unrelated to the student's tendency to erase and change a response. Discusses conditions under…

Explores how reliability and validity of assessment results should be conceived and covered in teacher education. Discusses each of the standards for teacher competence in assessment developed by the American Federation of Teachers in conjunction with other groups. Reviews coverage of these topics in frequently used textbooks. (SLD)

The accuracy of statistics based on performance assessments that represent percentages of students reaching standards is explored using data from a large-scale performance assessment, the Maryland School Performance Assessment Program. Results with students in grades 3, 5, and 8 support the accuracy of pooling results to produce the statistics.…

The effects of recent changes on the Scholastic Assessment Tests (SAT) on mathematics performance are being studied using data from 1993 and later. Early results show a relative gain for women in the verbal area but not in mathematics. Expected trends, including an effect from increased calculator use, are discussed. (SLD)

Results for 3,244 female and 3,033 male junior high school students from the Second International Mathematics Study show that applied items in algebra, geometry, and computation were easier for males but arithmetic items were differentially easier for females. Implications of these findings for assessment and instruction are discussed. (SLD)

The effects of performance assessment on student learning were studied in third grades in three suburban schools and matched control schools. Performance measures did not produce clear and immediate improvements in student learning, but some positive changes were seen in mathematics. (SLD)