Specialists in the field of large-scale, high-stakes writing assessment have, over the last forty years alternately discussed the issue of maximizing either reliability or validity in test design. Factors complicating the debate--such as Messick's (1989) expanded definition of validity, and the ethical implications of testing--are explored. An…

Writing achievement among young adolescents has become a significant concern. According to data from the National Assessment of Educational Progress (NAEP) (2000), writing achievement has not changed appreciably in the last 15 years. However, NAEP data suggest that teachers have increased the amount of time students spend writing. In other words,…

This study investigated the effect of the portfolio assessment strategy to teach and assess writing performance of EFL third year students enrolled at the 3rd Secondary School, Skaka (Al-Jouf region). The purpose of the study was to determine whether a specific portfolio assessment model was effective in helping the students to improve their…

Research on the utility of feedback to raters in the form of performance reports has produced mixed findings (Lunt, Morton, & Wigglesworth, 1994; Wigglesworth, 1993) and has thus far been trialled only in oral assessment contexts. This article reports on a study investigating raters' attitudes and responsiveness to feedback on their ratings of…

The authors report on an exploratory study that investigated Grade 10 students' responses to a large-scale, high-stakes literacy test, the results of which determine high school graduation in Ontario, Canada. Through focus-group and individual interviews, the authors found that students perceived the test as evaluating their English skills rather…

A case is presented for adjusting the scores for free response items in the Advanced Placement (AP) tests. Using information about the rating process from the reliability studies, administrations of the AP test for three subject areas, psychology, computer science, and English language and composition, are analyzed. In the reliability studies, 299…

Two studies investigated the comparability of scores from paper-and-pencil and computer-administered versions of the College-Level Examination Program (CLEP) General Examinations in mathematics and English composition. The first study used a prototype computer-administered version on each examination for 94 students for mathematics and 116 for…

At Golden College (California), student writing samples are holistically scored by pairs of judges on a six-point scale. Judges are allowed to use plus and minus figures, thus converting the integer scale to a decimal scale of evaluation. In 1991, 499 writing samples written as part of the placement testing process for students in the Coast…

Students will be better equipped for college writing if they know how and by what standards their writing will be judged during their undergraduate years. At the college level, measures of writing skills serve the important functions of admission, placement, course equivalency, junior status, exit from courses, or barriers to graduation. Placement…

The purpose of this writing sampler is to provide teachers and students with work representing each of the rubric score points for the stand alone writing prompt on the 2001 Delaware Student Testing Program. The student papers included in this document are part of the "anchor sets" (collections of scored student work "anchored"…

Designed for use by literacy specialists, resource teachers, and classroom teachers, this book presents a diagnostic battery encompassing vital areas of evaluation based on research and practice, efficient in administration and interpretation, and relatively inexpensive. The third edition of the book has been revised to improve its organization;…

Writing assessment began in Alaska in the 1970s, and the Alaska Writing Assessment (AWA) that was piloted in 1997 built on previous efforts. The 1997 AWA involved more than 20,000 students in grades 5, 7, and 10 from 43 school districts, and the mandatory assessment planned for 1998 will include approximately 28,000 students. This review of the…

This update provides information for implementing the Nebraska Statewide Writing Assessment. It is intended to assist local educators in planning and preparing for the writing assessment being initiated in all public schools in Nebraska in grades 4, 8, and 11 in February 2001. The update continues the series of materials provided by the Nebraska…

The goal of this series of guides is to show Texas educators what components of the Texas Essential Knowledge and Skills (TEKS) curriculum are eligible for testing on the Texas Assessment of Academic Skills (TAAS) and end-of-course tests. This booklet contains information for tests administered beginning in the 10th grade as graduation…

This manual contains information regarding the administration of the Oregon Statewide Assessment Program's tests in writing and mathematics problem-solving. Parts of the manual address (1) background and preparation for testing; (2) administering the writing assessment; (3) administering the mathematics problem-solving assessment; (4) local rater…