ERIC Number: ED367683
Record Type: Non-Journal
Publication Date: 1993
Reference Count: N/A
Interpretations of National Assessment of Educational Progress (NAEP) Anchor Points and Achievement Levels by the Print Media in 1991.
Koretz, Daniel; Diebert, Edward
This report reviews the accuracy and reasonableness of statements in the print media about student proficiency on the 1990 National Assessment of Educational Progress (NAEP) in mathematics. It explores the apparent effects of two reporting approaches, the anchor-point method used by the Educational Testing Service and the National Center for Education Statistics since 1984 and the achievement-level (performance standards) method instituted in 1990 by the National Assessment Governing Board. In presenting anchor points and achievement levels the majority of writers incorrectly portrayed performance as discontinuous and ignored the continuum of success and failure. P-values, when provided, were frequently misinterpreted. Only a minority of articles mentioned the judgmental nature of the levels. Use of these metrics appeared to help the press by providing quotable and seemingly clear expressions of test results, but many articles were simplistic or incorrect, and important information often went unreported. Neither method as implemented for the 1990 results was adequate. Some suggestions are made for improved reporting. Two tables present details about the methods. (Contains 40 references.) (SLD)
Descriptors: Academic Achievement, Achievement, Communication (Thought Transfer), Elementary Secondary Education, Information Dissemination, Journalism, Mathematics Achievement, Mathematics Tests, National Competency Tests, News Reporting, News Writing, Newspapers, Periodicals, Scaling, Test Interpretation, Test Results, Writing for Publication
Publication Type: Reports - Evaluative
Education Level: N/A
Audience: Researchers; Policymakers; Practitioners
Sponsor: National Center for Education Statistics (ED), Washington, DC.
Authoring Institution: Rand Corp., Santa Monica, CA. Inst. on Education and Training.
Identifiers - Assessments and Surveys: National Assessment of Educational Progress