ERIC Number: ED359268
Record Type: RIE
Publication Date: 1993-Jun
Reference Count: N/A
Educational Achievement Standards: NAGB's Approach Yields Misleading Interpretations. Report to Congressional Requesters.
General Accounting Office, Washington, DC. Program Evaluation and Methodology Div.
In September 1991, the National Assessment Governing Board (NAGB) announced standards for basic, proficient, and advanced achievement in mathematics and reported that few American students had reached these standards. Expert reviewers noted technical problems with the NAGB approach and questioned its results. In this report, the NAGB standard-setting approach and ability to provide policy guidance to the National Assessment of Education Progress (NAEP) are examined. The NAEP test-score standards set in 1990 were evaluated by examining the adequacy of item-judgment procedures and by studying whether the evidence supported NAGB's interpretation of the NAEP scores selected for each level. The investigation found that the standard-setting approach was procedurally flawed, and that the interpretations of the resulting NAEP scores were of doubtful validity. The NAGB improved its procedures substantially in 1992, but the issue of the validity of interpretation remains. The report concludes that the NAGB approach is unsuited for the NAEP. Alternative approaches are reviewed, but it is apparent that their use will be difficult as the NAEP is currently designed. Specific recommendations are given to help implement these alternative approaches. Six tables and three figures illustrate the discussion. Appendixes include comments from the U.S. Department of Education and from the NAGB, a summary description of the NAEP and other supplementary materials. A four-part bibliography is provided. Contains 44 references. (SLD)
Descriptors: Academic Achievement, Academic Standards, Educational Policy, Elementary Secondary Education, Evaluation Methods, Evaluators, Mathematics Achievement, Measurement Techniques, National Surveys, Research Problems, Scores, Standard Setting (Scoring), Student Evaluation, Test Interpretation, Test Results, Test Validity
U.S. General Accounting Office, P.O. Box 6015, Gaithersburg, MD 20884-6015 (first copy free; $2 for additional copies; orders for 100 or more to one address are discounted 25 percent).
Publication Type: Reports - Evaluative
Education Level: N/A
Authoring Institution: General Accounting Office, Washington, DC. Program Evaluation and Methodology Div.
Identifiers: General Accounting Office; National Assessment Governing Board; National Assessment of Educational Progress