ERIC Number: ED338679
Record Type: RIE
Publication Date: 1987
Reference Count: N/A
State-by-State Comparisons of Student Achievement: The Definition of the Content Domain for Assessment.
Linn, Robert L.
When the National Assessment of Educational Progress (NAEP) was designed 20 years ago, comparisons among individual states or localities were not deemed desirable. Today, this lack of information to allow comparison is judged to be a serious weakness of the NAEP, and ways to allow comparisons are actively sought. The focus of this paper is to review issues concerning the definition of the domain of content to be covered in the NAEP and the relationship of the definition and score reporting systems to the validity of inferences that are based on state-by-state comparisons. This validity is the most fundamental issue in development of the NAEP. Essential issues in the content domain include: (1) breadth of coverage and the match with what is taught and tested; and (2) the number and specificity of scores. Ideally, the domain for assessment would include separate measures of the full range of outcomes that are considered important by any of the states. Despite the desirability of having multiple scores for purposes of identifying strengths and weaknesses, global scores will still need to be produced, because multiple scores would be too overwhelming and because there is a desire for a score card. It is argued that the ability to disaggregate results to specific content areas should be retained. A 37-item list of references is included. (SLD)
Descriptors: Academic Achievement, Comparative Analysis, Content Validity, Educational Assessment, Elementary Secondary Education, Evaluation Criteria, Evaluation Utilization, National Programs, School Districts, Scores, State Norms, State Surveys, Student Evaluation, Test Construction, Test Validity
Publication Type: Reports - Evaluative
Education Level: N/A
Sponsor: Office of Educational Research and Improvement (ED), Washington, DC.
Authoring Institution: Center for Research on Evaluation, Standards, and Student Testing, Los Angeles, CA.
Identifiers: National Assessment of Educational Progress