NotesFAQContact Us
Search Tips
ERIC Number: ED464917
Record Type: Non-Journal
Publication Date: 2002-Apr
Pages: 81
Abstractor: N/A
Reference Count: N/A
Describing NAEP Achievement Levels with Multiple Domain Scores.
Schulz, E. Matthew; Lee, Won-Chan
This study was conducted to demonstrate the potential for using multiple domains to describe achievement levels in the National Assessment of Educational Progress (NAEP) mathematics test. Mathematics items from the NAEP grade 8 assessment for the year 2000 were used. Curriculum experts provided ratings of when the skills required to answer the items correctly were introduced and when they were mastered in a standard mathematics curriculum. The ratings were used to define two or three domains within each content strand in the test framework (number sense, measurement, geometry, data analysis, and algebra). Characteristic curves based on these domains tended to be well spaced and noncrossing as a function of the NAEP mathematics scale score. Results support Guttman-style interpretations of what students at a given level of achievement can or cannot be expected to do in terms of scoring higher or lower than a percentage correct criterion score that may be chosen to define mastery of a domain. On the basis of these results, it is concluded that achievement-level descriptions based on multiple domain scores would be useful in NAEP and similar broad-based assessments. Four appendixes contain a discussion of the computation of domain characteristic curves, instructions and forms for rating instructional timing, descriptions of the domains, and number sense test item examples. (Contains 11 tables, 14 figures, and 32 references.) (SLD)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: National Assessment of Educational Progress