ERIC Number: ED491544
Record Type: Non-Journal
Publication Date: 2006-Apr-9
Reference Count: 15
Using Test Content to Address Trend Discrepancies between NAEP and California State Tests
Wei, Xin; Shen, Xuejun; Lukoff, Brian; Ho, Andrew Dean; Haertel, Edward H.
Online Submission, Paper presented at the Annual Meeting of the American Educational Research Association (San Francisco, CA, Apr 2006)
In 1998 and again in 2002, samples of eighth grade students in California were tested in reading as part of the state-level component of the National Assessment of Educational Progress (NAEP). In each of these years, all eighth graders in the state were also required to participate in the state's accountability testing, which included the reading test in the Stanford Achievement Tests, Ninth Edition (SAT 9). State-level comparisons of performance on these two assessments showed improvement in the SAT 9, but a slight decline on NAEP (not statistically significant). To examine whether this trend discrepancy might be attributable to content differences between the two tests, SAT 9 reading items were coded into categories corresponding to the NAEP content strands plus a category for items not aligned to the NAEP framework. Analyses of performance within strands indicate that content differences probably cannot explain the discrepant trends on the state accountability test versus NAEP, although differences related to item format are a strong possibility. Implications and alternative explanations are discussed. (Contains 7 endnotes, 6 tables, and 10 figures.)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: Grade 8
Sponsor: National Center for Research on Evaluation, Standards, and Student Testing, Los Angeles, CA.
Authoring Institution: N/A
Identifiers - Location: California
Identifiers - Assessments and Surveys: Stanford Achievement Tests