NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: ED497524
Record Type: Non-Journal
Publication Date: 2007-Jul
Pages: 93
Abstractor: ERIC
Reference Count: 22
ISBN: N/A
ISSN: N/A
Aligning Science Assessment Standards: Louisiana and the 2009 National Assessment of Educational Progress (NAEP). Issues & Answers. REL 2007-No. 020
Timms, Michael; Schneider, Steven; Lee, Cindy; Rolfhus, Eric
Regional Educational Laboratory Southwest (NJ1)
This policy research document is intended for Louisiana policymakers to use when examining possible changes to the state assessment's alignment with the National Assessment of Educational Progress (NAEP). The 2009 NAEP test is not yet in existence, so the purpose of this report is to give policymakers a head start in determining where they might, if they so decide, begin to make changes in their assessment standards and specifications to develop an assessment system more closely aligned to that used for the NAEP. Reviewers observed that NAEP standards are based on descriptions of phenomena, whereas Louisiana's standards are based on explanations of what a student does to explore the phenomena. They also found that NAEP standards tend to be widely inclusive (including, for example, heat and electrical conductivity in the same standard) whereas most states tend to see such topics as part of two separate standards or benchmarks. Reviewers found Louisiana's science standards to be rigorous and found consistent spiraling through the grade levels. However, they also noted that teachers might more easily discern nuances in the standards if the grade level expectations, as well as the "key concepts" within the assessment guides, were integrated with the benchmarks. In comparing Louisiana benchmarks and grade level expectations with the NAEP, the overall alignment ratings for elementary, middle, and high school are generally high. The overall alignment rating for Louisiana science content and NAEP grade 4 is 2.6. (A rating of 1 indicates no alignment and a rating of 3, full alignment.) For grade 8, the alignment rating is 2.1. For grade 12, the rating is 2.5. Louisiana middle school content is partially aligned with the NAEP grade 8, while grade 4 and high school are most often fully aligned. The instances of partial alignment at all grade levels are due primarily to the fact that Louisiana's standards often imply NAEP content and the NAEP is often more detailed in its presentation of content. In addition, Louisiana contains many benchmarks that are unaddressed by the NAEP content statements. Generally, the combination of Louisiana's benchmarks and grade level expectations at all grade levels aligns very well with the NAEP content statements, because the grade level expectations often parallel NAEP statements in their level of detail. This report reveals current alignment issues between the state's tests and the future NAEP tests and may be important to policymakers considering revising science standards and assessments in line with No Child Left Behind requirements for state science tests in elementary, middle, and high schools. If state policymakers wish to increase the alignment between the state assessments and the NAEP, an area to consider is developing the comprehensive science task into a hands-on performance task. Revising assessments requires considerable time and resources, so policymakers must consider their capacity to make changes and the degree to which such changes will benefit students. The Louisiana assessment guides, which define the specifications for the state tests, ensure that testing of student knowledge and skills does not rely solely on multiple-choice items by including short constructed-response items and a comprehensive science task at each grade level. That enables a wider range of knowledge types to be tested than can be tested with multiple-choice alone. Louisiana records its proportions differently than the NAEP, so it is difficult to directly compare the relative amounts of testing time devoted to different topics. However, when focusing just on the three topic areas tested by the NAEP, the proportions of NAEP testing times are the same as the proportions of points in the Louisiana test at grade 4 and in high school, and they are similar at grade 8, where Louisiana's points are allocated equally across subjects while NAEP students are tested slightly more on Earth and space science. Overall, there is amatch between the test specifications in Louisiana's assessment guides and the NAEP science assessment and item specifications. Standards and test specifications represent the starting point for the development of tests and test items. In the ideal alignment study state science assessments would be compared with NAEP assessments directly at the item level. At some future date the NAEP 2009 assessment items may be available for such a study. The following are appended: (1) The documents compared; (2) How the study was conducted; (3) Content alignment for grade 4; (4) Content alignment for grade 8; and (5) Content alignment for grade 12. (Contains 1 box, 4 figures, and 17 tables.) [This report was prepared for the National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education by Regional Educational Laboratory Southwest, formerly known as Southwest Regional Educational Laboratory (SEDL), administered by Edvance Research, Inc.]
Regional Educational Laboratory Southwest. Available from: Edvance Research. 9901 IH-10 West Suite 700, San Antonio, TX 78230. Tel: 877-338-2623; Fax: 210-558-4183; e-mail: tassistance@edvanceresearch.com; Web site: http://edlabs.ed.gov/RELSouthwest
Publication Type: Reports - Research
Education Level: Elementary Education; Elementary Secondary Education; High Schools; Secondary Education
Audience: Policymakers
Language: English
Sponsor: N/A
Authoring Institution: Institute of Education Sciences (ED), Washington, DC.
Identifiers - Location: Louisiana
Identifiers - Laws, Policies, & Programs: No Child Left Behind Act 2001
IES Funded: Yes