NotesFAQContact Us
Search Tips
ERIC Number: ED518638
Record Type: Non-Journal
Publication Date: 2004-Sep
Pages: 24
Abstractor: As Provided
Reference Count: 20
States' Procedures for Ensuring Out-of-Level Test Instrument Quality. Out-of-Level Testing Report 14
Minnema, Jane E.; Thurlow, Martha L.; Moen, Ross E.; VanGetson, Gretchen R.
National Center on Educational Outcomes, University of Minnesota
The present study was initiated to gather information about states' out-of-level testing practices. Specifically, we wanted to see whether states attempted to align out-of-level tests with grade of enrollment content standards, what processes are used to complete this task, and what psychometric information states offer as evidence of that alignment. We collected narrative data in this study from two sources: technical information about states' large-scale statewide assessment and information gleaned from interviews with state assessment directors or other individuals knowledgeable about the state's large-scale assessment. We used the technical information gathered prior to the interviews to provide context and support for our interview data analysis process. We then compiled the results thematically. Five critical issues were highlighted in the results: (1) There was an increasing need for states to provide easily accessible technical information that includes out-of-level testing information; (2) States' arguments supporting their decision to not equate out-of-level test scores with onlevel test scores were stronger than arguments supporting this practice; (3) States provided incomplete and inconclusive information about the psychometric properties of out-of-level test scores; (4) States were not consistent in their opinions about the use of out-of-level tests; and (5) States made questionable assumptions about out-of-level testing. Overall, the wide variability of out-of-level testing practices among the states raises many concerns about the practice of out-of-level testing. The interview protocol is appended. (Contains 5 tables.)
National Center on Educational Outcomes. University of Minnesota, 350 Elliott Hall, 75 East River Road, Minneapolis, MN 55455. Tel: 612-626-1530; Fax: 612-624-0879; e-mail:; Web site:
Publication Type: Numerical/Quantitative Data; Reports - Evaluative
Education Level: Elementary Secondary Education
Audience: N/A
Language: English
Sponsor: Office of Special Education Programs (ED/OSERS)
Authoring Institution: National Center on Educational Outcomes; Council of Chief State School Officers; National Association of State Directors of Special Education (NASDSE)
Identifiers - Location: United States