ERIC Number: EJ762133
Record Type: Journal
Publication Date: 2007
Reference Count: 19
Building Validity Evidence for Scores on a State-Wide Alternate Assessment: A Contrasting Groups, Multimethod Approach
Elliott, Stephen N.; Compton, Elizabeth; Roach, Andrew T.
Educational Measurement: Issues and Practice, v26 n2 p30-43 Sum 2007
The relationships between ratings on the Idaho Alternate Assessment (IAA) for 116 students with significant disabilities and corresponding ratings for the same students on two norm-referenced teacher rating scales were examined to gain evidence about the validity of resulting IAA scores. To contextualize these findings, another group of 54 students who had disabilities, but were not officially eligible for the alternate assessment also was assessed. Evidence to support the validity of the inferences about IAA scores was mixed, yet promising. Specifically, the relationship among the reading, language arts, and mathematics achievement level ratings on the IAA and the concurrent scores on the ACES-Academic Skills scales for the eligible students varied across grade clusters, but in general were moderate. These findings provided evidence that IAA scales measure skills indicative of the state's content standards. This point was further reinforced by moderate to high correlations between the IAA and Idaho State Achievement Test (ISAT) for the not eligible students. Additional evidence concerning the valid use of the IAA was provided by logistic regression results that the scores do an excellent job of differentiating students who were eligible from those not eligible to participate in an alternate assessment. The collective evidence for the validity of the IAA scores suggests it is a promising assessment for NCLB accountability of students with significant disabilities. The methods of establishing this evidence have the potential to advance validation efforts of other states' alternate assessments.
Descriptors: Inferences, Disabilities, Rating Scales, Eligibility, Alternative Assessment, Achievement Tests, Student Evaluation, Test Validity, Scores, Correlation, Educational Testing, Measures (Individuals), Federal Legislation, Special Needs Students, Testing Accommodations, Elementary Secondary Education, State Programs
Blackwell Publishing. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8599; Fax: 781-388-8232; e-mail: firstname.lastname@example.org; Web site: http://www.blackwellpublishing.com/jnl_default.asp
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Elementary Secondary Education
Authoring Institution: N/A
Identifiers - Location: Idaho
Identifiers - Laws, Policies, & Programs: No Child Left Behind Act 2001