NotesFAQContact Us
Collection
Advanced
Search Tips
ERIC Number: ED511329
Record Type: Non-Journal
Publication Date: 2010-Jul
Pages: 18
Abstractor: As Provided
Reference Count: 12
ISBN: N/A
ISSN: N/A
Do the AZELLA Cut Scores Meet the Standards? A Validation Review of Arizona English Language Learner Assessment
Florez, Ida Rose
Civil Rights Project / Proyecto Derechos Civiles
The Arizona English Language Learners Assessment (AZELLA) is used by the Arizona Department of Education to determine which children should receive English support services. AZELLA results are used to determine if children are either proficient in English or have English language skills in one of four pre-proficient categories (pre-emergent, emergent, basic, intermediate). Children who test at or above the proficient cut score in English are placed in mainstream classes without English language support. Children who obtain scores below the proficient cut scores receive English language support services in state-mandated Structured English Immersion classes. Whenever tests are used to make high-stakes decisions, especially about vulnerable populations (e.g., children), it is the test developers' responsibility to ensure the instrument yields fair and valid results. When cut scores are used as the primary interpretation of the test they are key to establishing the test's validity. This validation study found that cut scores for the AZELLA are of questionable validity. The procedure used to set the cut scores is criticized by national measurement experts as ineffective and obsolete. Further, the test developers do not adequately establish the expertise of the judges used to set the cut scores. Evidence from the cut-score-setting process indicates judges did not come to consensus at the kindergarten level. Analysis of empirical evidence suggests cut scores over-identify kindergarten children and under-identify older children. Finally, the test developers rejected 85% of the cut scores recommended by the standard-setting judges, setting cut scores higher than recommended for kindergarten and lower than recommended for older children, without describing their process or rationale. (Contains 2 tables, 2 figures, and 2 footnotes.)
Civil Rights Project / Proyecto Derechos Civiles. 8370 Math Sciences, P.O. Box 951521, Los Angeles, CA 90095-1521. Tel: 310-267-5562; Fax: 310-206-6293; e-mail: crp@ucla.edu; Web site: http://www.civilrightsproject.ucla.edu
Publication Type: Reports - Evaluative
Education Level: Early Childhood Education; Elementary Secondary Education; Kindergarten
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: University of California, Los Angeles, Civil Rights Project / Proyecto Derechos Civiles
Identifiers - Location: Arizona
Identifiers - Laws, Policies, & Programs: Lau v Nichols; No Child Left Behind Act 2001
Identifiers - Assessments and Surveys: National Assessment of Educational Progress