NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1022216
Record Type: Journal
Publication Date: 2013
Pages: 21
Abstractor: As Provided
ISSN: ISSN-0895-7347
Comparing Panelists' Understanding of Standard Setting across Multiple Levels of an Alternate Science Assessment
Hansen, Mary A.; Lyon, Steven R.; Heh, Peter; Zigmond, Naomi
Applied Measurement in Education, v26 n4 p298-318 2013
Large-scale assessment programs, including alternate assessments based on alternate achievement standards (AA-AAS), must provide evidence of technical quality and validity. This study provides information about the technical quality of one AA-AAS by evaluating the standard setting for the science component. The assessment was designed to have three levels of cognitive difficulty, where each student is administered only the most appropriate level. The current study investigated panelists' levels of understanding during standard setting to explore whether there were differences based on cognitive level of the test. Data were collected at various time points through the use of open- and closed-ended questionnaires. Panelists reported that they understood the Performance Level Descriptor development and standard setting tasks and had common concerns and levels of understandings across levels of the AA-AAS.
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A