ERIC Number: ED457170
Record Type: Non-Journal
Publication Date: 2001-Jul
Reference Count: N/A
On the Cognitive Interpretation of Performance Assessment Scores. CSE Technical Report 546.
Ayala, Carlos Cuauhtemoc; Shavelson, Richard; Ayala, Mary Ann
This study explored some aspects of reasoning needed to complete science performance assessments, i.e., students' hands-on investigations scored for the scientific justifiability of the findings. The reasoning demands of science performance assessments were studied focusing on three dimensions identified from a previous analysis of data from the National Education Longitudinal Survey of 1988: basic knowledge and reasoning, spatial mechanical reasoning, and quantitative science reasoning. In this pilot study, six subjects (three science teacher experts and three high school physics student novices) were asked to think aloud while they completed one of three science performance assessments. The assessments were chosen because their tasks appeared to elicit differences in reasoning across these three dimensions. Comparisons were then made across the performance assessments and across expertise levels. The talk-alouds provided evidence of the three reasoning dimensions consistent with the nominal analysis of the performance assessment tasks. Experts were more likely to use scientific reasoning in addressing the tasks, while novices verbalized more "doing something" and "monitoring" statements. An appendix contains a chart of performance assessment and reasoning dimensions. (Contains 9 tables, 7 figures, and 19 references.) (Author/SLD)
Descriptors: High School Students, High Schools, Knowledge Level, Performance Based Assessment, Protocol Analysis, Science Teachers, Science Tests, Spatial Ability, Thinking Skills
National Center for Research on Evaluation, CRESST/CSE, Graduate School of Education & Information Studies, University of California, Los Angeles, CA 90095-1522. Tel: 310-206-1532.
Publication Type: Reports - Research
Education Level: N/A
Sponsor: Office of Educational Research and Improvement (ED), Washington, DC.
Authoring Institution: California Univ., Los Angeles. Center for the Study of Evaluation.; National Center for Research on Evaluation, Standards, and Student Testing, Los Angeles, CA.