ERIC Number: EJ1022771
Record Type: Journal
Publication Date: 2014-May
Abstractor: As Provided
Reference Count: N/A
Assessment of Uncertainty-Infused Scientific Argumentation
Lee, Hee-Sun; Liu, Ou Lydia; Pallant, Amy; Roohr, Katrina Crotts; Pryputniewicz, Sarah; Buck, Zoë E.
Journal of Research in Science Teaching, v51 n5 p581-605 May 2014
Though addressing sources of uncertainty is an important part of doing science, it has largely been neglected in assessing students' scientific argumentation. In this study, we initially defined a scientific argumentation construct in four structural elements consisting of claim, justification, uncertainty qualifier, and uncertainty rationale. We consulted literature to characterize and score different levels of student performances on each of these four argumentation elements. We designed a test comprised of nine scientific argumentation tasks addressing climate change, the search for life in space, and fresh water availability and administered it to 473 students from 9 high schools in the United States. After testing the local dependence and unidimensionality assumptions, we found that the uncertainty qualifier element was not aligned with the other three. After removing items related to uncertainty qualifier, we applied a Rasch analysis based on a Partial Credit Model. Results indicate that (1) claim, justification, and uncertainty rationale items form a unidimensional scale, (2) justification and uncertainty rationale items contribute the most on the unidimensional scientific argumentation scale as they cover much wider ranges of the scale than claim items, (3) average item difficulties increase in the order of claim, justification, and uncertainty rationale, (4) students' elaboration of uncertainty exhibits dual characteristics: self-assessment of their own knowledge and ability versus scientific assessment of conceptual and empirical errors embedded in investigations, and (5) students who can make warrants between theory and evidence are more likely to think about uncertainty from scientific sources than those who cannot. We identified limitations of this study in terms of science topic coverage and sample selection and made suggestions on how these limitations might have affected results and interpretations.
Descriptors: Persuasive Discourse, Student Evaluation, High School Students, Science Tests, Item Response Theory, Statistical Analysis, Test Items, Difficulty Level, Scaling, Test Construction, Secondary School Science, Self Evaluation (Individuals)
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: email@example.com; Web site: http://www.wiley.com/WileyCDA
Publication Type: Journal Articles; Reports - Evaluative
Education Level: High Schools; Secondary Education
Authoring Institution: N/A