ERIC Number: EJ1040211
Record Type: Journal
Publication Date: 2014
Abstractor: As Provided
Reference Count: N/A
Assessment as Evidential Reasoning
Gorin, Joanna S.
Teachers College Record, v116 n11 2014
Background/Context: Principles of evidential reasoning have often been discussed in the context of educational and psychological measurement with respect to construct validity and validity arguments. More recently, Mislevy proposed the metaphor of assessment as an evidentiary argument about students' learning and abilities given their behavior in particular circumstances. An assessment argument consists of a claim one wants to make, typically about student learning, and evidence that supports that claim. From this perspective, the quality of our assessments are a function of both whether we have built our arguments about the right types of claims and whether we have collected sufficient persuasive evidence to support our claims. Purpose: This paper examines limitations of the dominant practice in educational assessment of the 20th century, which focuses on relatively simple claims and often rely on a single piece of evidence. This paper considers future educational assessment in terms of principles of evidential reasoning, focusing the discussion on the changes to the claims our assessments must support, the types of evidence needed to support these claims, and the statistical tools available to evaluate our evidence vis-à-vis the claims. An expanded view of assessment is advanced in which assessments based on multiple evidence sources from contextually rich situated learning environments, including unconventional data regarding human competencies, improve our ability to make valid inferences and decisions about all education stakeholders. Conclusions: For educational assessment to have the positive impact we intend on educational outcomes, future assessments must leverage technological and computational developments, as well as more contemporary models of human cognition, to build robust complex evidential arguments about the critical competencies that are likely to determine individuals' success in 21st century society.
Descriptors: Educational Assessment, Educational Practices, Barriers, Evidence, Hypothesis Testing, Educational Principles, Research Methodology, Statistical Data, Research Tools, Evaluation Methods, Research Needs, Research Design, Student Evaluation, Academic Achievement, Achievement Rating, Outcome Measures, Robustness (Statistics)
Teachers College, Columbia University. P.O. Box 103, 525 West 120th Street, New York, NY 10027. Tel: 212-678-3774; Fax: 212-678-6619; e-mail: email@example.com; Web site: http://www.tcrecord.org
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Authoring Institution: N/A