ERIC Number: ED483399
Record Type: Non-Journal
Publication Date: 2004-May
A Brief Introduction to Evidence-Centered Design. CSE Report 632
Mislevy, Robert J.; Almond, Russell G.; Lukas, Janice F.
US Department of Education
Evidence-centered assessment design (ECD) is an approach to constructing educational assessments in terms of evidentiary arguments. This paper provides an introduction to the basic ideas of ECD, including some of the terminology and models that have been developed to implement the approach. In particular, it presents the high-level models of the Conceptual Assessment Framework and the Four-Process Architecture for assessment delivery systems. Special attention is given to the roles of probability-based reasoning in accumulating evidence across task performances, in terms of belief about unobservable variables that characterize the knowledge, skills, and/or abilities of students. This is the role traditionally associated with psychometric models, such as those of item response theory and latent class models. To unify the ideas and to provide a foundation for extending probability-based reasoning in assessment applications more broadly, however, a more general expression in terms of graphical models is indicated. This brief overview of ECD provides the reader with a feel for where and how graphical models fit into the larger enterprise of educational and psychological assessment. A simple example based on familiar large-scale standardized tests such as the GRE is used to fix ideas. The document contains two appendices: (1) further reading about the ECD Project; and (2) a glossary of evidence-centered design terms.
Descriptors: Student Evaluation, Evaluation Methods, Concept Formation, Thinking Skills, Test Construction, Task Analysis, Psychometrics, Data Analysis, Psychological Evaluation, Standardized Tests
Center for the Study of Evaluation (CSE), National Center for Research on Evaluation, Standards, and Student Testing (CRESST), Graduate School of Education & Information Studies, University of California, Los Angeles, Los Angeles, CA 90095-1522. Tel: 310-206-1532.
Publication Type: Reports - Research
Education Level: N/A
Sponsor: Institute of Education Sciences (IES), Washington, DC.
Authoring Institution: Center for Research on Evaluation, Standards, and Student Testing, Los Angeles, CA.