NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1115384
Record Type: Journal
Publication Date: 2012
Pages: 41
Abstractor: As Provided
ISSN: EISSN-2157-2100
Using the ECD Framework to Support Evidentiary Reasoning in the Context of a Simulation Study for Detecting Learner Differences in Epistemic Games
Sweet, Shauna J.; Rupp, Andre A.
Journal of Educational Data Mining, v4 n1 p183-223 2012
The "evidence-centered design" (ECD) framework is a powerful tool that supports careful and critical thinking about the identification and accumulation of evidence in assessment contexts. In this paper, we demonstrate how the ECD framework provides critical support for designing simulation studies to investigate statistical methods within an ill-defined methodological domain like games-based assessment. We discuss the design and selected findings of a complex simulation study to investigate the utility of statistics derived from a non -parametric method called "epistemic network analysis"; this method is used in practice for the analysis of real data from a suite of digital learning environments called "epistemic games." We present findings that show that one marginal ENA statistic, the "weighted density" statistic from social network analysis, has some ability to detect differences among a variety of simulated learners when they play different types of simulated games. Detection strength ranged from weak to strong, depending jointly on game design characteristics and the types of learners being compared. Our work illustrates the complex challenges of how best to describe, justify, and evaluate design decisions for simulation studies in the context of games-based assessment.
International Educational Data Mining. e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF)
Authoring Institution: N/A
Identifiers - Location: Maryland
Grant or Contract Numbers: DRL0918409; DRL0946372