NotesFAQContact Us
Search Tips
ERIC Number: ED560544
Record Type: Non-Journal
Publication Date: 2015-Jun
Pages: 8
Abstractor: As Provided
Reference Count: 41
A Comparison of Video-Based and Interaction-Based Affect Detectors in Physics Playground
Kai, Shiming; Paquette, Luc; Baker, Ryan S.; Bosch, Nigel; D'Mello, Sidney; Ocumpaugh, Jaclyn; Shute, Valerie; Ventura, Matthew
International Educational Data Mining Society, Paper presented at the International Conference on Educational Data Mining (EDM) (8th, Madrid, Spain, Jun 26-29, 2015)
Increased attention to the relationships between affect and learning has led to the development of machine-learned models that are able to identify students' affective states in computerized learning environments. Data for these affect detectors have been collected from multiple modalities including physical sensors, dialogue logs, and logs of students' interactions with the learning environment. While researchers have successfully developed detectors based on each of these sources, little work has been done to compare the performance of these detectors. In this paper, we address this issue by comparing interaction-based and video-based affect detectors for a physics game called Physics Playground. Specifically, we report on the development and detection accuracy of two suites of affect and behavioral detectors. The first suite of detectors applies facial expression recognition to video data collected with webcams, while the second focuses on students' interactions with the game as recorded in log-files. Ground-truth affect and behavior annotations for both face- and interaction-based detectors were obtained via live field observations during game-play. We first compare the performance of these detectors in predicting students' affective states and off-task behaviors, and then proceed to outline the strengths and weakness of each approach. [For complete proceedings, see ED560503.]
International Educational Data Mining Society. e-mail:; Web site:
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: Grade 8; Junior High Schools; Middle Schools; Elementary Education; Secondary Education; Grade 9; High Schools
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF); Bill and Melinda Gates Foundation
Authoring Institution: International Educational Data Mining Society
IES Grant or Contract Numbers: DRL 1235958