NotesFAQContact Us
Search Tips
ERIC Number: ED560878
Record Type: Non-Journal
Publication Date: 2015-Jun
Pages: 4
Abstractor: As Provided
Reference Count: 14
Video-Based Affect Detection in Noninteractive Learning Environments
Chen, Yuxuan; Bosch, Nigel; D'Mello, Sidney
International Educational Data Mining Society, Paper presented at the International Conference on Educational Data Mining (EDM) (8th, Madrid, Spain, Jun 26-29, 2015)
The current paper explores possible solutions to the problem of detecting affective states from facial expressions during text/diagram comprehension, a context devoid of interactive events that can be used to infer affect. These data present an interesting challenge for face-based affect detection because likely locations of affective facial expressions within videos of students' faces are entirely unknown. In the current study, students engaged in a text/diagram comprehension activity after which they self-reported their levels of confusion, frustration, and engagement. Data were chosen from various locations within the videos, and texture-based facial features were extracted to build affect detectors. Varying amounts of data were used as well to determine an appropriate window of data to analyze for each affect detector. Detector performance was measured using Area Under the ROC Curve (AUC), where chance level is 0.5 and perfect classification is 1. Confusion (AUC = 0.637), engagement (AUC = 0.554), and frustration (AUC = 0.609) were detected at above-chance levels. Prospects for improving the method of finding likely positions of affective states are also discussed. [For complete proceedings, see ED560503.]
International Educational Data Mining Society. e-mail:; Web site:
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF); Bill and Melinda Gates Foundation
Authoring Institution: International Educational Data Mining Society
IES Grant or Contract Numbers: DRL1235958