NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1248034
Record Type: Journal
Publication Date: 2020
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1939-1382
EISSN: N/A
Automatic Deictic Gestures for Animated Pedagogical Agents
Kappagantula, Sri Rama Kartheek; Adamo-Villani, Nicoletta; Wu, Meng-Lin; Popescu, Voicu
IEEE Transactions on Learning Technologies, v13 n1 p1-13 Jan-Mar 2020
We present a system that automatically generates deictic gestures for animated pedagogical agents (APAs). The system takes audio and text as input, which define what the APA has to say, and generates animated gestures based on a set of rules. The automatically generated gestures point to the exact locations of elements on a whiteboard nearby the APA, which are calculated by searching for keywords mentioned in the speech. We conducted a study with 100 subjects, in which we compared lecture videos containing gestures automatically-scripted by the system to videos of the same lecture containing manually-scripted gestures. The study results show that the manually-scripted and automatically-scripted lectures had comparable number of gestures, and that the gestures were timed equally well.
Institute of Electrical and Electronics Engineers, Inc. 445 Hoes Lane, Piscataway, NJ 08854. Tel: 732-981-0060; Web site: http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=4620076
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); National Science Foundation (NSF)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305A130016; 1217215