ERIC Number: EJ1248034
Record Type: Journal
Publication Date: 2020
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1939-1382
EISSN: N/A
Automatic Deictic Gestures for Animated Pedagogical Agents
IEEE Transactions on Learning Technologies, v13 n1 p1-13 Jan-Mar 2020
We present a system that automatically generates deictic gestures for animated pedagogical agents (APAs). The system takes audio and text as input, which define what the APA has to say, and generates animated gestures based on a set of rules. The automatically generated gestures point to the exact locations of elements on a whiteboard nearby the APA, which are calculated by searching for keywords mentioned in the speech. We conducted a study with 100 subjects, in which we compared lecture videos containing gestures automatically-scripted by the system to videos of the same lecture containing manually-scripted gestures. The study results show that the manually-scripted and automatically-scripted lectures had comparable number of gestures, and that the gestures were timed equally well.
Descriptors: Animation, Nonverbal Communication, Lecture Method, Video Technology, Computer Assisted Instruction, Electronic Learning, Visual Aids, Automation, Educational Psychology, College Students, College Faculty, Information Retrieval, Artificial Intelligence, Natural Language Processing
Institute of Electrical and Electronics Engineers, Inc. 445 Hoes Lane, Piscataway, NJ 08854. Tel: 732-981-0060; Web site: http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=4620076
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); National Science Foundation (NSF)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305A130016; 1217215