ERIC Number: EJ1092685
Record Type: Journal
Publication Date: 2016-Feb
Abstractor: As Provided
Reference Count: N/A
An Optimal Set of Flesh Points on Tongue and Lips for Speech-Movement Classification
Wang, Jun; Samal, Ashok; Rong, Panying; Green, Jordan R.
Journal of Speech, Language, and Hearing Research, v59 n1 p15-26 Feb 2016
Purpose: The authors sought to determine an optimal set of flesh points on the tongue and lips for classifying speech movements. Method: The authors used electromagnetic articulographs (Carstens AG500 and NDI Wave) to record tongue and lip movements from 13 healthy talkers who articulated 8 vowels, 11 consonants, a phonetically balanced set of words, and a set of short phrases during the recording. We used a machine-learning classifier (support-vector machine) to classify the speech stimuli on the basis of articulatory movements. We then compared classification accuracies of the flesh-point combinations to determine an optimal set of sensors. Results: When data from the 4 sensors (T1: the vicinity between the tongue tip and tongue blade; T4: the tongue-body back; UL: the upper lip; and LL: the lower lip) were combined, phoneme and word classifications were most accurate and were comparable with the full set (including T2: the tongue-body front; and T3: the tongue-body front). Conclusion: We identified a 4-sensor set-that is, T1, T4, UL, LL--that yielded a classification accuracy (91%-95%) equivalent to that using all 6 sensors. These findings provide an empirical basis for selecting sensors and their locations for scientific and emerging clinical applications that incorporate articulatory movements.
Descriptors: Speech Communication, Human Body, Measurement Equipment, Articulation (Speech), Phonemes, Classification
American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: email@example.com; Web site: http://jslhr.pubs.asha.org
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Sponsor: National Institutes of Health (DHHS)
Authoring Institution: N/A
Grant or Contract Numbers: R01DC009890|R01DC013547|R03 DC013990