ERIC Number: EJ931272
Record Type: Journal
Publication Date: 2011-Jun
Abstractor: As Provided
Reference Count: 0
Comparing Two Methods for Reducing Variability in Voice Quality Measurements
Kreiman, Jody; Gerratt, Bruce R.
Journal of Speech, Language, and Hearing Research, v54 n3 p803-812 Jun 2011
Purpose: Interrater disagreements in ratings of quality plague the study of voice. This study compared 2 methods for handling this variability. Method: Listeners provided multiple breathiness ratings for 2 sets of pathological voices, one including 20 male and 20 female voices unselected for quality and one including 20 breathy female voices. Ratings for each listener were averaged together, mean ratings were z transformed, and the likelihood that 2 listeners would agree exactly in their ratings was calculated as a function of averaging and standardizing condition. Data were also multidimensionally scaled to examine similarities among listeners in perceptual strategy. Results were compared with parallel analyses of existing breathiness ratings of the same voices gathered using a method-of-adjustment task. Results: Three-way interactions between the mean rating for a voice, standardization condition, and the number of voices averaged together were observed, but no main effect of averaging condition emerged. Multidimensional scaling revealed significant residual differences in perceptual strategy across listeners after averaging and standardizing. Ratings from the method-of-adjustment task showed both high agreement levels and consistent perceptual strategies across listeners, as theoretically predicted. Conclusion: Averaging multiple ratings and standardizing the mean are inadequate in addressing variations in voice quality perception.
Descriptors: Measurement Techniques, Comparative Analysis, Interrater Reliability, Auditory Perception, Multidimensional Scaling
American Speech-Language-Hearing Association (ASHA). 10801 Rockville Pike, Rockville, MD 20852. Tel: 800-638-8255; Fax: 301-571-0457; e-mail: email@example.com; Web site: http://jslhr.asha.org
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Authoring Institution: N/A