NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ931272
Record Type: Journal
Publication Date: 2011-Jun
Pages: 10
Abstractor: As Provided
Reference Count: 0
ISSN: ISSN-1092-4388
Comparing Two Methods for Reducing Variability in Voice Quality Measurements
Kreiman, Jody; Gerratt, Bruce R.
Journal of Speech, Language, and Hearing Research, v54 n3 p803-812 Jun 2011
Purpose: Interrater disagreements in ratings of quality plague the study of voice. This study compared 2 methods for handling this variability. Method: Listeners provided multiple breathiness ratings for 2 sets of pathological voices, one including 20 male and 20 female voices unselected for quality and one including 20 breathy female voices. Ratings for each listener were averaged together, mean ratings were z transformed, and the likelihood that 2 listeners would agree exactly in their ratings was calculated as a function of averaging and standardizing condition. Data were also multidimensionally scaled to examine similarities among listeners in perceptual strategy. Results were compared with parallel analyses of existing breathiness ratings of the same voices gathered using a method-of-adjustment task. Results: Three-way interactions between the mean rating for a voice, standardization condition, and the number of voices averaged together were observed, but no main effect of averaging condition emerged. Multidimensional scaling revealed significant residual differences in perceptual strategy across listeners after averaging and standardizing. Ratings from the method-of-adjustment task showed both high agreement levels and consistent perceptual strategies across listeners, as theoretically predicted. Conclusion: Averaging multiple ratings and standardizing the mean are inadequate in addressing variations in voice quality perception.
American Speech-Language-Hearing Association (ASHA). 10801 Rockville Pike, Rockville, MD 20852. Tel: 800-638-8255; Fax: 301-571-0457; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A