NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1163898
Record Type: Journal
Publication Date: 2018-Jan
Pages: 20
Abstractor: As Provided
ISSN: ISSN-0265-5322
Monitoring the Performance of Human and Automated Scores for Spoken Responses
Wang, Zhen; Zechner, Klaus; Sun, Yu
Language Testing, v35 n1 p101-120 Jan 2018
As automated scoring systems for spoken responses are increasingly used in language assessments, testing organizations need to analyze their performance, as compared to human raters, across several dimensions, for example, on individual items or based on subgroups of test takers. In addition, there is a need in testing organizations to establish rigorous procedures for monitoring the performance of both human and automated scoring processes during operational administrations. This paper provides an overview of the automated speech scoring system SpeechRater[superscript SM] and how to use charts and evaluation statistics to monitor and evaluate automated scores and human rater scores of spoken constructed responses.
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A