ERIC Number: EJ1087149
Record Type: Journal
Publication Date: 2016
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1916-4742
EISSN: N/A
How Do Raters Judge Spoken Vocabulary?
Li, Hui
English Language Teaching, v9 n2 p102-115 2016
The aim of the study was to investigate how raters come to their decisions when judging spoken vocabulary. Segmental rating was introduced to quantify raters' decision-making process. It is hoped that this simulated study brings fresh insight to future methodological considerations with spoken data. Twenty trainee raters assessed five Chinese students' monologic texts on vocabulary in this study. Both segmental rating and overall rating were retrieved from the raters. Rasch analysis suggested variation between raters in their judgment of vocabulary, although consistency was found in general. Besides, there was a mismatch between candidates' vocabulary scores and their lexical statistics. The raters' decision-making process was generally cumulative.
Descriptors: Foreign Countries, Evaluators, Interrater Reliability, Decision Making, Oral Language, Vocabulary, Language Proficiency, Language Tests, Simulation, Trainees, Item Response Theory, Chinese, Foreign Students, College Students, Scores, Research Design, Data Analysis, Correlation, Statistical Analysis
Canadian Center of Science and Education. 1120 Finch Avenue West Suite 701-309, Toronto, OH M3J 3H7, Canada. Tel: 416-642-2606; Fax: 416-642-2608; e-mail: elt@ccsenet.org; Web site: http://www.ccsenet.org/journal/index.php/elt
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom
Grant or Contract Numbers: N/A