ERIC Number: EJ834135
Record Type: Journal
Publication Date: 2009
Pages: 31
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0265-5322
EISSN: N/A
An Investigation into Native and Non-Native Teachers' Judgments of Oral English Performance: A Mixed Methods Approach
Kim, Youn-Hee
Language Testing, v26 n2 p187-217 2009
This study used a mixed methods research approach to examine how native English-speaking (NS) and non-native English-speaking (NNS) teachers assess students' oral English performance. The evaluation behaviors of two groups of teachers (12 Canadian NS teachers and 12 Korean NNS teachers) were compared with regard to internal consistency, severity, and evaluation criteria. Results of a Many-faceted Rasch Measurement analysis showed that most of the NS and NNS teachers maintained acceptable levels of internal consistency, with only one or two inconsistent raters in each group. The two groups of teachers also exhibited similar severity patterns across different tasks. However, substantial dissimilarities emerged in the evaluation criteria teachers used to assess students' performance. A qualitative analysis demonstrated that the judgments of the NS teachers were more detailed and elaborate than those of the NNS teachers in the areas of pronunciation, specific grammar use, and the accuracy of transferred information. These findings are used as the basis for a discussion of NS versus NNS teachers as language assessors on the one hand and the usefulness of mixed methods inquiries on the other. (Contains 4 figures, 3 tables and 3 notes.)
Descriptors: Methods Research, Evaluation Criteria, Oral English, English (Second Language), Teaching Methods, Native Speakers, Language Teachers, Comparative Analysis, Student Evaluation, Qualitative Research, Grammar, Pronunciation, Language Usage, Measurement Techniques, Foreign Countries, Korean, Language Tests
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Canada (Montreal)
Grant or Contract Numbers: N/A