ERIC Number: EJ1085344
Record Type: Journal
Publication Date: 2015
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1345-8353
EISSN: N/A
Assessment Behavior and Perceptions of Raters in Paired and Group Oral Interaction
Negishi, Junko
Journal of Pan-Pacific Association of Applied Linguistics, v19 n1 p195-213 2015
The study considers the assessment of L2 English learners by trained raters in paired and group oral assessments in comparison to an individual, monologue assessment, to determine 1) the degree to which raters assign pairs/groups shared (the same) scores and the degree to which raters give individual members of pairs/groups higher or lower as opposed to matching individual scores, 2) assessment tendencies by participants' English proficiency and paring/grouping conditions, 3) individual variation among raters, and 4) the types of comments (positive, negative, or mixed) raters give participants in pair/group conditions. It was found that 1) on the whole, pair/group scores tend to be shared and lower than individual scores, 2) raters tended to assign bother higher- and lower-level speakers lower scores when they are in interaction with lower-level speakers, but to assign middle-level speakers better scores in such a condition, 3) raters exhibited significant inter-rater variability, and 4) raters tended to give more negative comments when assigning lower scores and more positive comments on higher scores.
Descriptors: Evaluators, English (Second Language), Second Language Learning, Scores, Groups, Interrater Reliability, Oral Language, Language Tests, Language Proficiency, Student Evaluation, Scoring, Attitudes, Foreign Countries
Pan-Pacific Association of Applied Linguistics. Department of English, Namseoul University, 21 Maeju-ri, Seonghwan-eup, Cheonan-city, Choongnam, Korea 330-707. Tel: +82-2-3290-1995; e-mail: paalkorea@yahoo.co.kr; Web site: http://paal.kr/journals/journals.html
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Japan (Tokyo)
Identifiers - Assessments and Surveys: Test of English as a Foreign Language; Test of English for International Communication
Grant or Contract Numbers: N/A