ERIC Number: EJ1028843
Record Type: Journal
Publication Date: 2014-Jul
Abstractor: As Provided
Reference Count: 34
Rating Written Performance: What Do Raters Do and Why?
Kuiken, Folkert; Vedder, Ineke
Language Testing, v31 n3 p329-348 Jul 2014
This study investigates the relationship in L2 writing between raters' judgments of communicative adequacy and linguistic complexity by means of six-point Likert scales, and general measures of linguistic performance. The participants were 39 learners of Italian and 32 of Dutch, who wrote two short argumentative essays. The same writing tasks were administered to a control group of 18 native writers of Italian and 17 of Dutch. During a panel discussion raters were asked to verbalize for which reasons they assigned a text to a particular rating level. The results show that although raters' judgements of communicative adequacy largely corresponded to their judgments of linguistic complexity, the findings for L2 and L1 turned out to be different. In L2 overall ratings of linguistic complexity were correlated with lexical diversity and accuracy, but not with syntactic complexity. In L1 hardly any correlations between raters' judgements and general measures of syntactic complexity and lexical diversity were found. Furthermore, raters used different strategies when assessing high- and low-proficiency L2 writers or native writers, and seemed to attach more importance to textual features connected to communicative adequacy than to linguistic complexity and accuracy.
Descriptors: Writing Evaluation, Second Language Learning, Evaluators, Native Language, Indo European Languages, Italian, Correlation, Control Groups, Likert Scales, Difficulty Level, Linguistic Performance, Accuracy, Syntax, Evaluation, Language Proficiency, Scoring, Expertise, Task Analysis, Classification, Communicative Competence (Languages)
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: firstname.lastname@example.org; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A