NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1180537
Record Type: Journal
Publication Date: 2014-Sep
Pages: 10
Abstractor: As Provided
ISSN: ISSN-0119-5646
Criteria and Bias in Native English Teachers' Assessment of L2 Pragmatic Appropriacy: Content and FACETS Analyses
Tajeddin, Zia; Alemi, Minoo
Asia-Pacific Education Researcher, v23 n3 p425-434 Sep 2014
Although there are studies on the pragmatic assessment, to date no research has been done on native English raters' criteria for the assessment of EFL learners' pragmatic competence. Focusing on this topic, this study pursued two purposes. The first one was to find the criteria for rating the speech act of apology in L2 by native English teachers. The second was to investigate whether there was rater bias in native English teachers' rating of apology. To this end, 51 native English teachers rated six different pragmatic situations for an apology discourse completion task (DCT) which were accompanied by an L2 learner's response to each situation. Besides rating, the raters were asked to describe the way they rated the response to each DCT situation. The content analysis of raters' descriptions revealed five criteria they mostly applied in their rating: expression of apology, situation explanation, repair offer, promise for future, and politeness. FACETS was used to find the rater bias. Results indicated that raters showed different degrees of severity and leniency in their ratings, which contradicts the myth of native speakers being a benchmark in language assessment, including pragmatic assessment.
Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A