ERIC Number: EJ857754
Record Type: Journal
Publication Date: 2009
Pages: 25
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0265-5322
EISSN: N/A
Score Generalizability of Academic Writing Tasks: Does One Test Method Fit It All?
Gebril, Atta
Language Testing, v26 n4 p507-531 2009
Generalizability of writing scores has always been a longstanding concern in L2 writing assessment. A number of studies have been conducted to investigate this topic during the last two decades. However, with the introduction of new test methods, such as reading-to-write tasks, generalizability studies need to focus on the score accuracy of different task types. The current study attempts to examine how reading-to-write tasks are comparable to independent tasks in terms of score generalizability. To look into this issue, 115 Egyptian university students were asked to write on two independent tasks and two reading-to-write tasks. The essays were holistically scored by three raters, who received training prior to scoring. The study design followed a fully crossed univariate design (p x t x r), and consequently GENOVA (Crock & Brennan, 1983) was used to analyze the results. Results showed that the reading-to-write tasks yielded as reliable scores as independent tasks. In addition, the result indicated that score generalizability is very low when using one writing task due to the large (pt) variance component. Implications and limitations of the study are presented. (Contains 2 tables and 2 figures.)
Descriptors: Generalizability Theory, Writing Evaluation, Writing Tests, Scores, Second Language Learning, College Students, Foreign Countries, Academic Discourse, Essays, English (Second Language), Language Tests
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Egypt
Grant or Contract Numbers: N/A