NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1057783
Record Type: Journal
Publication Date: 2015-Apr
Pages: 23
Abstractor: As Provided
Reference Count: 56
ISBN: N/A
ISSN: ISSN-0265-5322
What Accounts for Integrated Reading-to-Write Task Scores?
Shin, Sun-Young; Ewert, Doreen
Language Testing, v32 n2 p259-281 Apr 2015
Reading-to-write (RTW) tasks are becoming increasingly popular and have already been used in several high-stakes English proficiency exams, either replacing or complementing a prompt-based essay test. However, it is still not clear that what accounts for successful or unsuccessful performance on an integrated reading-writing task is owing to the hybrid nature of reading and writing skills and to potential rater effects on test score variability. Thus, in this study, data-driven analytic rubrics for the RTW task were developed first. Then, the analytic subscores of 83 college ESL students' responses to the RTW task were obtained. Correlational analyses were first used for the data to explore the relationship of the writing and reading skills engaged in different aspects of the RTW task. A multivariate G-study was also applied to examine the degree of variability attributable to test takers and raters on analytic subscores. The results indicate that a RTW task may tap into both reading and writing abilities given relatively high correlations observed among composite of and separate analytic subscores, and independent reading and writing scores. The multivariate G-study results also show that each analytic rating domain could capture the difference in variability of test takers' proficiency utilized in the RTW task, and raters assigned scores neither too harshly nor too leniently across each analytic rating domain. However, the results also reveal that person and rater facets contributed to score variability differently in certain analytic categories. This study provides valuable insights into the nature of RTW tasks and has implications for rating rubric development for integrated tasks.
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A