NotesFAQContact Us
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1037433
Record Type: Journal
Publication Date: 2014
Pages: 21
Abstractor: As Provided
ISSN: ISSN-1543-4303
The Role of Lexical Properties and Cohesive Devices in Text Integration and Their Effect on Human Ratings of Speaking Proficiency
Crossley, Scott; Clevinger, Amanda; Kim, YouJin
Language Assessment Quarterly, v11 n3 p250-270 2014
There has been a growing interest in the use of integrated tasks in the field of second language testing to enhance the authenticity of language tests. However, the role of text integration in test takers' performance has not been widely investigated. The purpose of the current study is to examine the effects of text-based relational (i.e., cohesion) and propositional-specific (i.e., lexical) features on subsequent source text integration in spoken responses. In addition, the current study investigates the effects of word integration on human ratings of speaking performance. Sixty test-takers' speaking samples from the listen/speak section of the TOEFL-iBT were analyzed in terms of textual integration at the lexical and cohesion level and how this integration predicted human scores of speaking proficiency. The results indicate that the properties of the source text are strongly predicative of which words test takers will integrate into their response. Moreover, it was found that text integration is an important factor that affects human ratings of speaking proficiency. The findings of the study are discussed in terms of item difficulty and construct representation.
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Test of English as a Foreign Language