NotesFAQContact Us
Collection
Advanced
Search Tips
ERIC Number: ED507806
Record Type: Non-Journal
Publication Date: 2009-Sep
Pages: 128
Abstractor: As Provided
Reference Count: 94
ISBN: N/A
ISSN: ISSN-1930-9317
The Speaking Section of the TOEFL iBT[TM] (SSTiBT): Test-Takers' Reported Strategic Behaviors. TOEFL iBT[TM] Research Report. RR-09-30
Swain, Merrill; Huang, Li-Shih; Barkaoui, Khaled; Brooks, Lindsay; Lapkin, Sharon
Educational Testing Service
This study responds to the Test of English as a Foreign Language[TM] (TOEFL[R]) research agenda concerning the need to understand the processes and knowledge that test-takers utilize. Specifically, it investigates the strategic behaviors test-takers reported using when taking the Speaking section of the TOEFL iBT[TM] (SSTiBT). It also investigates how the reported strategic behaviors differed across integrated and independent tasks in the SSTiBT, as well as the relationship between test-takers' reported strategic behaviors and their performance on the tasks as determined by their test scores. The participating students were 14 graduate and 16 undergraduate engineering students whose first language was Chinese. The results indicate that test-takers reported using 49 separate strategies when completing the SSTiBT tasks. Of the five strategy categories, the metacognitive, communication, and cognitive strategies were proportionally the most frequently reported. The interrelationships among these three categories were negative. Undergraduates reported using significantly more communication strategies, whereas graduates reported using significantly more cognitive and affective strategies. No statistically significant differences were found in reported strategy use across proficiency levels. The integrated tasks were more alike with respect to reported strategy use than were the independent and integrated tasks. Furthermore, the integrated tasks elicited a wider variety of reported strategy use than the independent tasks. Overall, we found no relationship between the total number of reported strategic behaviors and total test score on the SSTiBT. We conclude that strategy use is integral to performing SSTiBT tasks and should therefore be considered as part of the construct of communicative performance. However, the relationship between strategy use and test performance is varied and is due to complex interactions among test-taker characteristics, tasks, and contexts. Appendices include: (1) A List of Strategic Behaviors; (2) Analysis of Test Scores; (3) Pretest Proficiency Screening; (4) Individual Profile Questionnaire; (5) Stimulated Recall Instructions; (6) Coding Scheme; (7) Results of Normality Tests; (8) Descriptive Statistics for Individual Strategies by Test-Taker Study Level; (9) Descriptive Statistics for Individual Strategies by Task Group; (10) Descriptive Statistics for Individual Strategies by Task; and (11) Excerpts Illustrating Impact of Stimulated Recalls on Test-Takers' Behavior. (Contains 19 tables, 4 figures, and 16 notes.)
Educational Testing Service. Rosedale Road Mailstop 19R, Princeton, NJ 08541-0001. Tel: 609-921-9000; Fax: 609-734-5410; Web site: http://www.ets.org
Publication Type: Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: Educational Testing Service
Identifiers - Assessments and Surveys: Test of English as a Foreign Language