ERIC Number: EJ1110951
Record Type: Journal
Publication Date: 2004-Jul
Pages: 52
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2330-8516
EISSN: N/A
Comparability of TOEFL CBT Writing Prompts: Response Mode Analyses. TOEFL Research Report. TOEFL RR-75. ETS Research Report. RR-04-23
Breland, Hunter; Lee, Yong-Won; Muraki, Eiji
ETS Research Report Series, Jul 2004
Eighty-three Test of English as a Foreign Language™ (TOEFL®) CBT writing prompts that were administered between July 1998 and August 2000 were examined in order to identify differences in scores that could be attributed to the response mode chosen by examinees (handwritten or word processed). Differences were examined statistically using polytomous logistic regression. An English language ability (ELA) variable was developed from the multiple-choice components of the TOEFL examination and used as a matching variable. Although there was little observed difference in mean writing scores, when examinees were matched on English language ability, small differences were observed in effect sizes consistently favoring the handwritten response mode. The difference favoring the handwritten response mode occurred for all of the writing prompts analyzed; however, the differences for individual writing prompts were small. This difference suggests a general effect for response mode.
Descriptors: English (Second Language), Language Tests, Second Language Learning, Cues, Computer Assisted Testing, Scores, Word Processing, Regression (Statistics), Effect Size, Essay Tests
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Test of English as a Foreign Language
Grant or Contract Numbers: N/A