ERIC Number: EJ690069
Record Type: Journal
Publication Date: 2005-Aug
Comparability of TOEFL CBT Essay Prompts: Response-Mode Analyses
Breland, Hunter; Lee, Yong-Won; Muraki, Eiji
Educational and Psychological Measurement, v65 n4 p577-595 Aug 2005
Eighty-three Test of English as a Foreign Language (TOEFL) writing prompts administered via computer-based testing between July 1998 and August 2000 were examined for differences attributable to the response mode (handwriting or word processing) chosen by examinees. Differences were examined statistically using polytomous logistic regression. A variable measuring English-language ability (ELA) was developed from the multiple-choice components of the TOEFL and used as a matching variable. Although there was little observed difference in mean writing scores, when examinees were matched on ELA, small differences were observed in effect sizes consistently favoring the handwriting response mode. This difference favoring the handwriting response mode occurred for all of the writing prompts analyzed, suggesting a general effect for response mode. Differences for individual writing prompts were small, however.
Descriptors: Evaluation Methods, Word Processing, Handwriting, Effect Size, English (Second Language), Computer Assisted Testing, Scores, Language Proficiency, Cues, Essays
Sage Publications, 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243 (Toll Free); Fax: 800-583-2665 (Toll Free).
Publication Type: Book/Product Reviews; Journal Articles
Education Level: N/A
Authoring Institution: N/A