ERIC Number: EJ1176860
Record Type: Journal
Publication Date: 2016
Pages: 24
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-1936-7384
EISSN: N/A
The Effects of Visual Input on Scoring a Speaking Achievement Test
Beltrán, Jorge
Working Papers in TESOL & Applied Linguistics, v16 n2 p1-24 2016
In the assessment of aural skills of second language learners, the study of the inclusion of visual stimuli has almost exclusively been conducted in the context of listening assessment. While the inclusion of contextual information in test input has been advocated for by numerous researchers (Ockey, 2010), little has been said regarding the "scoring" of speaking tests, which also involves raters' listening comprehension. This study is designed to identify the possible variation in the scoring of speaking test performance when the speech samples to be scored are presented in either audio-only or audio-visual format. A group of raters were first asked to score a set of audio-only speech samples from an achievement speaking test consisting of one monologic task through an online platform. Weeks later, they scored the same samples presented in audio-visual format. Scores from both scoring sessions were compared. Findings suggest that the inclusion of visual stimuli may not result in significant effects on assigned scores or internal consistency. Yet, given the raters' reported preference of using the audio-visual format, the study results call for further exploration of the positive effects of delivery methods on rater effect.
Descriptors: Achievement Tests, Speech Skills, Speech Tests, Second Language Learning, Visual Stimuli, Listening Comprehension Tests, Scoring Formulas, Audiovisual Aids, Intermode Differences, Interrater Reliability, Preferences, Quasiexperimental Design, College Second Language Programs, Task Analysis, Scoring Rubrics, Questionnaires, Test Reliability, Comparative Analysis, Mixed Methods Research, Adult Learning
Teachers College, Columbia University. 525 West 120th Street, New York, NY 10027. e-mail: tcwebjournal@tc.columbia.edu; Web site: https://tesolal.columbia.edu/
Publication Type: Journal Articles; Reports - Research; Tests/Questionnaires
Education Level: Adult Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: New York (New York)
Grant or Contract Numbers: N/A