ERIC Number: EJ1123978
Record Type: Journal
Publication Date: 2017-Jan
Pages: 26
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0265-5322
EISSN: N/A
Topic and Background Knowledge Effects on Performance in Speaking Assessment
Khabbazbashi, Nahal
Language Testing, v34 n1 p23-48 Jan 2017
This study explores the extent to which topic and background knowledge of topic affect spoken performance in a high-stakes speaking test. It is argued that evidence of a substantial influence may introduce construct-irrelevant variance and undermine test fairness. Data were collected from 81 non-native speakers of English who performed on 10 topics across three task types. Background knowledge and general language proficiency were measured using self-report questionnaires and C-tests respectively. Score data were analysed using many-facet Rasch measurement and multiple regression. Findings showed that for two of the three task types, the topics used in the study generally exhibited difficulty measures which were statistically distinct. However, the size of the differences in topic difficulties was too small to have a large practical effect on scores. Participants' different levels of background knowledge were shown to have a systematic effect on performance. However, these statistically significant differences also failed to translate into practical significance. Findings hold implications for speaking performance assessment.
Descriptors: Speech Tests, High Stakes Tests, English (Second Language), Language Proficiency, Questionnaires, Item Response Theory, Multiple Regression Analysis, Difficulty Level, Knowledge Level, Differences, Performance Based Assessment, Language Tests, Second Language Learning, Foreign Countries
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Tests/Questionnaires; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Iran (Tehran)
Identifiers - Assessments and Surveys: International English Language Testing System
Grant or Contract Numbers: N/A