ERIC Number: EJ1122370
Record Type: Journal
Publication Date: 2014-Jun
Pages: 16
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-2191-611X
EISSN: N/A
Piloting a Polychotomous Partial-Credit Scoring Procedure in a Multiple-Choice Test
Tsopanoglou, Antonios; Ypsilandis, George S.; Mouti, Anna
Language Learning in Higher Education, v4 n1 p43-58 Jun 2014
Multiple-choice (MC) tests are frequently used to measure language competence because they are quick, economical and straightforward to score. While degrees of correctness have been investigated for partially correct responses in combined-response MC tests, degrees of incorrectness in distractors and the role they play in determining the test-taker's final score remain comparatively unexplored. This pilot study examines degrees of incorrectness in MC test items and their potential impact on the overall "reliability of scoring procedures, test micro impact, and scoring performance" of individual test-takers. Investigating the above properties as quality dimensions of language testing is crucial since decisions made on the basis of such tests influence the careers and lives of test-takers. Three scoring procedures were applied to an authentic test: dichotomous, which is straightforward--correct/incorrect; polychotomous, which offers partial credit to very plausible and plausible options; and negative, which includes negative scoring when a wholly incorrect answer is selected. While these three procedures proved to be equally reliable, the polychotomous scoring method offered more sensitive and precise results, while negative scoring was particularly disadvantageous for test-takers. The polychotomous method of scoring moves away from the absolute right or wrong view and enhances sensitivity in the field of individualised language testing.
Descriptors: Scoring, Pilot Projects, Multiple Choice Tests, Language Tests, Language Skills, Test Items, Second Language Learning, Test Format, Guessing (Tests), Researchers, Language Teachers, Item Analysis, Correlation, English (Second Language), College Students, Likert Scales
De Gruyter Mouton. Available from: Walter de Gruyter, Inc. 121 High Street, Third Floor, Boston, MA 02110. Tel: 857-284-7073; Fax: 857-284-7358; e-mail: service@degruyter.com; Web site: http://www.degruyter.com
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: N/A
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Test of English as a Foreign Language
Grant or Contract Numbers: N/A