NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ827374
Record Type: Journal
Publication Date: 2007-Nov
Pages: 9
Abstractor: As Provided
Reference Count: 57
ISBN: N/A
ISSN: ISSN-0005-3503
The Reliability of Essay Marking in High-Stakes Chinese Second Language Examinations
Ren, Guanxin
Babel, v42 n2 p25-31, 38-39 Nov 2007
Essay marking is a subjective intellectual exercise in which the score reliability can be influenced by many factors such as the test design, the marker's interpretation of the marking criteria, the procedure, and the method used in the marking process. After conducting a literature review this study investigated the reliability of essay marking in high-stakes Chinese Second Language (CSL) examinations in Victoria, where the school-based assessments and the final external examinations are combined to produce one holistic score for each candidate. The subjects were twelve volunteer CSL markers from twelve different secondary schools in greater Melbourne. The data consisted of 24 marking sheets completed by the markers on two separate occasions. Comparison was made between the first and the second marking. The study found that over 83% of the scores awarded in the first marking were subjective. To improve the reliability of the essay marking in CSL, an alternative marking method called the "three-marker method" was introduced. It was evident that this method of marking improved the standard variation, variance, and reliability coefficient of CSL scoring. The outcome of this research could also be applicable to essay marking in other second languages. (Contains 4 tables.)
Australian Federation of Modern Language Teachers Associations. Faculty of Education and Social Work, University of Sydney, NSW 2006, Australia. Tel: +61-29351-2022; e-mail: president@afmlta.asn.au; e-mail: editor@afmlta.asn.au; Web site: http://www.afmlta.asn.au
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Australia