ERIC Number: ED223648
Record Type: RIE
Publication Date: 1982-Jun-23
Reference Count: 0
Assessment of Intercoder Reliability on the Classification of Secondary School Courses.
Evaluation Technologies, Inc., Arlington, VA.
The Classification of Secondary School Courses (CSSC) is a coding activity to translate the diverse course titles which appear on transcripts and master schedules of students into common terms, permitting meaningful comparisons to be made about these students and allowing secondary school coursework to be considered as a coherent factor in statistical studies. The CSSC facilitates this task by aggregating under a unique main course title all similar course titles and assigning each main title a unique six-digit code. A test of intercoder reliability was designed, conducted and analyzed to test the usefulness of the CSSC as a coding tool and develop recommendations on coder training and the coding task. This report summarizes the following activities integral to the test: (1) coder selection and training; (2) training methodology; and (3) coding task and analysis results. While there is a fair amount of variability in the coding, there are a number of straight-forward ways to reduce it and achieve nearly perfect codings. Some of these techniques involve training enhancements (e.g., expanding the cross-reference list) and some involve procedural approaches (e.g., using multiple coders). (Author/PN)
Publication Type: Reports - Research
Education Level: N/A
Sponsor: National Center for Education Statistics (ED), Washington, DC.
Authoring Institution: Evaluation Technologies, Inc., Arlington, VA.
Identifiers: Classification of Secondary School Courses; High School and Beyond (NCES); Inter Rater Reliability
Note: Small print in Appendix D.