NotesFAQContact Us
Search Tips
ERIC Number: ED429120
Record Type: Non-Journal
Publication Date: 1999-Apr
Pages: 6
Abstractor: N/A
Reference Count: N/A
The Relationship between Scoring Quality and Assessment Reliability.
Myerberg, N. James
Whether the internal consistency reliability of a test changes as the quality of the scoring of the test changes was studied with data from reading and mathematics short-answer and extended-response assessments administered in grades 3 to 8 in the Montgomery County (Maryland) Public Schools. There were about 9,000 students in each grade, with data from 18 assessments. Each assessment was scored by about 50 teachers, and about 30% of the papers were scored twice to provide data about the quality of scoring and to help in the training of scorers. For each of the assessments an inter-rater correlation coefficient and a coefficient alpha were computed for the best and worst groups of scorers, yielding a total of 36 pairs. A wide range was achieved for both inter-rater correlations and the alpha coefficients. The analysis of these findings indicates that the internal consistency of an assessment changes as the quality of the scoring of the assessment changes. Thus, for tests that are not multiple choice, any report on test quality should also include data related to scoring quality. (Contains one table.) (SLD)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A