NotesFAQContact Us
Search Tips
ERIC Number: ED049275
Record Type: RIE
Publication Date: 1971-Feb
Pages: 7
Abstractor: N/A
Reference Count: 0
A Validation of the Smith Test for Measuring Teacher Judgment of Written Composition.
Whalen, Thomas E.
Smith (1969) reported the results of an instrument for measuring teacher judgment of written composition. His test was first administered to a group of "experts" whose ratings were in high agreement. Then the test was given to a sample of over 200 teachers and lay readers. Among Smith's conclusions was that over half of the teachers have judgment which differs significantly from the experts. This study sought to determine if rater differences as measured by Smith's test would remain constant for another set of essays. Six raters were selected, on the basis of their scores on Forms A and B of the Smith test, to read and score 71 seventh-grade essays. No significant differences were observed between "good" and "bad" raters. The results cast doubt on the validity of Smith's test as a general instrument for assessing essay-rating behavior. Although the test does appear to separate raters in terms of their rankings of essays, and even though these rankings are relatively reliable, difference between raters did not remain constant for another set of essays. (Author/LR)
Publication Type: N/A
Education Level: N/A
Audience: N/A
Language: N/A
Sponsor: N/A
Authoring Institution: N/A
Note: Paper presented at the Annual Meeting of the American Educational Research Association, New York, New York, February 1971