NotesFAQContact Us
Search Tips
ERIC Number: ED045655
Record Type: RIE
Publication Date: 1969
Pages: 86
Abstractor: N/A
Reference Count: N/A
Developing a Technique for Discovering the Rater Policies of Essay Graders.
Shostak, Robert
The purpose of this study was to express in procedural terms one approach in the development of a technique to discover the rating strategies of essay graders. Sets of rater scores obtained from a reading of 256 high school essays by 32 experienced English teachers were submitted to a factor analysis which yielded four meaningful rater clusters. To determine what characteristics in these raters' teaching experiences and personal background appear to be correlates to rating behavior, the clusters were compared on seven items. The factor analysis approach appeared to be a suitable technique. The following conclusions were drawn: (1) There is a strong indication that both age and sex do reflect some kind of underlying rating strategy; but, what specifically in the rating strategy was not determined. (2) Grade level taught and size of class load could be considered together to reflect not so much an underlying rating strategy as a propensity to have younger teachers teach lower grade levels and take the heaviest loads. (3) Education, teaching experience, and number of hours spent teaching composition seemed to contribute little in making distinctions among the clusters. The results indicated that the concepts of reliability and validity used in connection with evaluating composition, as well as clear writing objectives, must be stressed. (Author/LK)
University Microfilms, A Xerox Company, 300 N. Zeeb Rd., Ann Arbor, Michigan 48103 (Order No. 70-1314, MFilm $3.00, Xerography $4.60)
Publication Type: N/A
Education Level: N/A
Audience: N/A
Language: N/A
Sponsor: N/A
Authoring Institution: N/A
Note: Ph.D. Dissertation, The University of Connecticut