ERIC Number: ED177211
Record Type: RIE
Publication Date: 1979-Apr
Reference Count: 0
Alternative Scoring Systems for Predicting Criterion Group Membership.
Four systems for scoring student essays were used to classify eleventh grade and undergraduate students according to writing ability. The reliabilities of the raters and the validities of the systems in classifying students were emphasized. Two analytic scoring systems--which assume that quality writing is characterized by the inclusion of certain rhetorical elements--were used: the Diederich Expository Scale and the Center for the Study of Evaluation (CSE) Analytic Scale. The T-unit analysis approach was used as an example of the frequency counting method; T-units were defined as the shortest grammatically complete units or sentences in a passage. The general impression, or holistic approach, was the fourth method used. Two samples of a 200-word expository essay were collected from students in four criterion groups: (1) non-college bound eleventh graders; (2) college bound students; (3) college students in a remedial composition course; and (4) college freshmen composition students. All of the systems--except T-unit--discriminated between the groups, particularly when three systems were used together. Classification accuracy was highest for the low-ability groups. Conclusions were made regarding the systems' generalizability and applicability. (Two writing topics are appended). (GDC)
Descriptors: Academic Ability, Analytical Criticism, Essays, Evaluation Criteria, Evaluation Methods, Expository Writing, High Schools, Higher Education, Holistic Evaluation, Predictive Measurement, Research Reports, Scoring, Scoring Formulas, Student Characteristics, Test Reliability, Writing Evaluation, Writing Skills
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Sponsor: National Inst. of Education (DHEW), Washington, DC.
Authoring Institution: California Univ., Los Angeles. Center for the Study of Evaluation.
Identifiers: CSE Analytic Scale; Diederich Rating Scale for Essays; T Units
Note: Paper presented at the Annual Meeting of the American Educational Research Association (63rd, San Francisco, California, April 8-12, 1979)