ERIC Number: ED193280
Record Type: RIE
Publication Date: 1980-Sep
Reference Count: 0
Evaluating Composition Skills: A Method and Example.
McLean, James E.; Chissom, Brad S.
Holistic evaluation is a reliable, valid, and cost-effective alternative to the usual mechanical assessment of writing. Writing samples are scored on a five-point scale against an overall impression of development, organization, and coherentness. The method was applied to the Communication Activities Skills Project (CASP) for grades 3-12. Writing samples were collected before and after the Project from experimental and control groups, using a stimulus question. Three or four teachers rated each sample, after three days of holistic evaluation training. To eliminate possible bias, raters were not aware of the research group origin of the sample, and scoring was anonymous. Reliability coefficients were measured for: the pre-Project and post-Project samples, the difference between them, and choice of best sample. Coefficients ranged from .62 to .95; most were above .75. Results on the relative performance of control and experimental groups conflicted, depending on the method of comparison: analysis of variance vs proportion. Detailed information concerning the holistic method and the rating categories is appended. (GK)
Publication Type: Speeches/Meeting Papers; Reports - Research; Guides - Classroom - Teacher
Education Level: N/A
Authoring Institution: N/A
Note: Paper presented at the Annual Meeting of the Evaluation Network (6th, Memphis, TN, September 29-October 1, 1980).