ERIC Number: ED242756
Record Type: RIE
Publication Date: 1983
Reference Count: 0
The Direct Assessment of Writing Skill: A Measurement Review. College Board Report No. 83-6.
Breland, Hunter M.
Direct assessment of writing skill, usually considered to be synonymous with assessment by means of writing samples, is reviewed in terms of its history and with respect to evidence of its reliability and validity. Reliability is examined as it is influenced by reader inconsistency, domain sampling, and other sources of error. Validity evidence is presented, which shows reported relationships between direct assessment scores and criteria such as class rank, English course grades, and instructors' ratings of writing ability. Evidence on the incremental validity of direct assessment over and above other available measures is also given. It is concluded that direct assessment makes a contribution but that methods need to be developed to improve its reliability and reduce its costs. New automated methods of textual analysis and new kinds of direct assessment in which more than a single score is produced are suggested as two approaches to better direct assessment. (Author)
Descriptors: Essay Tests, Evaluation Needs, Higher Education, Interrater Reliability, Measurement Techniques, Performance Based Assessment, Scoring, Secondary Education, Technological Advancement, Test Reliability, Test Validity, Writing Evaluation, Writing Skills
College Board Publications, Box 886, New York, NY 10101 ($5.00).
Publication Type: Information Analyses
Education Level: N/A
Sponsor: College Entrance Examination Board, New York, NY.
Authoring Institution: Educational Testing Service, Princeton, NJ.