NotesFAQContact Us
Collection
Advanced
Search Tips
ERIC Number: ED308219
Record Type: Non-Journal
Publication Date: 1989-Mar
Pages: 21
Abstractor: N/A
Reference Count: N/A
ISBN: N/A
ISSN: N/A
Designing a Review and Appeal Process for a Large Scale Writing Assessment Program.
Goldberg, Gail Lynn; Walker-Bartnick, Leslie
A formative evaluation of a pilot review and appeal process for the Maryland Writing Test (MWT) is described. The MWT is a large-scale direct assessment of writing. A three-year pilot phase was to culminate in the implementation of an operational procedure for the review and appeal of scores impacting a pass/fail decision for examinees. The MWT requires that students respond to a pair of three-paragraph prompts, one narrative and one explanatory. Each response is scored via a modified holistic procedure on a domain-specific rubric covering five criteria--content, organization, audience, sentence formation, and conventions of edited American English. During the first 2 years of the piloting of the MWT (1987 and 1988), approximately 50 reviewers were selected by the local education agencies for training by the State Department of Education; the reviewers were trained to conduct review sessions with students and/or parents. Review sessions were designed to help parents and students understand MWT scores and explanatory rubrics (scoring guides) and to provide information to help participants decide concerning possible appeals. Pilot study data from 1987 and 1988 indicate that the MWT scores have a high degree of validity. Of the 15,955 10th graders tested in 1987, 2,392 received a total raw score of 5.0 on the MWT, and thus were eligible for review and appeal. Of the 23,331 10th and 11th graders tested in 1988, 2,951 received a total raw score of 5.0, and thus were eligible for review and appeal. (TJH)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A