ERIC Number: ED393880
Record Type: Non-Journal
Publication Date: 1995-Jun
Reference Count: N/A
Improving the Reliability of a Direct Writing Skills Assessment.
Schwarz, Julie A.; Collins, Michelle L.
Behaviorally Anchored Rating Scales (BARS) were developed to score responses from a previously designed police written communication test that lacked reliability. Rating scales for each of the 9 dimensions of the test consisted of the scale definition and a 5-point continuum, with the scores of 5, 3, and 1 defined by specified behavioral incidents. Ten raters (graduate students) were trained to score the test using a Frame-of-Reference technique. Fifty tests previously completed by police incumbents were re-scored. Each test was scored by two raters in order to assess interrater reliabilities. Interrater reliabilities and internal consistency were found to improve. An appendix contains definitions of behaviorally based anchors. (Contains 2 tables and 38 references.) (Author/SLD)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A