ERIC Number: ED193459
Record Type: RIE
Publication Date: 1980-Sep
Reference Count: 0
Peer Ratings: Scoring Strategy Development and Reliability Demonstration on Air Force Basic Trainees. Final Report.
Borman, Walter C.; Rosse, Rodney L.
As an alternative for or adjunct to paper-and-pencil tests for predicting personnel performance, the United States Air Force studied the use of peer ratings as an evaluative tool. Purpose of this study was to evaluate the psychometric characteristics of peer ratings among Air Force basic trainees. Peer ratings were obtained from more than 27,000 basic trainees. An effective method was developed for scoring them by algebraically summing the positive and negative ratings. A modification of the Spearman-Brown prophecy formula was used to determine interrater reliability coefficients which were adjusted to the mean number of trainees in the flights. The peer ratings yielded uniformly high interrater reliability coefficients which indicated substantial agreement among raters. It was concluded that the method developed for norming peer ratings from different size groups was valuable and could be applied to standardize future peer ratings. Peer ratings thus show promise for performance appraisal when normed using this method. References and extensive norm tables for personnel characteristics such as effort, cooperation, people orientation, emotional stability, intelligence, calmness, physical strength and energy, and likelihood of success are included. (Author/KC)
Publication Type: Reports - Research; Numerical/Quantitative Data
Education Level: N/A
Sponsor: Air Force Human Resources Lab., Brooks AFB, TX.
Authoring Institution: Personnel Decisions, Inc., Minneapolis, Minn.
Identifiers: Air Force; Spearman Brown Formula; United States
Note: Small type in tables will not reproduce well.