ERIC Number: ED229443
Record Type: RIE
Publication Date: 1983-Mar
Reference Count: 0
Assessing the Psychometric Quality of Performance Rating Scales: Comparisons among Evaluative Criteria.
Lance, Charles E.; Moomaw, Michael E.
Direct assessments of the accuracy with which raters can use a rating instrument are presented. This study demonstrated how surplus behavioral incidents scaled during the development of Behaviorally Anchored Rating Scales (BARS) can be used effectively in the evaluation of the newly developed scales. Construction of scenarios of hypothetical incumbent job performance and alternative rating instruments makes fuller use of behavioral incident item pools that result from BARS development procedures. Ratee (hypothetical incumbent) performance levels are known from the scale values of items chosen to depict ratee performance and the relative accuracy with which raters may use newly developed BARS can be evaluated in comparison with alternative formats developed as part of the evaluation process. Secondly, the study adds to the literature concerned with comparisons of rating formats in terms of their psychometric properties by contrasting the sole effects of rating format upon the psychometric quality of resulting scales. Again, BARS was an effective format for the rating of the individuals' performance. Finally, the virtue of rating accuracy as an evaluative criterion for assessing the psychometric quality of performance rating scales was extolled. (Author/CM)
Publication Type: Speeches/Meeting Papers; Reports - Evaluative
Education Level: N/A
Authoring Institution: N/A
Identifiers: Behaviorally Anchored Rating Scales
Note: Paper presented at the Annual Meeting of the Southeastern Psychological Association (Atlanta, GA, March 23-26, 1983).