ERIC Number: ED210310
Record Type: RIE
Publication Date: 1980-Mar
Reference Count: 0
Toward a Definition of "Good" Incident Dimension Congruence for BARS.
Stutzman, Thomas M.; And Others
This study investigated the relationship between the dimensionality of behaviorally anchored scales during construction and during their use. It was hypothesized that as the agreement among raters in assigning behaviors to dimensions increased, there would be an increase in the stability of the structure of the dimensions and in their independence during use. Undergraduate students enrolled in two introductory history classes and five introductory psychology classes were administered a teacher evaluation instrument containing 60 behaviorally based items. These items represented five performance dimensions and four ranges of rater agreement. For the analyses, class means were subtracted for each item, items were factor analyzed, and inter-dimension correlations were computed. The results demonstrated partial support for the hypothesis. At the higher levels of agreement among raters, more of the original five dimensions were interpretable, and they were more independent. However, in none of the factor analyses were all of the original dimensions reproduced. It was concluded that the degree of agreement among judges during dimension construction did influence the ability of factor analytic solutions to represent the original dimensionality. However, high agreement does not guarantee the maintenance of dimension independence. (Author)
Publication Type: Speeches/Meeting Papers; Numerical/Quantitative Data; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Identifiers: Behaviorally Anchored Rating Scales; Dimensional Analysis
Note: Paper presented at the Annual Meeting of the Southeastern Psychological Association (Washington, DC, March, 1980).