PDF pending restoration
ERIC Number: ED246070
Record Type: RIE
Publication Date: 1984-Apr-26
Reference Count: 0
Application of Judgmental Standard Setting Procedures to Vocational Evaluation Competency Statements by Rehabilitation Field Personnel and Educators.
Sigmon, Gary L.; Halpin, Gerald
Traditionally, judgmental standard setting methods have been used exclusively at the test item level. In this study, the Ebel and Angoff methods of standard setting were utilized to determine minimum competency standards on a list of 175 identified competency statements for vocational evaluators. The following research questions were addressed: (1) Do the Ebel and Angoff methods result in the establishment of different competency standards? (2) Do vocational evaluation field personnel and vocational evaluation educators establish different standards? and (3) Are the standards determined by the different methods moderated by group membership? The raters were 19 vocational evaluation field personnel and 24 vocational evaluation educators from university settings. Significant differences were found between rating methods across groups; the Ebel method resulted in a higher mean competency standard. The groups of raters also set significantly different competency standards across methods; the field personnel established a higher mean competency standard. The importance of this group difference was minimized due to the significant interaction between group and method; here, the group difference was greater using the Angoff method. These results substantiate claims that these standard setting methods may be applied to measures other than test items. (BW)
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Identifiers: Angoff Methods; Ebel Method
Note: Paper presented at the Annual Meeting of the National Council on Measurement in Education (New Orleans, LA, April 24-26, 1984).