ERIC Number: ED393924
Record Type: RIE
Publication Date: 1995-Jun
An Analysis of the Effects of Untranslated Behavioral Checklists on the Psychometric Properties of Assessment Centers.
Donahue, Lisa M.; And Others
A field study with 178 candidates for a police promotional examination was conducted to investigate the effects of "untranslated" behavioral checklists on certain psychometric properties of an assessment center. The untranslated checklist used all behavioral responses elicited by the assessment center exercises, not just those that met a retranslation criterion of categorizing into dimensions. The study examined whether similar convergence of dimensions across exercises could be obtained across four job simulation exercises that varied greatly in content. The reliability of the behavioral checklist and criterion-related validity were evaluated by comparing the checklist to a conventional graphic rating scale format. The results suggest that the untranslated behavioral checklists improved the discriminant validity and reliability of dimension scores over a traditional graphic rating scale, but did not have a corresponding effect on the convergent validity of dimension scores. In addition, the untranslated behavioral checklist did not yield a significant relationship with performance. It is suggested that behavioral checklists have many benefits, and thus are very appropriate as a method of evaluating assessment center exercises. An appendix lists definitions of assessment center dimensions. (Contains 7 tables and 21 references.) (Author/SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Note: Paper presented at the Annual Meeting of the International Personnel Management Association Assessment Council Conference (New Orleans, LA, June 25-29, 1995).