ERIC Number: ED389743
Record Type: RIE
Publication Date: 1994-Jun-29
Reference Count: N/A
New Stuff in I/O (In-Baskets and Orals). The Development, Administration and Scoring of In-Baskets and Orals for the New York State Correction Captain Examination.
Kaiser, Paul D.; Brull, Harry
The design, administration, scoring, and results of the 1993 New York State Correctional Captain Examination are described. The examination was administered to 405 candidates. As in previous Sergeant and Lieutenant examinations, candidates also completed latent image written simulation problems and open/closed book multiple choice test components. New approaches to constructing the examination permitted the inclusion of in-baskets and orals. The in-basket items required candidates to handle relatively complex situations. Candidates were then asked specific questions about their decisions. Scoring was by rater pairs formed of a civil service examiner and a corrections subject matter expert. Each rater pair scored a small subset of items for each candidate, becoming item experts who could evaluate a small set of responses rapidly and consistently. The inclusion of oral interviews provided other challenges. The interviews were conducted by a trained civil service examiner who asked standardized questions. Assessors, Department of Corrections personnel above the rank of captain, evaluated responses on a 9-point scale. Both in-basket and oral processes proved to be efficient and economical. Two appendixes contain an examination type synopsis and the history of litigation about corrections department examinations. (Contains 10 tables.) (SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Identifiers: In Basket Simulation; Oral Examinations
Note: Paper presented at the International Personnel Management Association Assessment Council Conference (Charleston, SC, June 29, 1994).