ERIC Number: ED421490
Record Type: Non-Journal
Publication Date: 1998-Apr
Reference Count: N/A
Setting Test-Level Standards for a Performance Assessment of Physicians' Clinical Skills: A Process Investigation.
De Champlain, Andre F.; Margolis, Melissa J.; Ross, Linette P.; Macmillan, Mary K.; Klass, Daniel J.
The purpose of the present investigation was to address several critical issues relating to setting a performance standard on a nationally administered standardized patient examination (SPX). The specific goals of the study were to: (1) compare pass/fail rates from this exercise to those of past studies undertaken with the same examination; (2) assess inter-rater classification consistency at both the case and test levels; and (3) determine whether a partially or fully compensatory model more accurately accounts for the process by which expert judges set test-level standards. Examinee data rated by the standard-setting judges in this study were taken from the 1996-97 administration of the National Board of Medical Examiners standardized patient examination at two testing sites. A random sample of 160 fourth-year medical students was chosen for the investigation, and 8 clinicians were recruited to provide the expert judgments. This information will be valuable in helping determine how to best set a fair and defensible standard for future forms of the SPX. (Contains 4 tables, 1 figure, and 22 references.) (SLD)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A