NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ948061
Record Type: Journal
Publication Date: 2011-Dec
Pages: 9
Abstractor: As Provided
Reference Count: 16
ISSN: ISSN-1382-4996
Assessment of Multiple Physician Competencies in Postgraduate Training: Utility of the Structured Oral Examination
Jefferies, Ann; Simmons, Brian; Ng, Eugene; Skidmore, Martin
Advances in Health Sciences Education, v16 n5 p569-577 Dec 2011
Competency based medical education involves assessing physicians-in-training in multiple roles. Training programs are challenged by the need to introduce appropriate yet feasible assessment methods. We therefore examined the utility of a structured oral examination (SOE) in the assessment of the 7 CanMEDS roles (Medical Expert, Communicator, Collaborator, Manager, Health Advocate, Scholar and Professional) in a Neonatal-Perinatal Medicine subspecialty training program. Between 2004 and 2008, 68 trainees participated in an annual SOE. Each SOE consisted of 4 1st year and 4 2nd year clinical scenarios with standardized questions written by neonatologists that addressed all 7 CanMEDS roles. Examiners assigned a checklist score and global rating scores for knowledge and organization. A satisfaction survey was completed at the end of 3 examinations. Across the 5 SOEs, questions related to each competency were tabulated and an overall checklist score for each competency calculated. Inter-station reliability was determined for each CanMEDS role. Values for Cronbach's alpha were 0.62 [plus or minus] 0.2 (Medical Expert), 0.43 (Communicator), 0.40 [plus or minus] 0.34 (Collaborator), 0.19 [plus or minus] 0.17 (Manager), 0.46 [plus or minus] 0.32 (Advocate), 0.67 [plus or minus] 0.18 (Scholar) and 0.79 (Professional). Inter-rater reliability, determined for the first examination when there were 2 examiners per case, was moderate to substantial for 67% of cases. Participant satisfaction was high. Electronic communication facilitated exam development and costs were minimal. The SOE demonstrates psychometric properties suitable for a formative, in-training assessment as well as low cost, ease of administration and acceptability. It may be a useful way to assess physician competencies in training programs. (Contains 4 tables and 3 figures.)
Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A