ERIC Number: EJ797089
Record Type: Journal
Publication Date: 2005-Jan
Reference Count: 0
Demonstration of Portfolios to Assess Competency of Residents
O'sullivan, Patricia S.; Reckase, Mark D.; McClain, Tina; Savidge, Mildred A.; Clardy, James A.
Advances in Health Sciences Education, v9 n4 p309-323 Jan 2005
Residency educators are identifying approaches to measure resident competence. Portfolios are well suited since they require work already completed as part of patient care where competency must be demonstrated. This paper describes assessment of the reliability and validity of portfolios in a psychiatry residency program. This was a cross-sectional study across 4 years of residency education. Using guidelines, 18 residents assembled portfolios containing five entries chosen from 13 skills. Trained raters scored the portfolios. Residents and faculty were interviewed about their perceptions. Generalizability results indicated five entries and two raters were sufficient for relative decisions. Six entries or a third rater would be sufficient for absolute decisions. Portfolio scores tended to improve with years of training and correlated with psychiatric knowledge but not clinical performance. Residents and faculty identified benefits to assembling a portfolio. Portfolios incorporate tasks embedded in the residency to provide evidence of resident competency. The results support that the score is reliable and valid.
Descriptors: Portfolio Assessment, Psychiatry, Competence, Medical Care Evaluation, Reliability, Validity, Case Studies, Resident Advisers, Residential Programs
Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: email@example.com; Web site: http://www.springerlink.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A