Purpose: Determining the valid and fair use of the interview for medical school admissions is contingent upon a demonstration of the reproducibility of interview scores. This study seeks to establish the generalizability of interview scores, first assessing the existing research evidence, and then analyzing data from a non-experimental independent…

Problem Statement and Background: While the psychometric properties of Objective Structured Clinical Examinations (OSCEs) have been studied, their latent structures have not been well characterized. This study examines a factor analytic model of a comprehensive OSCE and addresses implications for measurement of clinical performance. Methods: An…

Qualitative analysis of a large ethnographic database from observations of a resident teaching clinic revealed three important findings. The first finding was that breakdown, a situation where an "actor" (such as a person or the group) is not achieving expected effectiveness, was the most important category because of its frequency and explanatory…

The purpose of this study is to investigate the content-specificity of communication skills. It investigates the reliability and dimensionality of standardized patient (SP) ratings of communication skills in an Objective Structured Clinical Examination(OSCE) for final year medical students. An OSCE consisting of seven standardized patient(SP)…

Effect Sizes (ES) are an increasingly important index used to quantify the degree of practical significance of study results. This paper gives an introduction to the computation and interpretation of effect sizes from the perspective of the consumer of the research literature. The key points made are: (1) "ES" is a useful indicator of the…

Context: Various research studies have examined the question of whether expert or non-expert raters, faculty or students, evaluators or standardized patients, give more reliable and valid summative assessments of performance on Objective Structured Clinical Examinations (OSCEs). Less studied has been the question of whether or not non-faculty…

As the rapidity with which medical knowledge is generated and disseminated becomes amplified, an increasing emphasis has been placed on the need for physicians to develop the skills necessary for life-long learning. One such skill is the ability to evaluate one's own deficiencies. A ubiquitous finding in the study of self-assessment, however, is…

This three-part article begins with a brief presentation of a framework that describes different approaches to conduct and report research on expert knowledge. The framework contrasts "direct vs. indirect" approaches and provides examples of each. Second, the article gives a detailed description of the methods and results of three concept mapping…

OSCE examinations were held in May and June 2002 for all third and fourth year and some fifth year medical students at the University of Leeds. There has been an arbitrary pass mark of 65% for these examinations. However, we recognise that it is important to adopt a systematic approach towards standard setting in all examinations so held a trial…

Reports on research and educational findings using the Inventory of Cognitive Biases in Medicine (ICBM). The ICBM was administered to medical students as well as practicing physicians and susceptibility to cognitive bias was found to be substantial among both groups. Concludes that educational strategies in the classroom and clinical settings may…

Reflects on the merits of the Problem Based curriculum designed at McMaster University in Hamilton, Ontario nearly 30 years ago. This curriculum was a product influenced by the times in which it was used rather than by any educational theory. Concludes that it is necessary to edit the problems as well as any other course materials so as not to…