ERIC Number: EJ1076454
Record Type: Journal
Publication Date: 2014-Jan
Abstractor: As Provided
Reference Count: 21
The Impact of Different Scoring Rubrics for Grading Virtual Patient-Based Exams
Fors, Uno G. H.; Gunning, William T.
Journal of Educational Computing Research, v50 n1 p97-118 Jan 2014
Virtual patient cases (VPs) are used for healthcare education and assessment. Most VP systems track user interactions to be used for assessment. Few studies have investigated how virtual exam cases should be scored and graded. We have applied eight different scoring models on a data set from 154 students. Issues studied included the impact of penalizing guessing, requiring a correct diagnosis, different grading levels, and the effect of using weighted diagnostic metrics. Controlling the random-guessing approach is necessary and can be accomplished by a rubric that measures a relative efficiency of the learner's inquiries and the total number of inquiries. Using a straight percentage score versus a curved exam score had a major impact on grades. Significant differences were found when using different metrics as only one of the eight rubric models resulted in a Gaussian distribution. Course directors need to analyze expected learning outcomes from a course to determine a scoring metric to assess those particular needs; the grading rubric must also control for guessing.
Descriptors: Scoring Rubrics, Health Education, Evaluation Methods, Case Method (Teaching Technique), Vignettes, Patients, Interaction, Grading, Scoring, Guessing (Tests), Computer Simulation, Medical Education, Inquiry
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: firstname.lastname@example.org; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Identifiers - Location: Ohio