ERIC Number: EJ1039449
Record Type: Journal
Publication Date: 2014-Mar
Abstractor: As Provided
Reference Count: 63
Metacognitive Scaffolds Improve Self-Judgments of Accuracy in a Medical Intelligent Tutoring System
Feyzi-Behnagh, Reza; Azevedo, Roger; Legowski, Elizabeth; Reitmeyer, Kayse; Tseytlin, Eugene; Crowley, Rebecca S.
Instructional Science: An International Journal of the Learning Sciences, v42 n2 p159-181 Mar 2014
In this study, we examined the effect of two metacognitive scaffolds on the accuracy of confidence judgments made while diagnosing dermatopathology slides in SlideTutor. Thirty-one (N = 31) first- to fourth-year pathology and dermatology residents were randomly assigned to one of the two scaffolding conditions. The cases used in this study were selected from the domain of nodular and diffuse dermatitides. Both groups worked with a version of SlideTutor that provided immediate feedback on their actions for 2 h before proceeding to solve cases in either the "Considering Alternatives" or "Playback" condition. No immediate feedback was provided on actions performed by participants in the scaffolding mode. Measurements included learning gains (pre-test and post-test), as well as metacognitive performance, including Goodman-Kruskal Gamma correlation, bias, and discrimination. Results showed that participants in both conditions improved significantly in terms of their diagnostic scores from pre-test to post-test. More importantly, participants in the Considering Alternatives condition outperformed those in the "Playback" condition in the accuracy of their confidence judgments and the discrimination of the correctness of their assertions while solving cases. The results suggested that presenting participants with their diagnostic decision paths and highlighting correct and incorrect paths helps them to become more metacognitively accurate in their confidence judgments.
Descriptors: Metacognition, Scaffolding (Teaching Technique), Accuracy, Evaluative Thinking, Clinical Diagnosis, Intelligent Tutoring Systems, Medicine, Feedback (Response), Measures (Individuals), Pretests Posttests, Correlation, Statistical Bias, Discriminant Analysis, Improvement, Scores, Problem Solving, Medical Students
Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: email@example.com; Web site: http://www.springerlink.com
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Authoring Institution: N/A