NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1002059
Record Type: Journal
Publication Date: 2013-Apr
Pages: 11
Abstractor: As Provided
Reference Count: 0
ISSN: ISSN-0959-4752
What Are Confidence Judgments Made of? Students' Explanations for Their Confidence Ratings and What that Means for Calibration
Dinsmore, Daniel L.; Parkinson, Meghan M.
Learning and Instruction, v24 p4-14 Apr 2013
Although calibration has been widely studied, questions remain about how best to capture confidence ratings, how to calculate continuous variable calibration indices, and on what exactly students base their reported confidence ratings. Undergraduates in a research methods class completed a prior knowledge assessment, two sets of readings and posttest questions, and rated their confidence in their responses to each posttest item. Students also wrote open-ended responses explaining why they marked their confidence as they did. Students provided confidence ratings on a 100-mm line for one of the passages and through magnitude scaling for the other counterbalanced passage. Calibration was calculated using a rho coefficient and yielded acceptable measures of calibration. No within-subject differences were found between 100-mm line responses and magnitude scaling responses, p = 0.54. Open-ended responses revealed that students base their confidence ratings on prior knowledge, characteristics of the text, characteristics of the item, guessing, and combinations of these categories. Future studies including calibration should carefully consider implicit assumptions about students' sources of confidence and how those sources theoretically relate to calibration. (Contains 3 tables and 5 figures.)
Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A