NotesFAQContact Us
Search Tips
ERIC Number: EJ1111264
Record Type: Journal
Publication Date: 2008-Jul
Pages: 33
Abstractor: As Provided
Reference Count: 36
ISSN: EISSN-2330-8516
A Study of Confidence and Accuracy Using the Rasch Modeling Procedures. Research Report. ETS RR-08-42
Paek, Insu; Lee, Jihyun; Stankov, Lazar; Wilson, Mark
ETS Research Report Series, Jul 2008
This study investigated the relationship between students' actual performance (accuracy) and their subjective judgments of accuracy (confidence) on selected English language proficiency tests. The unidimensional and multidimensional IRT Rasch approaches were used to model the discrepancy between confidence and accuracy at the item and test level and to assess disattenuated strength of association between accuracy and confidence. The analysis results indicate a pattern of overconfidence bias (i.e., overestimation of success rate), which was related to item difficulty. In addition, the strength of association between accuracy and confidence dimension was relatively high: The confidence dimension explained 45% and 52% of the variability in the accuracy dimension for the two tests employed in this study.
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A