NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ899874
Record Type: Journal
Publication Date: 2010
Pages: 14
Abstractor: As Provided
Reference Count: 57
ISSN: ISSN-1436-4522
Development and Evaluation of a Confidence-Weighting Computerized Adaptive Testing
Yen, Yung-Chin; Ho, Rong-Guey; Chen, Li-Ju; Chou, Kun-Yi; Chen, Yan-Lin
Educational Technology & Society, v13 n3 p163-176 2010
The purpose of this study was to examine whether the efficiency, precision, and validity of computerized adaptive testing (CAT) could be improved by assessing confidence differences in knowledge that examinees possessed. We proposed a novel polytomous CAT model called the confidence-weighting computerized adaptive testing (CWCAT), which combined a confidence-weighting scoring scheme with the graded response model (GRM). The CWCAT provided a more interactive testing environment by focusing on the examinees' confidence in their responses. An experiment was conducted to evaluate the comparison between the CWCAT and conventional CAT in terms of efficiency, precision, and validity. As expected, the polytomous method provided better discrimination among individual differences in the confidence in knowledge and required fewer items per examinee. Results also showed that CWCAT yielded ability estimates that were higher and better correlated to examinees' performance in English learning. Furthermore, the ability measured by CWCAT was not as likely to be affected by guessing as on conventional CAT, and, therefore, was more consistent with examinees' true ability. (Contains 9 tables and 9 figures.)
International Forum of Educational Technology & Society. Athabasca University, School of Computing & Information Systems, 1 University Drive, Athabasca, AB T9S 3A3, Canada. Tel: 780-675-6812; Fax: 780-675-6973; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Secondary Education; High Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Taiwan