NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1148772
Record Type: Journal
Publication Date: 2017
Pages: 16
Abstractor: As Provided
ISSN: ISSN-1302-597X
Effects of Content Balancing and Item Selection Method on Ability Estimation in Computerized Adaptive Tests
Sahin, Alper; Ozbasi, Durmus
Eurasian Journal of Educational Research, n69 p21-36 2017
Purpose: This study aims to reveal effects of content balancing and item selection method on ability estimation in computerized adaptive tests by comparing Fisher's maximum information (FMI) and likelihood weighted information (LWI) methods. Research Methods: Four groups of examinees (250, 500, 750, 1000) and a bank of 500 items with 10 different content domains were generated through Monte Carlo simulations. Examinee ability was estimated by fixing all settings except for the item selection methods mentioned. True and estimated ability (?) values were compared by dividing examinees into six subgroups. Moreover, the average number of items used was compared. Findings: The correlations decreased steadily as examinee ? level increased among all examinee groups when LWI was used. FMI had the same trend with the 250 and 500 examinees. Correlations for 750 examinees decreased as ? level increased as well, but they were somewhat steady with FMI. For 1000 examinees, FMI was not successful in estimating examinee ? accurately after ? subgroup 4. Moreover, when FMI was used, ? estimates had less error than LWI. The figures regarding the average items used indicated that LWI used fewer items in subgroups 1, 2, 3 and that FMI used less items in subgroups 4, 5, and 6. Implications for Research and Practice: The findings indicated that when content balancing is put into use, LWI is more suitable to estimate examinee ? for examinees between -3 and 0 and that FMI is more stable when examinee ? is above 0. An item selection algorithm combining these two item selection methods is recommended.
ANI Publishing Company. Kizilirmak Sokak 10/A Bakanliklar, Ankara, Turkey 06440. Tel: +90-312-425-8150; Fax: +90-312-425-8111; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A