ERIC Number: EJ820006
Record Type: Journal
Publication Date: 2008
Abstractor: As Provided
Reference Count: 14
NCME 2008 Presidential Address: The Impact of Anchor Test Configuration on Student Proficiency Rates
Fitzpatrick, Anne R.
Educational Measurement: Issues and Practice, v27 n4 p34-40 Win 2008
Examined in this study were the effects of reducing anchor test length on student proficiency rates for 12 multiple-choice tests administered in an annual, large-scale, high-stakes assessment. The anchor tests contained 15 items, 10 items, or five items. Five content representative samples of items were drawn at each anchor test length from a small universe of items in order to investigate the stability of equating results over anchor test samples. The operational tests were calibrated using the one-parameter model and equated using the mean b-value method. The findings indicated that student proficiency rates could display important variability over anchor test samples when 15 anchor items were used. Notable increases in this variability were found for some tests when shorter anchor tests were used. For these tests, some of the anchor items had parameters that changed somewhat in relative difficulty from one year to the next. It is recommended that anchor sets with more than 15 items be used to mitigate the instability in equating results due to anchor item sampling. Also, the optimal allocation method of stratified sampling should be evaluated as one means of improving the stability and precision of equating results.
Descriptors: Test Length, Multiple Choice Tests, Item Sampling, Student Evaluation, Academic Achievement
Blackwell Publishing. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8599; Fax: 781-388-8232; e-mail: email@example.com; Web site: http://www.blackwellpublishing.com/jnl_default.asp
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Authoring Institution: N/A