NotesFAQContact Us
Search Tips
ERIC Number: ED464117
Record Type: Non-Journal
Publication Date: 2002-Apr
Pages: 25
Abstractor: N/A
Reference Count: N/A
Sample Selection Effect on AP Multiple-Choice Score to Composite Score Scaling.
Yang, Wen-Ling; Dorans, Neil J.; Tateneni, Krishna
Scores on the multiple-choice sections of alternate forms are equated through anchor-test equating for the Advanced Placement Program (AP) examinations. There is no linkage of free-response sections since different free-response items are given yearly. However, the free-response and multiple-choice sections are combined to produce a composite. Therefore, to derive new-form cut scores on the composite score scale that are comparable to the old-form cut scores, the multiple-choice score of the AP examinations are linked to the composite score through single-group linking design. This study investigates whether the multiple-choice to composite linking functions remain invariant over subgroups by region for two AP examinations using 3 years of test data. The region groups are of interest because the AP program administers different free-response sections to different time-zone regions as a precaution for security reasons. The study focused on: (1) how invariant cut scores are across regions; and (2) whether the small sample size for some regional groups presents particular problems for assessing linking invariance. Both equipercentile and linear linking methods were applied. The equatability index proposed by N. Dorans and P. Holland (2000) is used to evaluate the invariance of the linking functions, and the cross-classification approach is used to evaluate the invariance of the composite cut scores. Overall, the curvilinear linkings across regions seem to hold up reasonably well. Nevertheless, more examinations are needed to decide whether the linkings in the small regions contain enough data to support the use of weak models such as equipercentile scaling. The strong smoothing associated with the linear linking model, as expected, reduces the variability of linkages across regions. However, more work is needed to see if less strong models can be found for improving consistency over the unsmoothed linkings without incurring the bias apparent with the linear linkings. (Author/SLD)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Advanced Placement Examinations (CEEB)