ERIC Number: ED382645
Record Type: RIE
Publication Date: 1993-Nov
Reference Count: N/A
Deriving Comparable Scores for Computer Adaptive and Conventional Tests: An Example Using the SAT.
Eignor, Daniel R.
Procedures used to establish the comparability of scores derived from the College Board Admissions Testing Program (ATP) computer adaptive Scholastic Aptitude Test (SAT) prototype and the paper-and-pencil SAT are described in this report. Both the prototype, which is made up of Verbal and Mathematics computer adaptive tests (CATs), and a form of the paper-and-pencil test were administered to more than 500 examinees using a random groups counterbalanced design. Both linear and equipercentile procedures were used for equating in each of the separate testing orders (paper-and-pencil followed by CAT, or CAT, then paper-and-pencil). Data were not pooled across the orders because the groups were not randomly equivalent due to administrative problems. The linear procedure was chosen for each test (Verbal or Mathematical) for each order, and results from the two orders were averaged. The final Verbal and Mathematical CAT conversions were quite similar to the paper-and-pencil conversions, although the two conversions for Verbal and two conversions for Mathematical did differ by as much as 20 scaled score points in certain regions of the scale. Ten tables and 10 figures illustrate the analysis. (Contains 11 references.) (Author/SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: Educational Testing Service, Princeton, NJ.
Identifiers: Equipercentile Equating; Linear Equating Method; Paper and Pencil Tests; Scholastic Aptitude Test
Note: Version of a paper presented at the Annual Meeting of the National Council on Measurement in Education (Atlanta, GA, April 13-15, 1993).