ERIC Number: ED395947
Record Type: RIE
Publication Date: 1988-Feb
Reference Count: N/A
Checking the Equivalence of Nearly Identical Test Editions.
Dorans, Neil J.; Lawrence, Ida M.
A procedure for checking the score equivalence of nearly identical editions of a test is described. The procedure employs the standard error of equating (SEE) and utilizes graphical representation of score conversion deviation from the identity function in standard error units. Two illustrations of the procedure involving Scholastic Aptitude Test (SAT) data are presented. Results from this kind of analysis could have implications for equating practices and test assembly. If the two versions of the operational SAT test had differed by more than two SEEs, it might have been necessary to compute separate equating functions for each order and to consider taking an average of the two functions or using separate functions for each order depending on the practical consequences of the option. If the equating function for one or more of the item orders had been shown to differ by more than two SEEs, then test assemblers would have been alerted to the fact that item order affects test properties and that item order needs to be taken into account when assembling tests. (Contains two figures, two tables, and four references.) (Author/SLD)
Publication Type: Reports - Evaluative
Education Level: N/A
Authoring Institution: Educational Testing Service, Princeton, NJ.
Identifiers: Equivalence Formation; Graphic Representation; Scholastic Aptitude Test; Standard Deviation