ERIC Number: EJ722979
Record Type: Journal
Publication Date: 2005-Dec
Reference Count: 9
Accuracy of Random Groups Equating with Very Small Samples
Journal of Educational Measurement, v42 n4 p309-330 Dec 2005
This study investigated the effectiveness of equating with very small samples using the random groups design. Of particular interest was equating accuracy at specific scores where performance standards might be set. Two sets of simulations were carried out, one in which the two forms were identical and one in which they differed by a tenth of a standard deviation in overall difficulty. These forms were equated using mean equating, linear equating, unsmoothed equipercentile equating, and equipercentile equating using two through six moments of log-linear presmoothing with samples of 25, 50, 75, 100, 150, and 200. The results indicated that identity equating was preferable to any equating method when samples were as small as 25. For samples of 50 and above, the choice of an equating method over identity equating depended on the location of the passing score relative to examinee performance. If passing scores were located below the mean, where data were sparser, mean equating produced the smallest percentage of misclassified examinees. For passing scores near the mean, all methods produced similar results with linear equating being the most accurate. For passing scores above the mean, equipercentile equating with 2- and 3-moment presmoothing were the best equating methods. Higher levels of presmoothing did not improve the results.
Descriptors: Equated Scores, Simulation, Performance Based Assessment, Evaluation Methods, Sample Size
Journal Customer Services, Blackwell Publishing, 350 Main Street, Malden, MA 02148. Tel: 800-835-6770 (Toll Free); Fax: 781-388-8232; e-mail: firstname.lastname@example.org.
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A