ERIC Number: EJ829916
Record Type: Journal
Publication Date: 2009
Abstractor: As Provided
Reference Count: 20
Using Log-Linear Smoothing to Improve Small-Sample DIF Estimation
Puhan, Gautam; Moses, Timothy P.; Yu, Lei; Dorans, Neil J.
Journal of Educational Measurement, v46 n1 p59-83 Spr 2009
This study examined the extent to which log-linear smoothing could improve the accuracy of differential item functioning (DIF) estimates in small samples of examinees. Examinee responses from a certification test were analyzed using White examinees in the reference group and African American examinees in the focal group. Using a simulation approach, separate DIF estimates for seven small-sample-size conditions were obtained using unsmoothed (U) and smoothed (S) score distributions. These small sample U and S DIF estimates were compared to a criterion (i.e., DIF estimates obtained using the unsmoothed total data) to assess their degree of variability (random error) and accuracy (bias). Results indicate that for most studied items smoothing the raw score distributions reduced random error and bias of the DIF estimates, especially in the small-sample-size conditions. Implications of these results for operational testing programs are discussed.
Descriptors: Test Items, Reference Groups, Testing Programs, Raw Scores, African Americans, Test Bias, Sample Size, Whites, Focus Groups, Simulation
Blackwell Publishing. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8599; Fax: 781-388-8232; e-mail: email@example.com; Web site: http://www.blackwellpublishing.com/jnl_default.asp
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Authoring Institution: N/A