ERIC Number: EJ723407
Record Type: Journal
Publication Date: 2005
Reference Count: 27
A Comparison of Four Methods for Detecting Differential Item Functioning in Ordered Response Items
Kristjansson, Elizabeth; Aylesworth, Richard; Mcdowell, Ian; Zumbo, Bruno D.
Educational and Psychological Measurement, v65 n6 p935-953 2005
Item bias is a major threat to measurement validity. Methods for detecting differential item functioning (DIF) are now commonly used to identify potentially biased items. DIF detection methods for dichotomous items are well developed, but those for ordinal items are less well developed. In this article, the authors compare four methods for detecting DIF in ordinal items: the Mantel, generalized Mantel-Haenszel (GMH), logistic discriminant function analysis (LDFA), and unconstrained cumulative logits ordinal logistic regression (UCLOLR). Factors varied include type of DIF, group ability differences, studied item discrimination, skewness in ability distributions, and sample size ratio. All procedures had good Type I error control as well as high power for detecting uniform DIF. However, the Mantel could not detect nonuniform DIF, and the LDFA also performed poorly in detecting nonuniform DIF, particularly when item discrimination was high. The UCLOLR and GMH performed extremely well under conditions simulated in this study. Implications for research and practice are discussed.
Descriptors: Discriminant Analysis, Test Bias, Multivariate Analysis, Regression (Statistics), Evaluation Methods, Test Items, Error of Measurement
SAGE Publications, 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243 (Toll Free); Fax: 800-583-2665 (Toll Free).
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Authoring Institution: N/A