ERIC Number: EJ717934
Record Type: Journal
Publication Date: 2005
Efficiency of the Mantel, Generalized Mantel-Haenszel, and Logistic Discriminant Function Analysis Methods in Detecting Differential Item Functioning for Polytomous Items
Su, Ya-Hui; Wang, Wen-Chung
Applied Measurement in Education, v18 n4 p313-350 2005
Simulations were conducted to investigate factors that influence the Mantel, generalized Mantel-Haenszel (GMH), and logistic discriminant function analysis (LDFA) methods in assessing differential item functioning (DIF) for polytomous items. The results show that the magnitude of DIF contamination in the matching score, as measured by the average signed area between the 2 item characteristic curves of the reference and focal groups (Raju, 1988), was more crucial than the percentage of DIF items in a test in determining the Type I error (false positives) of the 3 methods. As long as the average signed area approached zero, all 3 methods maintained control over their Type I error, even when the percentage of DIF items was as high as 20%. The Mantel and LDFA methods yielded higher power (true positives) than the GMH method under all but the balanced DIF patterns. Test purification procedures were useful in improving control over Type I error under the constant DIF pattern.
Descriptors: Discriminant Analysis, Test Bias, Research Methodology, Test Items, Item Response Theory, Functional Behavioral Assessment, Simulation, Evaluation Methods
Lawrence Erlbaum Associates, Inc., Journal Subscription Department, 10 Industrial Avenue, Mahwah, NJ 07430-2262. Tel: 800-926-6579 (Toll Free); e-mail: firstname.lastname@example.org.
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Authoring Institution: N/A