ERIC Number: ED331877
Record Type: RIE
Publication Date: 1991-Apr
Reference Count: N/A
The Effect of Sample Size on the Functioning of the Mantel-Haenszel Statistic.
Mazor, Kathleen M.; And Others
The Mantel-Haenszel (MH) procedure has become one of the most popular procedures for detecting differential item functioning. Valid results with relatively small numbers of examinees represent one of the advantages typically attributed to this procedure. In this study, examinee item responses were simulated to contain differentially functioning items, and then were analyzed at five sample sizes (2,000, 1,000, 500, 200, and 100) to compare detection rates. Five different 75-item tests were generated for each group. Results show that the MH procedure missed more than 30% of the differentially functioning items when groups of 2,000 were used. When 500 or fewer examinees were retained in each group, more than 50% of the differentially functioning items were missed. The items most likely to be undetected were those that were difficult, those with a small difference in item difficulty between the two groups, and poorly discriminating items. Three tables and four graphs describe the simulations. (Author/SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Identifiers: Mantel Haenszel Procedure
Note: Paper presented at the Annual Meeting of the National Council on Measurement in Education (Chicago, IL, April 1991).