ERIC Number: ED335366
Record Type: RIE
Publication Date: 1991-Apr-25
Reference Count: N/A
A Procedure To Detect Test Bias Present Simultaneously in Several Items.
Shealy, Robin; Stout, William
A statistical procedure is presented that is designed to test for unidirectional test bias existing simultaneously in several items of an ability test, based on the assumption that test bias is incipient within the two groups' ability differences. The proposed procedure--Simultaneous Item Bias (SIB)--is based on a multidimensional item response theory (IRT) approach. SIB statistically tests for bias in one or more items at a time, and is corrected for the inflation (or deflation) of the test statistic due to target ability difference, a valid group difference that is conceptually independent of psychological test bias. The correction plays the same role as does the practice of including the single studied item in the matching criterion score in the Mantel-Haenszel (MH) procedure that is adapted for test responses. It is shown through the initial portion of an extensive simulation study in progress with 84 cases that, with the correction in place, the procedure performs as well as does the MH procedure in many cases when there is a single biased item, and it performs well in the case of multiple item test bias. Twelve tables present data from the simulation, and four graphs illustrate study findings. A 20-item list of references is included. (Author/SLD)
Publication Type: Reports - Evaluative
Education Level: N/A
Sponsor: Office of Naval Research, Arlington, VA. Cognitive and Neural Sciences Div.
Authoring Institution: Illinois Univ., Urbana. Dept. of Statistics.
Identifiers: Ability Estimates; Mantel Haenszel Procedure; Simultaneous Item Bias Procedure