ERIC Number: ED233085
Record Type: RIE
Publication Date: 1983-Apr
Reference Count: 0
Accounting for Statistical Artifacts in Item Bias Research.
Shepard, Lorrie; And Others
Theoretically preferred item response theory (IRT) bias detection procedures were applied to both a mathematics achievement and vocabulary test. The data were from black seniors and white seniors on the High School and Beyond data files. We wished to account for statistical artifacts by conducting cross-validation or replication studies. Therefore, each analysis was repeated on randomly equivalent samples of blacks and whites (n's=1500). Furthermore, to establish a baseline for judging bias indices that might be attributable only to sampling fluctuations, bias analyses were conducted comparing randomly selected groups of whites. Also, to assess the effect of mean group differences on the appearance of bias, pseudo-ethnic groups were created, i.e., samples of whites were selected to simulate the average black-white difference. The validity and sensitivity of the IRT bias indices were supported by several findings. The pattern of between study correlations showed high consistency for parallel ethnic analyses where bias was plausibly present. Also, the indices met the discriminant validity test. Overall the sums-of-squares statistics (weighted by the inverse of the variance errors) were judged to be the best indices for quantifying item characteristic curve differences between groups. (PN)
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Sponsor: Colorado Univ., Boulder. Council on Research and Creative Work.; Colorado Univ., Boulder. School of Education.
Authoring Institution: N/A
Identifiers: High School and Beyond (NCES)
Note: Paper presented at the Annual Meeting of the American Educational Research Association (67th, Montreal, Quebec, April 11-15, 1983).