ERIC Number: EJ799823
Record Type: Journal
Publication Date: 2008-Jun
Abstractor: As Provided
Reference Count: 47
Measurement Invariance versus Selection Invariance: Is Fair Selection Possible?
Borsman, Denny; Romeijn, Jan-Willem; Wicherts, Jelte M.
Psychological Methods, v13 n2 p75-98 Jun 2008
This article shows that measurement invariance (defined in terms of an invariant measurement model in different groups) is generally inconsistent with selection invariance (defined in terms of equal sensitivity and specificity across groups). In particular, when a unidimensional measurement instrument is used and group differences are present in the location but not in the variance of the latent distribution, sensitivity and positive predictive value will be higher in the group at the higher end of the latent dimension, whereas specificity and negative predictive value will be higher in the group at the lower end of the latent dimension. When latent variances are unequal, the differences in these quantities depend on the size of group differences in variances relative to the size of group differences in means. The effect originates as a special case of Simpson's paradox, which arises because the observed score distribution is collapsed into an accept-reject dichotomy. Simulations show the effect can be substantial in realistic situations. It is suggested that the effect may be partly responsible for overprediction in minority groups as typically found in empirical studies on differential academic performance. A methodological solution to the problem is suggested, and social policy implications are discussed. (Contains 6 figures and 3 footnotes.)
Descriptors: Test Items, Minority Groups, Measurement, Scores, Simulation, Prediction, Academic Achievement, Public Policy, Test Bias, Psychometrics, Generalization, Futures (of Society), Test Reliability
American Psychological Association. Journals Department, 750 First Street NE, Washington, DC 20002-4242. Tel: 800-374-2721; Tel: 202-336-5510; Fax: 202-336-5502; e-mail: email@example.com; Web site: http://www.apa.org/publications
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Authoring Institution: N/A