NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ827260
Record Type: Journal
Publication Date: 2009
Pages: 17
Abstractor: As Provided
Reference Count: 28
ISSN: ISSN-0013-1644
Construct Validity Invariance and Discrepancies in Meta-Analytic Effect Sizes Based on Different Measures: A Simulation Study
Nugent, William R.
Educational and Psychological Measurement, v69 n1 p62-78 2009
Critical to meta-analysis is the presumption that effect sizes based on different measures are directly comparable. Recent theoretical work has shown that an invariance condition--universe score, or construct, validity invariance--must hold for either observed score or reliability-corrected effect sizes based on different measures to be directly comparable. To date, however, no research has been done investigating how crucial violations of this invariance condition are for either effect size discrepancy across different measures or the outcomes of a meta-analysis. This article reports the results of a simulation study of the possible effects that violations of construct validity invariance have on (a) the differences in population construct level standardized mean difference effect sizes based on different measurement procedures; (b) the variability in population construct level correlation effect sizes based on different measurement procedures; and (c) the results of a meta-analysis. Results suggest that considerable variability in effect sizes can exist across measurement procedures that fail to meet universe score validity invariance and that this variability has the potential to negatively affect meta-analytic results. (Contains 3 figures and 1 table.)
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A