ERIC Number: EJ1167905
Record Type: Journal
Publication Date: 2018-Feb
Abstractor: As Provided
Test-Retest Reliability and Predictive Validity of the Implicit Association Test in Children
Rae, James R.; Olson, Kristina R.
Developmental Psychology, v54 n2 p308-330 Feb 2018
The Implicit Association Test (IAT) is increasingly used in developmental research despite minimal evidence of whether children's IAT scores are reliable across time or predictive of behavior. When test-retest reliability and predictive validity have been assessed, the results have been mixed, and because these studies have differed on many factors simultaneously (lag-time between testing administrations, domain, etc.), it is difficult to discern what factors may explain variability in existing test-retest reliability and predictive validity estimates. Across five studies (total N = 519; ages 6- to 11-years-old), we manipulated two factors that have varied in previous developmental research--lag-time and domain. An internal meta-analysis of these studies revealed that, across three different methods of analyzing the data, mean test-retest (rs of 0.48, 0.38, and 0.34) and predictive validity (rs of 0.46, 0.20, and 0.10) effect sizes were significantly greater than zero. While lag-time did not moderate the magnitude of test-retest coefficients, whether we observed domain differences in test-retest reliability and predictive validity estimates was contingent on other factors, such as how we scored the IAT or whether we included estimates from a unique sample (i.e., a sample containing gender typical and gender diverse children). Recommendations are made for developmental researchers that utilize the IAT in their research.
Descriptors: Pretests Posttests, Test Reliability, Predictive Validity, Association Measures, Children, Scores, Meta Analysis, Effect Size, Racial Attitudes, Sexual Identity, Coding, Correlation, Statistical Analysis, Multiple Regression Analysis
American Psychological Association. Journals Department, 750 First Street NE, Washington, DC 20002. Tel: 800-374-2721; Tel: 202-336-5510; Fax: 202-336-5502; e-mail: email@example.com; Web site: http://www.apa.org
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Sponsor: National Science Foundation (NSF)
Authoring Institution: N/A
Identifiers - Location: Washington
Grant or Contract Numbers: 1523632