ERIC Number: EJ937769
Record Type: Journal
Publication Date: 2011
Abstractor: As Provided
Reference Count: N/A
The Dependability of the General Factor of Intelligence: Why Small, Single-Factor Models Do Not Adequately Represent "g"
Major, Jason T.; Johnson, Wendy; Bouchard, Thomas J., Jr.
Intelligence, v39 n5 p418-433 Sep-Oct 2011
Floyd, Shands, Rafael, Bergeron and McGrew (2009) used generalizability theory to test the reliability of general-factor loadings and to compare three different sources of error in them: the test battery size, the test battery composition, the factor-extraction technique, and their interactions. They found that their general-factor loadings were moderately to strongly dependable. We replicated the methods of Floyd et al. (2009) in a different sample of tests, from the Minnesota Study of Twins Reared Apart (MISTRA). Our first hypothesis was that, given the greater diversity of the tests in MISTRA, the general-factor loadings would be less dependable than in Floyd et al. (2009). Our second hypothesis, contrary to the positions of Floyd et al. (2009) and Jensen and Weng (1994), was that the general factors from the small, randomly-formed test batteries would differ substantively from the general factor from a well-specified hierarchical model of all available tests. Subtests from MISTRA were randomly selected to form independent and overlapping batteries of 2, 4 and 8 tests in size, and the general-factor loadings of eight probe tests were obtained in each battery by principal components analysis, principal factor analysis and maximum likelihood estimation. Results initially indicated that the general-factor loadings were unexpectedly more dependable than in Floyd et al. (2009); however, further analysis revealed that this was due to the greater diversity of our probe tests. After adjustment for this difference in diversity, and consideration of the representativeness of our probe tests versus those of Floyd et al. (2009), our first hypothesis of lower dependability was confirmed in the overlapping batteries, but not the independent ones. To test the second hypothesis, we correlated "g" factor scores from the random test batteries with "g" factor scores from the VPR model; we also calculated special coefficients of congruence on the same relation. Consistent with our second hypothesis, the general factors from small non-hierarchical models were found to not be reliable enough for the purposes of theoretical research. We discuss appropriate standards for the construction and factor analysis of intelligence test batteries. (Contains 6 tables.)
Descriptors: Generalizability Theory, Intelligence, Intelligence Tests, Twins, Replication (Evaluation), Factor Analysis, Maximum Likelihood Statistics, Reliability
Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: firstname.lastname@example.org; Web site: http://www.elsevier.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A