ERIC Number: ED395025
Record Type: Non-Journal
Publication Date: 1990-Apr
Reference Count: N/A
Effects of Coaching on the Validity of the SAT: A Simulation Study.
The effects of student coaching in preparation for the College Board Scholastic Aptitude Test (SAT) on the predictive validity of this test for freshman year performance were studied using data on 1985 freshman year students from four colleges. After the validity of the SAT was estimated for each school, a given proportion of students was picked, and a given magnitude of score gains was added to the observed SAT verbal and mathematics scores. The validity of the new SAT scores was then estimated and compared to the observed validity measures. Each simulation provides an estimate of the change in validity resulting from a hypothetical coaching effect. Sample sizes from the 4 colleges were: (1) 996 students from a highly selective school; (2) 1,346 from a moderately selective school; (3) 386 from a small, less selective school; and (4) 203 from a small religiously affiliated college. Results indicated that the validity indicators of the SAT in highly selective colleges are more contaminated by coaching effects than in less selective colleges. Results also indicate that changes in the levels of coaching do not seem large enough to account for the observed decline in the validity of the SAT over the past 10 years. Appendix A provides a detailed discussion of the second college, and Appendix B describes decrements in multiple partial correlation coefficients. (Contains 5 figures, 14 tables, and 19 references.) (SLD)
Publication Type: Reports - Research; Tests/Questionnaires
Education Level: N/A
Authoring Institution: Educational Testing Service, Princeton, NJ.
Identifiers - Assessments and Surveys: SAT (College Admission Test)