ERIC Number: ED462410
Record Type: RIE
Publication Date: 2001-Dec
Toward a Framework for Validating Gains under High-Stakes Conditions. CSE Technical Report.
Koretz, Daniel M.; McCaffrey, Daniel F.; Hamilton, Laura S.
Although high-stakes testing is now widespread, methods for evaluating the validity of gains obtained under high-stakes conditions are poorly developed. This report presents an approach for evaluating the validity of inferences based on score gains on high-stakes tests. It describes the inadequacy of traditional validation approaches for validating gains under high-stakes conditions and outlines an alternative validation framework for conceptualizing meaningful and inflated score gains. The report draws on this framework to suggest a classification of forms of test preparation and their likely effects on the validity of gains. Finally, it suggests concrete directions for validation efforts that would be consistent with the framework. An appendix contains a mathematical model of the validity of gains. (Contains 3 figures and 23 references.) (Author/SLD)
Descriptors: Achievement Gains, Elementary Secondary Education, High Stakes Tests, Models, Scores, Validity
UCLA/Center for the Study of Evaluation, 301 GSE&IS, Box 951522, Los Angeles, CA 90095-1522 ($4.50). Tel: 310-206-1532. For full text: http://www.cse.ucla.edu/CRESST/Reports/TR551.pdf.
Publication Type: Reports - Descriptive
Education Level: N/A
Sponsor: Office of Educational Research and Improvement (ED), Washington, DC.
Authoring Institution: California Univ., Los Angeles. Center for the Study of Evaluation.; National Center for Research on Evaluation, Standards, and Student Testing, Los Angeles, CA.