ERIC Number: EJ1091965
Record Type: Journal
Publication Date: 2016
Abstractor: As Provided
Reference Count: 79
The Validity of Value-Added Estimates from Low-Stakes Testing Contexts: The Impact of Change in Test-Taking Motivation and Test Consequences
Finney, Sara J.; Sundre, Donna L.; Swain, Matthew S.; Williams, Laura M.
Educational Assessment, v21 n1 p60-87 2016
Accountability mandates often prompt assessment of student learning gains (e.g., value-added estimates) via achievement tests. The validity of these estimates have been questioned when performance on tests is low stakes for students. To assess the effects of motivation on value-added estimates, we assigned students to one of three test consequence conditions: (a) an aggregate of test scores is used solely for institutional effectiveness purposes, (b) personal test score is reported to the student, or (c) personal test score is reported to faculty. Value-added estimates, operationalized as change in performance between two testing occasions for the same individuals where educational programming was experienced between testing occasions, were examined across conditions, in addition to the effects of test-taking motivation. Test consequences did not impact value-added estimates. Change in test-taking motivation, however, had a substantial effect on value-added estimates. In short, value-added estimates were attenuated due to decreased motivation from pretest to posttest.
Descriptors: Test Validity, Accountability, Achievement Tests, Scores, Disclosure, Selective Dissemination of Information, Achievement Gains, Cognitive Tests, Value Judgment, Learner Engagement, Likert Scales, Personality Traits, Gender Differences, Predictive Validity, Student Motivation, College Students, Measurement Objectives, Pretests Posttests
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research; Tests/Questionnaires
Education Level: Higher Education; Postsecondary Education
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Student Opinion Survey