ERIC Number: EJ1103862
Record Type: Journal
Publication Date: 2016
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0268-0939
EISSN: N/A
Selling "Impact": Peer Reviewer Projections of What Is Needed and What Counts in REF Impact Case Studies. A Retrospective Analysis
Watermeyer, Richard; Hedgecoe, Adam
Journal of Education Policy, v31 n5 p651-665 2016
The intensification of an audit culture in higher education is made no more apparent than with the growing prevalence of performance-based research funding systems like the UK's Research Excellence Framework (REF) and the introduction of new measures of assessment like "impact" or more specifically, the economic and societal impacts of research. Detractors of this regulatory intervention, however, question the legitimacy and credibility of such a system for, and focus within, the evaluation of research performance. Within this study, we specifically sought to understand the process of evaluating the impact of research by gaining unique access as observers of a simulated impact evaluation exercise populated by approximately n = 90 senior academic peer reviewers and user assessors, undertaken within one UK research-intensive university prior to and in preparation of its submission to REF2014. Over an intensive two-day period, we observed how peer reviewers and user assessors grouped into four overarching disciplinary panels went about deliberating and scoring impact, presented in the form of narrative-based case studies. Among other findings, our observations revealed that in their efforts to evaluate impact, peer reviewers were indirectly promoting a kind of impact mercantilism, where case studies that best sold impact were those rewarded with the highest evaluative scores.
Descriptors: Case Studies, Program Evaluation, Observation, Program Effectiveness, Ethnography, Peer Evaluation, Evidence, Relevance (Education), Stakeholders, Partnerships in Education, Research Methodology, Grantsmanship, Research Reports, Design Requirements, Financial Support, Foreign Countries
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom
Grant or Contract Numbers: N/A