In this article we attempt to reconstruct the tacit and implicit notions of quality in the humanities. This reconstruction is based on a series of semi-structured qualitative interviews with 33 humanities scholars. Applying Max Weber's theory of authority, we argue the quality notions have two different sources--external and internal. External…

Evaluators play a central role in assessments of researchers' performance for reward, but the nature of their role and influence is not well understood. Ongoing reliance on evaluator judgement is typically justified as a need for referees in contests for reward, because quantitative performance measures alone can be subject to distortion. Yet, if…

European Research Council Grants (ERC) have become the most important vehicle for funding scientific research in the EU. Since their creation in 2007, they have provided funding for around 7,000 of the nearly 70,000 proposals for research projects submitted. With a success rate of about 11%, these Grants are highly competitive. Despite major…

In many sectors and in many respects, interdisciplinarity has made progress in recent decades, but less so when it comes to evaluating interdisciplinary work. Challenges remain, especially regarding what counts as 'good' interdisciplinarity. While previous reviews describe broad trends contributing to these challenges, high-level observations are…

The number of real-world laboratories (RwLs) as research settings to address sustainability problems by using collaborative and experimental approaches has been growing steadily over the past years. RwLs are widely considered promising settings for the production of action-orientated knowledge in order to contribute solving wicked real-world…

This article looks at the effects of a national policy of research prioritization in the years following Ireland's economic crisis. A national research prioritization exercise initiated by policymakers redefined the purpose of higher education research, and designed policies in line with this approach. Placing research for enterprise to the fore,…

There is increasing attention on evidencing research impact and applying a systems thinking perspective in public health. However, there is limited understanding of the extent to which and how public health research that applies a systems thinking perspective contributes to changes in system behaviour and improved population health outcomes. This…

Canada's research policy over the past three decades has steered national science toward industrial innovation. Yet, the outcomes of this policy orientation are debatable. Macro-level indicators continue to show weak performance in firm innovation, and there is also evidence that this policy stance has had material effects on science at the meso…

The use of indicators in research policy and evaluation is widely perceived as problematic. Responding to demands for explicit normative framings in STI governance, I propose an agenda for transforming the place and role of indicators in policy. Given that expert advice should not separate knowledge formation from decision-making under conditions…

Universities are organizational structures with individual activity mixes or strategies that lead to different performance levels by mission. Evaluation techniques based on performance indicators or rankings risk rewarding just a specific type of university and undermining university diversification: they usually introduce homogenizing pressures…

Assessing societal impacts of research is more difficult than assessing advances in knowledge. Methods to evaluate research impact on policy processes and outcomes are especially underdeveloped, and are needed to optimize the influence of research on policy for addressing complex issues such as chronic diseases. Contribution analysis (CA), a…