ERIC Number: EJ1130485
Record Type: Journal
Publication Date: 2017
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1350-293X
EISSN: N/A
Evaluation Study Design--A Pluralist Approach to Evidence
Fives, Allyn; Canavan, John; Dolan, Pat
European Early Childhood Education Research Journal, v25 n1 p153-170 2017
There is significant controversy over what counts as evidence in the evaluation of social interventions. It is increasingly common to use methodological criteria to rank evidence types in a hierarchy, with Randomised Controlled Trials (RCTs) at or near the highest level. Because of numerous challenges to a hierarchical approach, this article offers a Matrix (or typology) of evaluation evidence, which is justified by the following two lines of argument. First, a pluralist approach to evidence is defended. Starting from the principle of methodological aptness, it is argued that different types of research question are best answered by different types of study. This article will address some of the key issues in the debate on RCTs (the ethical principles of duty of care and social utility, the role of random allocation, and threats to internal validity) in respect of which two opposing paradigms provide irreconcilable arguments, namely the position that RCTs are the "gold standard" and the opposing position that RCTs are often if not always inappropriate in social settings. The second line of argument is that evaluations often require both experimental and non-experimental research in tandem. In a pluralist approach, non-causal evidence is seen as a vital component in order to evaluate interventions in mixed methods studies (as part of evidence-based practice [EBP]) and also is important for good practice itself (as part of practice-based evidence [PBE]). The article concludes by providing a detailed description of what an Evaluation Evidence Matrix can and cannot do.
Descriptors: Evaluation Methods, Evaluation Research, Randomized Controlled Trials, Ethics, Social Influences, Test Validity, Evidence, Intervention, Matrices, Mixed Methods Research, Research Design
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A