The realist review/synthesis has become an increasingly prominent methodological approach to evidence synthesis that can inform policy and practice. While there are publication standards and guidelines for the conduct of realist reviews, published reviews often provide minimal detail regarding how they have conducted some methodological steps.…

Integrative data analyses have recently been shown to be an effective tool for researchers interested in synthesizing datasets from multiple studies in order to draw statistical or substantive conclusions. The actual process of integrating the different datasets depends on the availability of some common measures or items reflecting the same…

In 2013, Kovar and Ball published a literature review on the agricultural literacy research conducted from 1988 to 2011. As a result of their study, they located 49 articles published in that time frame. Since then, agricultural literacy research has been designated as the number one priority by the American Association of Agricultural Education's…

A diversity of approaches for critically appraising qualitative and quantitative evidence exist and emphasize different aspects. These approaches lack clear processes to facilitate rating the overall quality of the evidence for aggregated findings that combine qualitative and quantitative evidence. We draw on a meta-aggregation of implementation…

Predatory journals are a blemish on scholarly publishing and academia and the studies published within them are more likely to contain data that is false. The inclusion of studies from predatory journals in evidence syntheses is potentially problematic due to this propensity for false data to be included. To date, there has been little exploration…

Meta-analyses have become the gold standard for synthesizing evidence from multiple clinical trials, and they are especially useful when outcomes are rare or adverse since individual trials often lack sufficient power to detect a treatment effect. However, when zero events are observed in one or both treatment arms in a trial, commonly used…

We describe best practices in reporting reliability estimates in counseling research with consideration to precision, generalization, and diverse populations. We provide a historical context to reporting reliability estimates, the limitations of past practices, and new methods to address reliability generalization. We highlight best practices…

Background The CLUSTER model of searching was proposed as a systematic method of searching for studies for reviews of complex interventions. Aim: The method has not been evaluated before. This methodological review identified and evaluated a sample of evidence syntheses that have used CLUSTER. Methods: A forward citation search on the seed CLUSTER…

Rapid reviews have been widely employed to support timely decision-making, and limiting the search date is the most popular approach in published rapid reviews. We assessed the accuracy and workload of search date limits on the meta-analytical results to determine the best rapid strategy. The meta-analyses data were collected from the Cochrane…

Introduction: The What Works Clearinghouse (WWC) reviews rigorous research on educational interventions with a goal of identifying "what works" and making that information accessible to educators and policymakers. In rating the quality of causal research, the WWC has historically prioritized internal validity over external validity. One…

Data extraction is a crucial, yet labor-intensive and error-prone part of evidence synthesis. To date, efforts to harness machine learning for enhancing efficiency of the data extraction process have fallen short of achieving sufficient accuracy and usability. With the release of large language models (LLMs), new possibilities have emerged to…

To enable optimal decision-making based on the best evidence available, open syntheses are called for. To make data accessible and comprehensible even for decision-makers without proficient knowledge in meta-analysis, a graphical user interface (GUI) provides flexible data visualizations including interpretation aids. Moreover, due to a growing…

During drug development, evidence can emerge to suggest a treatment is more effective in a specific patient subgroup. Whilst early trials may be conducted in biomarker-mixed populations, later trials are more likely to enroll biomarker-positive patients alone, thus leading to trials of the same treatment investigated in different populations. When…

The addition of research-focused experiences to undergraduate chemistry laboratory courses has been shown to bolster student learning, enhance student retention in STEM, and improve student self-identity as scientists. In the area of synthetic organic chemistry, the preparation of libraries of compounds with novel optical and electronic properties…

When structure-property relationships are discussed in inorganic chemistry and materials science, the common perception is that materials with the same composition and atomic arrangement have the same properties. In this laboratory experiment, we show that "processing"--the exact conditions under which materials are made--can in fact…