Special Issue Paper
Issues relating to confounding and meta-analysis when including non-randomized studies in systematic reviews on the effects of interventions
Article first published online: 6 NOV 2012
Copyright © 2012 John Wiley & Sons, Ltd.
Research Synthesis Methods
Special Issue: Inclusion of Non-Randomized Studies in Systematic Reviews
Volume 4, Issue 1, pages 26–35, March 2013
How to Cite
Valentine, J. C. and Thompson, S. G. (2013), Issues relating to confounding and meta-analysis when including non-randomized studies in systematic reviews on the effects of interventions. Res. Synth. Method, 4: 26–35. doi: 10.1002/jrsm.1064
- Issue published online: 22 MAR 2013
- Article first published online: 6 NOV 2012
- Manuscript Accepted: 30 SEP 2012
- Manuscript Revised: 21 SEP 2012
- Manuscript Received: 17 OCT 2011
- non-randomized studies;
- systematic reviews
Confounding caused by selection bias is often a key difference between non-randomized studies (NRS) and randomized controlled trials (RCTs) of interventions.
Key methodological issues
In this third paper of the series, we consider issues relating to the inclusion of NRS in systematic reviews on the effects of interventions. We discuss whether potential biases from confounding in NRS can be accounted for, the limitations of current methods for attempting to do so, the different contexts of NRS and RCTs, the problems these issues create for reviewers, and a research agenda for the future.
Reviewers who are considering whether or not to include NRS in meta-analyses must weigh a number of factors. Including NRS may allow a review to address outcomes or pragmatic implementations of an intervention not studied in RCTs, but it will also increase the workload for the review team, as well as their required technical repertoire. Furthermore, the results of a synthesis involving NRS will likely be more difficult to interpret, and less certain, relative to the results of a synthesis involving only randomized studies. When both randomized and non-randomized evidence are available, we favor a strategy of including NRS and RCTs in the same systematic review but synthesizing their results separately.
Including NRS will often make the limitations of the evidence derived from RCTs more apparent, thereby guiding inferences about generalizability, and may help with the design of the next generation of RCTs. Copyright © 2012 John Wiley & Sons, Ltd.