Special Issue Paper
Issues relating to confounding and meta-analysis when including non-randomized studies in systematic reviews on the effects of interventions
Article first published online: 6 NOV 2012
Copyright © 2012 John Wiley & Sons, Ltd.
Research Synthesis Methods
Special Issue: Inclusion of Non-Randomized Studies in Systematic Reviews
Volume 4, Issue 1, pages 26–35, March 2013
How to Cite
Valentine, J. C. and Thompson, S. G. (2013), Issues relating to confounding and meta-analysis when including non-randomized studies in systematic reviews on the effects of interventions. Res. Synth. Method, 4: 26–35. doi: 10.1002/jrsm.1064
- Issue published online: 22 MAR 2013
- Article first published online: 6 NOV 2012
- Manuscript Accepted: 30 SEP 2012
- Manuscript Revised: 21 SEP 2012
- Manuscript Received: 17 OCT 2011
- 2000. Meta-analysis of heterogeneously reported study results: a Bayesian approach. In Stangl DK, Berry DA (eds), Meta-analysis in Medicine and Health Policy. Marcel Dekker, New York, pp 29–63. , , , .
- 1996. Identification of causal effects using instrumental variables. J Am Stat Assoc 91: 444–455. , , .
- 1990. Instrumental Variables. Cambridge University Press, Cambridge. , .
- 1963. Experimental and Quasi-experimental Designs for Research. Rand McNally, Chicago. , .
- 2007. Bounds on potential risks and causal risk differences under assumptions about confounding parameters. Stat Med 26: 5125–5135. , , .
- Cochrane Non-Randomized Studies Methods Group. 2010. Classifying non-randomised studies (NRS) and the assessing the risk of bias for a systematic review. 18th Cochrane Colloquium, Keystone, Colorado.
- 2008. Three conditions under which experiments and observational studies produce comparable causal estimates: new findings from within-study comparisons. J Policy Anal Manage 27: 724–750. , , .
- 1998. Choosing between randomised and non-randomised studies: a systematic review. Health Technol Assess 2: 1–124. , , , , , .
- 1998. Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. Stat Med 17: 2265–2281. .
- 2003. Evaluating non-randomized intervention studies. Health Technol Assess 7: 1–179. , , , , , , , .
- 2001. Systematic reviews of observational studies. In: Egger M, Davey Smith G, Altman DG (eds), Systematic Reviews in Health Care: Meta-analysis in Context. BMJ Books, Cornwall, UK, pp. 211–227. , , .
- The Fibrinogen Studies Collaboration. 2009. Systematically missing confounders in individual participant data meta-analysis of observational cohort studies. Stat Med 28: 1218–1237.
- 2011. Meta-analyses of adverse effects data derived from randomised controlled trials as compared to observational studies: methodological overview. PLoS Med 8(5): e1001026. doi: 10.1371/journal.pmed.1001026. , , .
- Higgins JPT, Altman DG, Sterne JAC (eds). 2008. Assessing risk of bias in included studies. In: Higgins JPT, Green S (eds). Cochrane Handbook for Systematic Reviews of Interventions. John Wiley, Chichester, pp. 187–242.
- 2012. Issues relating to study design and risk of bias when including non-randomized studies in systematic reviews on the effects of interventions. Res Synth Methods. DOI: 10.1002/jrsm.1064 , , , , , , .
- 1965. The environment and disease: association or causation? Proc R Soc Med 58: 295–300. .
- 1739/1740. A treatise of human nature: being an attempt to introduce the experimental method of reasoning into moral subjects. Available online at http://www.gutenberg.org/etext/4705. .
- 2005. Robust, accurate confidence intervals with a weak instrument: quarter of birth and education. Journal of the Royal Statistical Society, Series A 168: 109–126. , .
- 1999. Does alcoholics anonymous work? The results from a meta-analysis of controlled experiments. Subst Use Misuse 34: 1897–1916. , .
- 1992. Juvenile delinquency treatment: a meta-analytic inquiry into the variability of effects. In Cook TD, Cooper H, Cordray DS, Hartmann H, Hedges LV, Light RJ, Louis TA, Mosteller F (eds). Meta-analysis for Explanation: A Casebook. Russell Sage Foundation, New York, NY, pp. 83–127. .
- 2001. The way in which intervention studies have “personality” and why it is important to meta-analysis. Eval Health Prof 24: 236–254. , .
- 2011. Comprehensive evaluations of the adverse effects of drugs: importance of appropriate study selection and data sources. Therapeutic Advances in Drug Safety 2: 59–68. , , .
- 2000. A systematic review of comparisons of effect sizes derived from randomised and non-randomised studies. Health Technol Assess 34: 1–154. , , , , , .
- 1843. A system of logic, ratiocinative and inductive. Available online at http://www.gutenberg.org/ebooks/27942. .
- 2005. The impact of program developers as evaluators on criminal recidivism: results from meta-analyses of experimental and quasi-experimental research. Journal of Experimental Criminology 1: 435–450. , .
- 2009. Including non-randomized studies. In , (eds), Cochrane Handbook for Systematic Reviews of Interventions, version 5.0.2. The Cochrane Collaboration, 2009. Available from: www.cochrane-handbook.org [September 2009]. , , , .
- An introduction to methodological issues when including non-randomized studies in systematic reviews on the effects of interventions. Research Synthesis Methods. , , , , , . (in press).
- 2010. Development of a combined database for meta-epidemiological research. Research Synthesis Methods 1: 212–225. , , , et al.
- 2008. Can nonrandomized experiments yield accurate answers? A randomized experiment comparing random and nonrandom assignments. J Am Stat Assoc 103: 1334–1643. , , .
- 2002. Experimental and Quasi-experimental Designs for Generalized Causal Inference. Houghton, Mifflin and Company, Boston, MA. , , .
- 2012. Structural approach to bias in meta-analysis. Research Synthesis Methods 2: 223–237. .
- 2007. Analysis of observational studies in the presence of treatment selection bias. Effects of invasive cardiac management on AMI survival using propensity score and instrumental variable methods. J Am Med Assoc 297: 278–285. , , , , , .
- 1960. Regression-discontinuity analysis: an alternative to the ex post facto experiment. J Educ Psychol 51: 309–317. , .
- 2011. A proposed method of bias adjustment methods for meta-analyses of published observational studies. Int J Epidemiol 40: 765–777. , , , , , , , .
- 1984. Research Design for Program Evaluation: the Regression-Discontinuity Approach. Sage Publications, Beverly Hills, CA. .
- 2009. Bias modelling in evidence synthesis. J R Stat Soc A Stat Soc 172: 21–47. , , , .
- 2011. Replication in prevention science. Prev Sci 12: 103–117. , , , , , , , , .
- 2009. Validity characteristics of randomized and quasi-experiments in studies of school-based prevention programs. Poster presented at the annual meeting of the American Psychological Association, Toronto. , , , , , , .
- 2008. A systematic and transparent approach for assessing the methodological quality of intervention effectiveness research: the Study Design and Implementation Assessment Device (Study DIAD). Psychol Methods 13: 130–149. , .
- 2010. How many studies do you need?: A primer on statistical power for meta-analysis. J Educ Behav Stat 35: 215–247. , , .
- 2009. Models for potentially biased evidence in meta-analysis using empirically based priors. J R Stat Soc A Stat Soc 172: 119–136. , , , , .