Research Article

You have free access to this content

Graphical displays for meta-analysis: An overview with suggestions for practice

  1. Judith Anzures-Cabrera1,
  2. Julian P. T. Higgins2,*

Article first published online: 23 MAR 2010

DOI: 10.1002/jrsm.6

Issue

Research Synthesis Methods

Research Synthesis Methods

Volume 1, Issue 1, pages 66–80, January/March 2010

Additional Information

How to Cite

Anzures-Cabrera, J. and Higgins, J. P. T. (2010), Graphical displays for meta-analysis: An overview with suggestions for practice. Res. Synth. Method, 1: 66–80. doi: 10.1002/jrsm.6

Author Information

  1. 1

    Roche Products Ltd, Welwyn Garden City, U.K.

  2. 2

    MRC, Biostatistics Unit, Cambridge, U.K.

*MRC, Biostatistics Unit, Cambridge, U.K.

Publication History

  1. Issue published online: 21 APR 2010
  2. Article first published online: 23 MAR 2010
  3. Manuscript Accepted: 24 JAN 2010
  4. Manuscript Revised: 19 JAN 2010
  5. Manuscript Received: 9 SEP 2009

Funded by

  • MRC. Grant Number: U.1052.00.011

SEARCH

SEARCH BY CITATION

ARTICLE TOOLS

Get PDF (659K)

References

  • 1
    Barnard FR. One Picture is Worth Ten Thousand Words. Printers' Ink: New York, 1927; 114–115.
  • 2
    Borenstein M, Hedges LV, Higgins JPT, Rothstein H. Introduction to Meta-analysis. Wiley: Chichester, 2009.
  • 3
    Light RJ, Singer JD, Willett JB. The visual presentation and interpretation of meta-analyses. In The Handbook of Research Synthesis, CooperH, HedgesLV (eds), Chapter 28. Russell Sage Foundation: New York, 1994; 439–445.
  • 4
    Ferrer RL. Graphical methods for detecting bias in meta-analysis. Family Medicine 1998; 30:579–583.
  • 5
    DuMouchel W, Normand SL. Computer-modeling and graphical strategies for meta-analysis. Meta-analysis in Medicine and Health Policy, StanglDK, BerryDA (eds). Marcel Dekker: New York, 2000; 127–178.
  • 6
    Bax L, Ikeda N, Fukui N, Yaju Y, Tsuruta H, Moons KG. More than numbers: the power of graphs in meta-analysis. American Journal of Epidemiology 2009; 169:249–255.
  • 7
    Borman GD, Grigg JA. Visual and narrative interpretation. In The Handbook of Research Synthesis and Meta-analysis (2nd edn), CooperH, HedgesLV, ValentineJC (eds), Chapter 26. Russell Sage Foundation: New York, 2009; 497–519.
  • 8
    Higgins J.Cochrane Statistical Methods Group. Considerations and recommendations for figures in Cochrane reviews: graphs of statistical data, 2003. Available from: http://www.cochrane.org/resources/handbook/ (accessed 1 January 2010).
  • 9
    DerSimonian R, Kacker R. Random-effects model for meta-analysis of clinical trials: an update. Contemporary Clinical Trials 2007; 28:105–114.
  • 10
    Lewis S, Clarke M. Forest plots: trying to see the wood and the trees. British Medical Journal 2001; 322:1479–1480.
  • 11
    Egger M, Davey Smith G, Phillips AN. Meta-analysis: principles and procedures. British Medical Journal 1997; 315:1533–1537.
  • 12
    Moja L, Moschetti I, Liberati A. Understanding systematic reviews: the meta-analysis graph (also called ‘forest plot’). Internal and Emergency Medicine 2007; 2:140–142.
  • 13
    Ried K. Interpreting and understanding meta-analysis graphs. A practical guide. Australian Family Physician 2006; 35:635–638.
  • 14
    Schriger DL, Altman DG, Vetter JA, Heafner T, Moher D. Forest plots in reports of systematic reviews: a cross-sectional study reviewing current practice. International Journal of Epidemiology 2010; DOI: 10.1093/ije/dyp370.
  • 15
    Galbraith RF. A note on graphical presentation of estimated odds ratios from several clinical trials. Statistics in Medicine 1988; 7:889–894.
    Direct Link:
  • 16
    Sanders S, Glasziou PP, Del Mar CB, Rovers M. Antibiotics for acute otitis media in children. Cochrane Database of Systematic Reviews 2004; (1):CD000219.
  • 17
    DuMouchel W. Predictive cross-validation of Bayesian meta-analyses. Bayesian Statistics 5, BernardoJM, BergerJO, DawidAP, SmithAFM (eds). Oxford University Press: Oxford, 1996; 107–127.
  • 18
    Elvik R. Evaluating the statistical conclusion validity of weighted mean results in meta-analysis by analysing funnel graph diagrams. Accident Analysis and Prevention 1998; 30:255–266.
  • 19
    Ye Z, Liu EHC, Higgins JPT, Keavney Bd, Lowe GDO, Collins R, Danesh J. Seven haemostatic gene polymorphisms in coronary disease: meta-analysis of 66 155 cases and 91 307 controls. The Lancet 2006; 367:651–658.
  • 20
    Sutton AJ, Abrams KR. Bayesian methods in meta-analysis and evidence synthesis. Statistical Methods in Medical Research 2001; 10:277–303.
  • 21
    Van Houwelingen HC, Arends LR, Stijnen T. Advanced methods in meta-analysis: multivariate approach and meta-regression. Statistics in Medicine 2002; 21:589–624.
    Direct Link:
  • 22
    Smith TC, Spiegelhalter DJ, Thomas A. Bayesian approaches to random-effects meta-analysis: a comparative study. Statistics in Medicine 1995; 14:2685–2699.
    Direct Link:
  • 23
    Higgins JPT, Thompson SG, Spiegelhalter DJ. A re-evaluation of random-effects meta-analysis. Journal of the Royal Statistical Society Series A 2009; 172:137–159.
  • 24
    Lau J, Antman EM, Jimenez-Silva J, Kupelink B, Mosteller SF, Chalmers TC. Cumulative meta-analysis of therapeutic trials for myocardial infarction. New England Journal of Medicine 1992; 327:248–254.
  • 25
    Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts: treatments for myocardial infarction. Journal of the American Medical Association 1992; 268:240–248.
  • 26
    Lau J, Schmid CH, Chalmers TC. Cumulative meta-analysis of clinical trials: builds evidence for exemplary medical care. Journal of Clinical Epidemiology 1995; 48:45–57.
  • 27
    Pogue J, Yusuf S. Overcoming the limitations of current meta-anlysis of randomised controlled trials. The Lancet 1998; 351:47–52.
  • 28
    Ioannidis JPA, Contopoulos-Ioannidis DG, Lau J. Recursive cumulative meta-analysis: a diagnostic for the evolution of total randomized evidence from group and individual patient data. Journal of Clinical Epidemiology 1999; 52:281–291.
  • 29
    Bax L, Yu LM, Ikeda N, Tsuruta H, Moons KG. Development and validation of MIX: comprehensive free software for meta-analysis of causal research data. BMC Medical Research Methodology 2006; 6:50.
  • 30
    Barrowman NJ, Myers RA. Raindrop plots: a new way to display collections of likelihoods and distributions. American Statistician 2003; 57:268–274.
  • 31
    Light RJ, Pillemer DB. Summing Up: The Science of Reviewing Research. Harvard University Press: Cambridge, MA, 1984.
  • 32
    Sterne JAC, Egger M, Davey Smith G. Investigating and dealing with publication bias and other biases. Systematic Reviews in Health Care: Meta-analysis in Context, EggerM, Davey SmithG, AltmanDG (eds). BMJ Publication Group: London, 2001; 189–208.
  • 33
    Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. British Medical Journal 1997; 315:629–634.
  • 34
    Renehan AG, Tyson M, Egger M, Heller RF, Zwahlen M. Body-mass index and incidence of cancer: a systematic review and meta-analysis of prospective observational studies. The Lancet 2008; 371:569–578.
  • 35
    Lau J, Ioannidis JPA, Terrin N, Schmid CH, Olkin I. The case of the misleading funnel plot. British Medical Journal 2006; 333:597–600.
  • 36
    Tang JL, Liu JL. Misleading funnel plot for detection of bias in meta-analysis. Journal of Clinical Epidemiology 2000; 53:477–484.
  • 37
    Munafo MR, Clark TG, Flint J. Assessing publication bias in genetic association studies: evidence from a recent meta-analysis. Psychiatry Research 2004; 129:39–44.
  • 38
    Sterne JAC, Egger M. Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. Journal of Clinical Epidemiology 2001; 54:1046–1055.
  • 39
    Terrin N, Schmid CH, Lau J. In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias. Journal of Clinical Epidemiology 2005; 58:894–901.
  • 40
    Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Contour-enhanced meta-analysis funnel plots help distinguish publication bias from other causes of asymmetry. Journal of Clinical Epidemiology 2008; 61:991–996.
  • 41
    Sterne JAC, Egger M, Moher D. Addressing reporting biases. In Cochrane Handbook for Systematic Reviews of Interventions HigginsJPT, GreenS (eds), Chapter 10. Wiley: Chichester, U.K., 2008; 297–333.
  • 42
    Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 2001; 56:455–463.
    Direct Link:
  • 43
    HigginsJPT, AltmanDG (eds). Assessing risk of bias in included studies. In Cochrane Handbook for Systematic Reviews of Interventions. HigginsJPT, GreenS (eds), Chapter 8. Wiley: Chichester, U.K., 2008; 187–241.
  • 44
    Galbraith RF. Some applications of radial plots. Journal of the American Statistical Association 1994; 89:1232–1242.
  • 45
    Whitehead A, Whitehead J. A general parametric approach to the meta-analysis of randomised clinical trials. Statistics in Medicine 1991; 10:1665–1677.
    Direct Link:
  • 46
    Thompson SG. Controversies in meta-analysis: the case of the trials of serum cholesterol reduction. Statistical Methods in Medical Research 1993; 2:173–192.
  • 47
    Copas J, Lozada-Can C. The radial plot in meta-analysis: approximations and applications. Journal of the Royal Statistical Society Series C (Applied Statistics) 2009; 58:329–344.
    Direct Link:
  • 48
    L'Abbé KA, Detsky AS, O'Rourke K. Meta-analysis in clinical research. Annals of Internal Medicine 1987; 107:224–233.
  • 49
    Van Houwelingen HC, Zwinderman KH, Stijnen T. A bivariate approach to meta-analysis. Statistics in Medicine 1993; 12:2273–2284.
    Direct Link:
  • 50
    Marret E, Remy C, Bonnet F. Postoperative Pain Forum Group. Meta-analysis of epidural analgesia versus parenteral opioid analgesia after colorectal surgery. British Journal of Surgery 2007; 94:665–673.
    Direct Link:
  • 51
    Jimenez FJ, Guallar E, Martinmoreno JM. A graphical display useful for meta-analysis. European Journal of Public Health 1997; 7:101–105.
  • 52
    Deeks JJ. Issues in the selection of a summary statistic for meta-analysis of clinical trials with binary outcomes. Statistics in Medicine 2002; 21:1575–1600.
    Direct Link:
  • 53
    Irwig L, Macaskill P, Glasziou P, Fahey M. Meta-analytic methods for diagnostic test accuracy. Journal of Clinical Epidemiology 1995; 48:119–130.
  • 54
    Langlotz CP, Sonnad SS. Meta-analysis of diagnostic procedures: a brief overview. Academic Radiology 1998; 5:S269–S273.
  • 55
    Higgins JPT, Thompson SG. Quantifying heterogeneity in a meta-analysis. Statistics in Medicine 2002; 21:1539–1558.
    Direct Link:
  • 56
    Walker AM, Martin-Moreno JM, Artalejo FR. Odd man out: a graphical approach to meta-analysis. American Journal of Public Health 1988; 78:961–966.
  • 57
    Pladevall-Vila M, Delclos GL, Varas C, Guyer H, Brugués-Tarradellas J, Anglada-Arisa A. Controversy of oral contraceptives and risk of rheumatoid arthritis: meta-analysis of conflicting studies and review of conflicting meta-analyses with special emphasis on analysis of heterogeneity. American Journal of Epidemiology 1996; 144:1–14.
  • 58
    Rifat SL. Graphic representations of effect estimates: an example from a meta-analytic review. Journal of Clinical Epidemiology 1990; 43:1267–1269.
  • 59
    Hardy RJ, Thompson SG. Detecting and describing heterogeneity in meta-analysis. Statistics in Medicine 1998; 17:841–856.
    Direct Link:
  • 60
    Wang MC, Bushman BJ. Using the normal quantile plot to explore meta-analytic data sets. Psychological Methods 1998; 3:46–54.
  • 61
    Carlin JB. Meta-analysis for 2 x 2 tables: a Bayesian approach. Statistics in Medicine 1992; 11:141–158.
    Direct Link:
  • 62
    Greenland S. Quantitative methods in the review of epidemiologic literature. Epidemiologic Reviews 1987; 9:1–30.
  • 63
    Baujat B, Mahe C, Pignon JP, Hill C. A graphical method for exploring heterogeneity in meta-analyses: application to a meta-analysis of 65 trials. Statistics in Medicine 2002; 21:2641–2652.
    Direct Link:
  • 64
    Thompson SG, Higgins JPT. How should meta-regression analyses be undertaken and interpreted? Statistics in Medicine 2002; 21:1559–1574.
    Direct Link:
  • 65
    Thompson SG. Why and how sources of heterogeneity should be investigated. In Systematic Reviews in Health Care: Meta-analysis in Context, EggerM, Davey SmithG, AltmanDG (eds), Chapter 9. BMJ Books: London, 2001; 157–175.
  • 66
    Bailar III JC. The practice of meta-analysis. Journal of Clinical Epidemiology 1995; 48:149–157.
  • 67
    Berkey CS, Hoaglin DC, Mosteller F, Colditz GA. A random-effects regression model for meta-analysis. Statistics in Medicine 1995; 14:395–411.
    Direct Link:
  • 68
    Sutton AJ, Abrams KR. Bayesian methods in meta-analysis and evidence synthesis. Statistical Methods in Medical Research 2001; 10:277–303.
  • 69
    Lau J, Ioannidis JPA, Schmid CH. Summing up evidence: one answer is not always enough. The Lancet 1998; 351:123–127.
  • 70
    Lewington S, Clarke R, Qizilbash N, Peto R, Collins R. Age-specific relevance of usual blood pressure to vascular mortality: a meta-analysis of individual data for one million adults in 61 prospective studies. The Lancet 2002; 360:1903–1913.
  • 71
    Olkin I. Diagnostic statistical procedures in medical meta-analyses. Statistics in Medicine 1999; 18:2331–2341.
    Direct Link:
  • 72
    Copas J, Shi JQ. Meta-analysis, funnel plots and sensitivity analysis. Biostatistics 2000; 1:247–262.
  • 73
    Hardy RJ, Thompson SG. A likelihood approach to meta-analysis with random effects. Statistics in Medicine 1996; 15:619–629.
    Direct Link:
  • 74
    Borenstein M, Hedges L, Higgins J, Rothstein H. Comprehensive Meta-analysis Version 2 [Computer program]. Biostat: Englewood, NJ, 2005.
  • 75
    Review Manager (RevMan) [ Computer program] Version 5.0. Nordic Cochrane Centre: Copenhagen.
  • 76
    SterneJAC (ed.). Meta-Analysis in Stata: An Updated Collection from the Stata Journal. Stata Press: College Station, TX, 2009.
  • 77
    Cleveland WS. The Elements of Graphing Data. Hobart Press: Summit, NJ, 1994.
Get PDF (659K)