Volume 20, Issue 24
Research Article

A refined method for the meta‐analysis of controlled clinical trials with binary outcome

Joachim Hartung

Corresponding Author

E-mail address: hartung@statistik.uni‐dortmund.de

Department of Statistics, University of Dortmund, D‐44221 Dortmund, Germany

Also project Meta‐Analysis in Biometry and Epidemiology (SFB 475) of the German Research Community (DFG).

Department of Statistics, University of Dortmund, D‐44221 Dortmund, GermanySearch for more papers by this author
Guido Knapp

Department of Statistics, University of Dortmund, D‐44221 Dortmund, Germany

Also project Meta‐Analysis in Biometry and Epidemiology (SFB 475) of the German Research Community (DFG).

Search for more papers by this author
First published: 20 December 2001
Citations: 131

Presented at the International Society for Clinical Biostatistics Twentieth International Meeting, Heidelberg, Germany, September 1999.

Abstract

For the meta‐analysis of controlled clinical trials with binary outcome a test statistic for testing an overall treatment effect is proposed, which is based on a refined estimator for the variance of the treatment effect estimator usually used in the random‐effects model of meta‐analysis. In simulation studies it is shown that the proposed test keeps the prescribed significance level much better than the commonly used tests in the fixed‐effects and random‐effects model, respectively. Moreover, when using the test it is not necessary to choose between fixed effects and random effects approaches in advance. The proposed method applies in the same way to the analysis of a controlled multi‐centre study with binary outcome, including a possible interaction between drugs and centres. Copyright © 2001 John Wiley & Sons, Ltd.

Number of times cited according to CrossRef: 131

  • The use of intracardiac echocardiography catheters in endocardial ablation of cardiac arrhythmia: Meta‐analysis of efficiency, effectiveness, and safety outcomes, Journal of Cardiovascular Electrophysiology, 10.1111/jce.14367, 31, 3, (664-673), (2020).
  • Individual participant data meta‐analysis of intervention studies with time‐to‐event outcomes: A review of the methodology and an applied example, Research Synthesis Methods, 10.1002/jrsm.1384, 11, 2, (148-168), (2020).
  • Adverse drug reactions associated with amitriptyline — protocol for a systematic multiple-indication review and meta-analysis, Systematic Reviews, 10.1186/s13643-020-01296-8, 9, 1, (2020).
  • The association of HTR2A polymorphisms with obsessive-compulsive disorder and its subtypes: A meta-analysis, Journal of Affective Disorders, 10.1016/j.jad.2020.06.016, (2020).
  • Gender disparity in cardiovascular mortality following radiation therapy for Hodgkin’s lymphoma: a systematic review, Cardio-Oncology, 10.1186/s40959-020-00067-7, 6, 1, (2020).
  • A second X chromosome contributes to resilience in a mouse model of Alzheimer’s disease, Science Translational Medicine, 10.1126/scitranslmed.aaz5677, 12, 558, (eaaz5677), (2020).
  • Abbreviated and comprehensive literature searches led to identical or very similar effect estimates: a meta-epidemiological study, Journal of Clinical Epidemiology, 10.1016/j.jclinepi.2020.08.002, 128, (1-12), (2020).
  • Mechanical or biological heart valve for dialysis-dependent patients? A meta-analysis, The Journal of Thoracic and Cardiovascular Surgery, 10.1016/j.jtcvs.2020.05.101, (2020).
  • The effects of livestock grazing on biodiversity are multi‐trophic: a meta‐analysis, Ecology Letters, 10.1111/ele.13527, 23, 8, (1298-1309), (2020).
  • Methods for estimating between‐study variance and overall effect in meta‐analysis of odds ratios, Research Synthesis Methods, 10.1002/jrsm.1404, 11, 3, (426-442), (2020).
  • Step width variability as a discriminator of age-related gait changes, Journal of NeuroEngineering and Rehabilitation, 10.1186/s12984-020-00671-9, 17, 1, (2020).
  • Comparison of exclusion, imputation and modelling of missing binary outcome data in frequentist network meta-analysis, BMC Medical Research Methodology, 10.1186/s12874-020-00929-9, 20, 1, (2020).
  • Incidence and mortality from cervical cancer and other malignancies after treatment of cervical intraepithelial neoplasia: a systematic review and meta-analysis of the literature, Annals of Oncology, 10.1016/j.annonc.2019.11.004, (2020).
  • Proportional assist ventilation versus pressure support ventilation for weaning from mechanical ventilation in adults: a meta-analysis and trial sequential analysis, Critical Care, 10.1186/s13054-020-03251-4, 24, 1, (2020).
  • Efficacy of therapeutic plasma exchange for treatment of autoimmune hemolytic anemia: A systematic review and meta‐analysis of randomized controlled trials, Journal of Clinical Apheresis, 10.1002/jca.21790, 35, 4, (294-306), (2020).
  • Individual participant data meta‐analysis to examine interactions between treatment effect and participant‐level covariates: Statistical recommendations for conduct and planning, Statistics in Medicine, 10.1002/sim.8516, 39, 15, (2115-2137), (2020).
  • Short-term exposure to particulate matter (PM10 and PM2.5), nitrogen dioxide (NO2), and ozone (O3) and all-cause and cause-specific mortality: Systematic review and meta-analysis, Environment International, 10.1016/j.envint.2020.105876, 142, (105876), (2020).
  • Bisexuality and Non-Suicidal Self-Injury (NSSI): a narrative synthesis of associated variables and a meta-analysis of risk, Journal of Affective Disorders, 10.1016/j.jad.2020.07.103, (2020).
  • Comparing traditional and Bayesian approaches to ecological meta‐analysis, Methods in Ecology and Evolution, 10.1111/2041-210X.13445, 11, 10, (1286-1295), (2020).
  • The global prevalence of hepatitis D virus infection: systematic review and meta-analysis, Journal of Hepatology, 10.1016/j.jhep.2020.04.008, (2020).
  • Investigation of Risk Of Bias due to Unreported and SelecTively included results in meta-analyses of nutrition research: the ROBUST study protocol, F1000Research, 10.12688/f1000research.20726.2, 8, (1760), (2020).
  • Scoping Reviews, Systematic Reviews, and Meta-Analysis: Applications in Veterinary Medicine, Frontiers in Veterinary Science, 10.3389/fvets.2020.00011, 7, (2020).
  • A Systematic Review and Meta-Analysis of Interventions for Actinic Keratosis from Post-Marketing Surveillance Trials, Journal of Clinical Medicine, 10.3390/jcm9072253, 9, 7, (2253), (2020).
  • Nutritional management of chronic pancreatitis: A systematic review and meta‐analysis of randomized controlled trials, Journal of Gastroenterology and Hepatology, 10.1111/jgh.15230, 0, 0, (2020).
  • High burden of acute kidney injury in COVID-19 pandemic: systematic review and meta-analysis, Journal of Clinical Pathology, 10.1136/jclinpath-2020-207023, (jclinpath-2020-207023), (2020).
  • Risk of metastatic pheochromocytoma and paraganglioma in SDHx mutation carriers: a systematic review and updated meta-analysis , Journal of Medical Genetics, 10.1136/jmedgenet-2019-106324, 57, 4, (217-225), (2019).
  • Estimation in meta‐analyses of mean difference and standardized mean difference, Statistics in Medicine, 10.1002/sim.8422, 39, 2, (171-191), (2019).
  • Impact of angiotensin‐converting enzyme inhibitors or angiotensin receptor blockers on renal and mortality outcomes in people with Type 2 diabetes and proteinuria, Diabetic Medicine, 10.1111/dme.14107, 37, 1, (44-52), (2019).
  • Likelihood-based random-effects meta-analysis with few studies: empirical and simulation studies, BMC Medical Research Methodology, 10.1186/s12874-018-0618-3, 19, 1, (2019).
  • The Use of Metaanalysis in Pharmacoepidemiology, Pharmacoepidemiology, 10.1002/9781119413431, (897-947), (2019).
  • Effects of antihypertensives, lipid-modifying drugs, glycaemic control drugs and sodium bicarbonate on the progression of stages 3 and 4 chronic kidney disease in adults: a systematic review and meta-analysis, BMJ Open, 10.1136/bmjopen-2019-030596, 9, 9, (e030596), (2019).
  • The impact of intensive care unit diaries on patients’ and relatives’ outcomes: a systematic review and meta-analysis, Critical Care, 10.1186/s13054-019-2678-0, 23, 1, (2019).
  • Evidence synthesis in prognosis research, Diagnostic and Prognostic Research, 10.1186/s41512-019-0059-4, 3, 1, (2019).
  • Drug-eluting or bare-metal stents for percutaneous coronary intervention: a systematic review and individual patient data meta-analysis of randomised clinical trials, The Lancet, 10.1016/S0140-6736(19)30474-X, (2019).
  • Predictors of the effects of treatment for shoulder pain: protocol of an individual participant data meta-analysis, Diagnostic and Prognostic Research, 10.1186/s41512-019-0061-x, 3, 1, (2019).
  • Comparison of the Effects of Glucagon-Like Peptide Receptor Agonists and Sodium-Glucose Cotransporter 2 Inhibitors for Prevention of Major Adverse Cardiovascular and Renal Outcomes in Type 2 Diabetes Mellitus, Circulation, 10.1161/CIRCULATIONAHA.118.038868, 139, 17, (2022-2031), (2019).
  • Comparative fertility and pregnancy outcomes after local treatment for cervical intraepithelial neoplasia and stage 1a1 cervical cancer: protocol for a systematic review and network meta-analysis from the CIRCLE group, BMJ Open, 10.1136/bmjopen-2018-028009, 9, 10, (e028009), (2019).
  • Double or triple antithrombotic therapy after coronary stenting and atrial fibrillation: A systematic review and meta-analysis of randomized clinical trials, International Journal of Cardiology, 10.1016/j.ijcard.2019.12.054, (2019).
  • Participants' outcomes gone missing within a network of interventions: Bayesian modeling strategies, Statistics in Medicine, 10.1002/sim.8207, 38, 20, (3861-3879), (2019).
  • A note on the empirical Bayes heterogeneity variance estimator in meta‐analysis, Statistics in Medicine, 10.1002/sim.8197, 38, 20, (3804-3816), (2019).
  • Simulation and data‐generation for random‐effects network meta‐analysis of binary outcome, Statistics in Medicine, 10.1002/sim.8193, 38, 17, (3288-3303), (2019).
  • A new justification of the Hartung‐Knapp method for random‐effects meta‐analysis based on weighted least squares regression, Research Synthesis Methods, 10.1002/jrsm.1356, 10, 4, (515-527), (2019).
  • Analysing data and undertaking meta‐analyses, Cochrane Handbook for Systematic Reviews of Interventions, 10.1002/9781119536604, (241-284), (2019).
  • Statistical approaches to identify subgroups in meta-analysis of individual participant data: a simulation study, BMC Medical Research Methodology, 10.1186/s12874-019-0817-6, 19, 1, (2019).
  • Investigation of Risk Of Bias due to Unreported and SelecTively included results in meta-analyses of nutrition research: the ROBUST study protocol, F1000Research, 10.12688/f1000research.20726.1, 8, (1760), (2019).
  • A unified method for improved inference in random effects meta-analysis, Biostatistics, 10.1093/biostatistics/kxz020, (2019).
  • Evaluation of the Normality Assumption in Meta-Analyses, American Journal of Epidemiology, 10.1093/aje/kwz261, (2019).
  • A guide to systematic review and meta-analysis of prognostic factor studies, BMJ, 10.1136/bmj.k4597, (k4597), (2019).
  • Physical inactivity, cardiometabolic disease, and risk of dementia: an individual-participant meta-analysis, BMJ, 10.1136/bmj.l1495, (l1495), (2019).
  • Evidences from a Systematic Review and Meta-Analysis Unveil the Role of MiRNA Polymorphisms in the Predisposition to Female Neoplasms, International Journal of Molecular Sciences, 10.3390/ijms20205088, 20, 20, (5088), (2019).
  • Whole milk compared with reduced-fat milk and childhood overweight: a systematic review and meta-analysis, The American Journal of Clinical Nutrition, 10.1093/ajcn/nqz276, (2019).
  • The efficacy and safety of dipeptidyl peptidase-4 inhibitors for type 2 diabetes: a Bayesian network meta-analysis of 58 randomized controlled trials, Acta Diabetologica, 10.1007/s00592-018-1222-z, 56, 3, (249-272), (2018).
  • Effectiveness of supported employment in non-trial routine implementation: systematic review and meta-analysis, Social Psychiatry and Psychiatric Epidemiology, 10.1007/s00127-018-1577-z, 54, 5, (525-531), (2018).
  • Methods to calculate uncertainty in the estimated overall effect size from a random‐effects meta‐analysis, Research Synthesis Methods, 10.1002/jrsm.1319, 10, 1, (23-43), (2018).
  • A comparison of heterogeneity variance estimators in simulated random‐effects meta‐analyses, Research Synthesis Methods, 10.1002/jrsm.1316, 10, 1, (83-98), (2018).
  • Simulation-based power calculations for planning a two-stage individual participant data meta-analysis, BMC Medical Research Methodology, 10.1186/s12874-018-0492-z, 18, 1, (2018).
  • Drug eluting versus bare metal stents for percutaneous coronary intervention of saphenous vein graft lesions: An updated meta-analysis of randomized controlled trials, Cardiovascular Revascularization Medicine, 10.1016/j.carrev.2018.03.025, 19, 7, (837-844), (2018).
  • SGLT2 inhibitors for primary and secondary prevention of cardiovascular and renal outcomes in type 2 diabetes: a systematic review and meta-analysis of cardiovascular outcome trials, The Lancet, 10.1016/S0140-6736(18)32590-X, (2018).
  • Midterm clinical outcomes with everolimus-eluting bioresorbable scaffolds versus everolimus-eluting metallic stents for percutaneous coronary interventions: a meta-analysis of randomised trials, EuroIntervention, 10.4244/EIJ-D-17-00492, 13, 13, (1565-1573), (2018).
  • Effects of medication assisted treatment (MAT) for opioid use disorder on functional outcomes: A systematic review, Journal of Substance Abuse Treatment, 10.1016/j.jsat.2018.03.001, 89, (28-51), (2018).
  • Outcomes associated with mammalian target of rapamycin (mTOR) inhibitors in heart transplant recipients: A meta-analysis, International Journal of Cardiology, 10.1016/j.ijcard.2018.03.111, 265, (71-76), (2018).
  • Individual participant data meta‐analysis of continuous outcomes: A comparison of approaches for specifying and estimating one‐stage models, Statistics in Medicine, 10.1002/sim.7930, 37, 29, (4404-4420), (2018).
  • A comparison of seven random‐effects models for meta‐analyses that estimate the summary odds ratio, Statistics in Medicine, 10.1002/sim.7588, 37, 7, (1059-1085), (2018).
  • A comparison of methods for meta‐analysis of a small number of studies with binary outcomes, Research Synthesis Methods, 10.1002/jrsm.1296, 9, 3, (366-381), (2018).
  • Left ventricular assist device implantation improves glycaemic control: a systematic review and meta‐analysis, ESC Heart Failure, 10.1002/ehf2.12337, 5, 6, (1141-1149), (2018).
  • When should meta‐analysis avoid making hidden normality assumptions?, Biometrical Journal, 10.1002/bimj.201800071, 60, 6, (1040-1058), (2018).
  • Two-stage Individual Participant Data Meta-analysis and Generalized Forest Plots, The Stata Journal: Promoting communications on statistics and Stata, 10.1177/1536867X1501500203, 15, 2, (369-396), (2018).
  • The efficacy and safety of non-vitamin K antagonist oral anticoagulants in patients with atrial fibrillation and coronary artery disease: A meta-analysis of randomized trials, European Heart Journal: Acute Cardiovascular Care, 10.1177/2048872618796990, (204887261879699), (2018).
  • Impact of patient and public involvement on enrolment and retention in clinical trials: systematic review and meta-analysis, BMJ, 10.1136/bmj.k4738, (k4738), (2018).
  • Acupuncture for the Treatment of Adults with Posttraumatic Stress Disorder: A Systematic Review and Meta-Analysis, Journal of Trauma & Dissociation, 10.1080/15299732.2017.1289493, 19, 1, (39-58), (2017).
  • Data‐generating models of dichotomous outcomes: Heterogeneity in simulation studies for a random‐effects meta‐analysis, Statistics in Medicine, 10.1002/sim.7569, 37, 7, (1115-1124), (2017).
  • Meta-analysis supports GWAS-implicated link between GRM3 and schizophrenia risk, Translational Psychiatry, 10.1038/tp.2017.172, 7, 8, (e1196-e1196), (2017).
  • Meta-analysis reveals associations between genetic variation in the 5′ and 3′ regions of Neuregulin-1 and schizophrenia, Translational Psychiatry, 10.1038/tp.2016.279, 7, 1, (e1004-e1004), (2017).
  • Efficacy of mindfulness meditation for smoking cessation: A systematic review and meta-analysis, Addictive Behaviors, 10.1016/j.addbeh.2017.01.022, 69, (27-34), (2017).
  • External validation, update and development of prediction models for pre-eclampsia using an Individual Participant Data (IPD) meta-analysis: the International Prediction of Pregnancy Complication Network (IPPIC pre-eclampsia) protocol, Diagnostic and Prognostic Research, 10.1186/s41512-017-0016-z, 1, 1, (2017).
  • Mindfulness-based Relapse Prevention for Substance Use Disorders, Journal of Addiction Medicine, 10.1097/ADM.0000000000000338, 11, 5, (386-396), (2017).
  • Timing and Characteristics of Cumulative Evidence Available on Novel Therapeutic Agents Receiving Food and Drug Administration Accelerated Approval, The Milbank Quarterly, 10.1111/1468-0009.12261, 95, 2, (261-290), (2017).
  • The Hartung‐Knapp modification for random‐effects meta‐analysis: A useful refinement but are there any residual concerns?, Statistics in Medicine, 10.1002/sim.7411, 36, 25, (3923-3934), (2017).
  • Equal‐tailed confidence intervals for comparison of rates, Pharmaceutical Statistics, 10.1002/pst.1813, 16, 5, (334-348), (2017).
  • Power analysis for random‐effects meta‐analysis, Research Synthesis Methods, 10.1002/jrsm.1240, 8, 3, (290-302), (2017).
  • Deriving percentage study weights in multi-parameter meta-analysis models: with application to meta-regression, network meta-analysis and one-stage individual participant data models, Statistical Methods in Medical Research, 10.1177/0962280216688033, (096228021668803), (2017).
  • Bayesian meta-analysis: The role of the between-sample heterogeneity, Statistical Methods in Medical Research, 10.1177/0962280217709837, (096228021770983), (2017).
  • Effect of diet and physical activity based interventions in pregnancy on gestational weight gain and pregnancy outcomes: meta-analysis of individual participant data from randomised trials, BMJ, 10.1136/bmj.j3119, (j3119), (2017).
  • Meta‐analysis using individual participant data: one‐stage and two‐stage approaches, and why they may differ, Statistics in Medicine, 10.1002/sim.7141, 36, 5, (855-875), (2016).
  • Mindfulness Meditation for Chronic Pain: Systematic Review and Meta-analysis, Annals of Behavioral Medicine, 10.1007/s12160-016-9844-2, 51, 2, (199-213), (2016).
  • Meta‐analysis of few small studies in orphan diseases, Research Synthesis Methods, 10.1002/jrsm.1217, 8, 1, (79-91), (2016).
  • Meta‐analysis of two studies in the presence of heterogeneity with applications in rare diseases, Biometrical Journal, 10.1002/bimj.201500236, 59, 4, (658-671), (2016).
  • Hartung–Knapp method is not always conservative compared with fixed‐effect meta‐analysis, Statistics in Medicine, 10.1002/sim.6879, 35, 15, (2503-2515), (2016).
  • Acupuncture for substance use disorders: A systematic review and meta-analysis, Drug and Alcohol Dependence, 10.1016/j.drugalcdep.2016.02.034, 163, (1-15), (2016).
  • A systematic review of St. John’s wort for major depressive disorder, Systematic Reviews, 10.1186/s13643-016-0325-2, 5, 1, (2016).
  • Calcineurin Inhibitor Minimization, Conversion, Withdrawal, and Avoidance Strategies in Renal Transplantation: A Systematic Review and Meta‐Analysis, American Journal of Transplantation, 10.1111/ajt.13710, 16, 7, (2117-2138), (2016).
  • Random-effects meta-analysis: the number of studies matters, Statistical Methods in Medical Research, 10.1177/0962280215583568, 26, 3, (1500-1518), (2015).
  • Misunderstandings about Q and ‘Cochran's Q test' in meta‐analysis, Statistics in Medicine, 10.1002/sim.6632, 35, 4, (485-495), (2015).
  • Ceftaroline fosamil versus ceftriaxone for the treatment of community-acquired pneumonia: individual patient data meta-analysis of randomized controlled trials, Journal of Antimicrobial Chemotherapy, 10.1093/jac/dkv415, 71, 4, (862-870), (2015).
  • Fixed Effect and Random Effects Meta-Analysis, Meta-Analysis with R, 10.1007/978-3-319-21416-0_2, (21-53), (2015).
  • Grundlagen der Metaanalyse und deren Bewertung, Prävention und Therapie Durch Sport, Band 1, 10.1016/B978-3-437-24255-7.00010-4, (253-262), (2015).
  • Paravertebral Block for Inguinal Herniorrhaphy, Anesthesia & Analgesia, 10.1213/ANE.0000000000000835, 121, 2, (556-569), (2015).
  • Active and passive smoking and risk of breast cancer: a meta-analysis, Breast Cancer Research and Treatment, 10.1007/s10549-015-3628-4, 154, 2, (213-224), (2015).
  • Meta-analysis in clinical trials revisited, Contemporary Clinical Trials, 10.1016/j.cct.2015.09.002, 45, (139-145), (2015).
  • Hartung-Knapp-Sidik-Jonkman approach and its modification for random-effects meta-analysis with few studies, BMC Medical Research Methodology, 10.1186/s12874-015-0091-1, 15, 1, (2015).
  • See more

The full text of this article hosted at iucr.org is unavailable due to technical difficulties.