This paper is devoted to meta-analysis of large studies with low adverse event rates. In this setting, the terms ‘Odds Ratio’ and ‘Relative Risk’ are virtually synonymous.
Fixed vs random effects meta-analysis in rare event studies: The Rosiglitazone link with myocardial infarction and cardiac death†
Article first published online: 3 SEP 2007
Copyright © 2007 John Wiley & Sons, Ltd.
Statistics in Medicine
Volume 26, Issue 24, pages 4375–4385, 30 October 2007
How to Cite
Shuster, J. J., Jones, L. S. and Salmon, D. A. (2007), Fixed vs random effects meta-analysis in rare event studies: The Rosiglitazone link with myocardial infarction and cardiac death. Statist. Med., 26: 4375–4385. doi: 10.1002/sim.3060
- Issue published online: 13 SEP 2007
- Article first published online: 3 SEP 2007
- Manuscript Accepted: 6 AUG 2007
- Manuscript Received: 29 JUN 2007
- National Institute of Research Resources, National Institutes of Health. Grant Number: M01RR00082
- low event rates;
- odds ratio;
- random effects;
- relative risk;
Meta-analyses can be powerful tools to combine the results of randomized clinical trials and observational studies to make consensus inferences about a medical issue. It will be demonstrated that a common practice of testing for homogeneity of effect size, and acting upon the inference to decide between fixed vs random effects, can lead to potentially misleading results. A by-product of this paper is a new ratio estimator approach to random effects meta-analysis of a large set of studies with low event rates. As a case study, we shall use the recent Rosiglitazone example, where diagnostic testing failed to reject homogeneity, leading the investigators to use fixed effects. The results for the fixed and random effects analyses are discordant. In the fixed (random) effects analysis, the p-values for myocardial infarction were 0.03 (0.11) while those for cardiac death were 0.06 (0.0017). Had the fixed effects analysis controlled the study error for multiple testing via a Bonferonni correction, the joint 95+ per cent confidence rectangle for the two outcomes would have included odds ratios of (1.0, 1.0). For the Rosiglitazone example, random effects analysis, where all studies receive the same weight, is the superior choice over fixed effects, where two large studies dominate. Copyright © 2007 John Wiley & Sons, Ltd.