Combining the evidence using stable weights
Article first published online: 29 MAR 2011
Copyright © 2011 John Wiley & Sons, Ltd.
Research Synthesis Methods
Volume 1, Issue 3-4, pages 284–296, July - December 2010
How to Cite
Kulinskaya, E., Morgenthaler, S. and Staudte, R. G. (2010), Combining the evidence using stable weights. Res. Synth. Method, 1: 284–296. doi: 10.1002/jrsm.20
- Issue published online: 17 APR 2011
- Article first published online: 29 MAR 2011
- Manuscript Accepted: 11 JAN 2011
- Manuscript Revised: 10 JAN 2011
- Manuscript Received: 15 NOV 2010
- variance stabilization;
- risk difference;
In a meta-analysis one seeks to combine the results of several studies in order to improve the accuracy of decisions. Here we compare by simulation four methods for combining estimates of the risk difference, namely the Cochran and Mantel–Haenszel (MH) methods, the inverse-variance weights approach and a recent variance-stabilized weights approach. Both the level and power of corresponding test statistics, as well as the coverage of related confidence intervals are compared over a wide range of sample size and parameter configurations.
We found that the inverse-variance weights methodology is unreliable and is not recommended, while for equal risks, the Cochran test and the associated confidence intervals are the most reliable. Under alternatives of unequal risks, the coverage probabilities of the variance-stabilized confidence intervals are almost uniformly more reliable than those based on other methods except when the average risk is small in which case the MH confidence intervals are preferable. Copyright © 2011 John Wiley & Sons, Ltd.