Meta-regression approximations to reduce publication selection bias
Version of Record online: 3 SEP 2013
Copyright © 2013 John Wiley & Sons, Ltd.
Research Synthesis Methods
Volume 5, Issue 1, pages 60–78, March 2014
How to Cite
Stanley, T. D. and Doucouliagos, H. (2014), Meta-regression approximations to reduce publication selection bias. Res. Synth. Method, 5: 60–78. doi: 10.1002/jrsm.1095
- Issue online: 11 MAR 2014
- Version of Record online: 3 SEP 2013
- Manuscript Accepted: 21 JUL 2013
- Manuscript Revised: 16 JUL 2013
- Manuscript Received: 12 JUL 2012
- publication selection bias;
- systematic reviews, truncation
Publication selection bias is a serious challenge to the integrity of all empirical sciences. We derive meta-regression approximations to reduce this bias. Our approach employs Taylor polynomial approximations to the conditional mean of a truncated distribution. A quadratic approximation without a linear term, precision-effect estimate with standard error (PEESE), is shown to have the smallest bias and mean squared error in most cases and to outperform conventional meta-analysis estimators, often by a great deal. Monte Carlo simulations also demonstrate how a new hybrid estimator that conditionally combines PEESE and the Egger regression intercept can provide a practical solution to publication selection bias. PEESE is easily expanded to accommodate systematic heterogeneity along with complex and differential publication selection bias that is related to moderator variables. By providing an intuitive reason for these approximations, we can also explain why the Egger regression works so well and when it does not. These meta-regression methods are applied to several policy-relevant areas of research including antidepressant effectiveness, the value of a statistical life, the minimum wage, and nicotine replacement therapy. Copyright © 2013 John Wiley & Sons, Ltd.