An alternative to R2 for assessing linear models of effect size
Article first published online: 8 APR 2011
Copyright © 2011 John Wiley & Sons, Ltd.
Research Synthesis Methods
Volume 1, Issue 3-4, pages 272–283, July - December 2010
How to Cite
Aloe, A. M., Becker, B. J. and Pigott, T. D. (2010), An alternative to R2 for assessing linear models of effect size. Res. Synth. Method, 1: 272–283. doi: 10.1002/jrsm.23
- Issue published online: 17 APR 2011
- Article first published online: 8 APR 2011
- Manuscript Accepted: 23 JAN 2011
- Manuscript Revised: 22 DEC 2010
- Manuscript Received: 18 MAR 2010
- variance explained
Reviewers often use regression models in meta-analysis (‘meta-regressions’) to examine the relationships between effect sizes and study characteristics. In this paper, we propose and illustrate the use of an index (R) that expresses the amount of variance in the outcome that is explained by the meta-regression model. The values of R2 obtained from the standard computer output for linear models of effect size in the meta-analysis context are typically too small, because the typical R2 considers sampling variance to be unexplained whereas in meta-analysis it can be quantified. Although the idea of removing the unexplainable variance from the estimator of variance accounted for in meta-analysis is not new (Cook et al., 1992; Raudenbush, 1994) we explicitly define four estimators of variance explained, and illustrate via two examples that the typical R2 obtained in a linear model of effect size is always lower than our indices. Thus, the typical R2 underestimates the explanatory power of linear models of effect sizes. Our four estimators improve upon typical weighted R2 values. Copyright © 2011 John Wiley & Sons, Ltd.