This article was published online on 20 April 2009. An error in the affiliation and correspondence address was subsequently identified. This notice is included in the online and print versions to indicate that both have been corrected on 3 December 2009.
Systematic reviews of economic evaluations: utility or futility?†
Version of Record online: 20 APR 2009
Copyright © 2009 John Wiley & Sons, Ltd.
Volume 19, Issue 3, pages 350–364, March 2010
How to Cite
Anderson, R. (2010), Systematic reviews of economic evaluations: utility or futility?. Health Econ., 19: 350–364. doi: 10.1002/hec.1486
- Issue online: 8 FEB 2010
- Version of Record online: 20 APR 2009
- Manuscript Accepted: 19 FEB 2009
- Manuscript Revised: 28 NOV 2008
- Manuscript Received: 21 JUL 2008
- systematic review;
- economic evaluation;
- economic studies;
- evidence-based policy
Systematic reviews of studies of effectiveness are the centrepiece of evidence-based medicine and policy making. Increasingly, systematic reviews of economic evaluations are also an expected input into much evidence-based policy making, with some health economists even calling for ‘an economics approach to systematic review’.
This paper questions the value of conducting systematic reviews of economic evaluations to inform decision making in health care. It argues that the value of systematic reviews of economic evaluations is usually undermined by three things. Firstly, compared with effectiveness studies, there is a much wider range of factors that limit the generalisability of cost–effectiveness results, over time and between health systems and service settings, including the context-dependency of resource use and opportunity costs, and different decision contexts and budget constraints. Secondly, because economic evaluations are more explicitly intended to be decision-informing, the requirements for generalisability take primacy, and considerations of internal validity become more secondary. Thirdly, since one of the two main forms of economic evaluation – decision analytic modelling – is itself a well-developed method of evidence synthesis, in most cases the need for a comprehensive systematic review of previous economic evaluations of a particular health technology or policy choice is unwarranted.
I conclude that apparent ‘meta-analytic expectations’ for clear and widely applicable cost–effectiveness conclusions from systematic reviews of economic evaluations are optimistic and generally futile. For more useful insights and knowledge from previous economic studies in evidence-based policy making, a more limited range of reasons for conducting systematic reviews of health economic studies is proposed. Copyright © 2009 John Wiley & Sons, Ltd.