Volume 14, Issue 4
Economic Evaluation

Probabilistic sensitivity analysis for NICE technology assessment: not an optional extra

Karl Claxton

Corresponding Author

E-mail address: kpc1@york.ac.uk

Centre for Health Economics, Department of Economics and Related Studies, University of York, UK

Centre for Health Economics, University of York, Heslington, York YO10 5DD, UK===Search for more papers by this author
Mark Sculpher

Centre for Health Economics, University of York, UK

Search for more papers by this author
Chris McCabe

Sheffield Health Economics Group, School of Health and Related Research, University of Sheffield, UK

Search for more papers by this author
Andrew Briggs

Health Economics Research Centre, Department of Public Health, University of Oxford, UK

Search for more papers by this author
Ron Akehurst

Sheffield Health Economics Group, School of Health and Related Research, University of Sheffield, UK

Search for more papers by this author
Martin Buxton

Health Economics Research Group, Brunel University, UK

Search for more papers by this author
John Brazier

Sheffield Health Economics Group, School of Health and Related Research, University of Sheffield, UK

Search for more papers by this author
Tony O'Hagan

Department of Probability and Statistics, University of Sheffield, UK

Search for more papers by this author
First published: 28 February 2005
Citations: 258

Abstract

Recently the National Institute for Clinical Excellence (NICE) updated its methods guidance for technology assessment. One aspect of the new guidance is to require the use of probabilistic sensitivity analysis with all cost‐effectiveness models submitted to the Institute. The purpose of this paper is to place the NICE guidance on dealing with uncertainty into a broader context of the requirements for decision making; to explain the general approach that was taken in its development; and to address each of the issues which have been raised in the debate about the role of probabilistic sensitivity analysis in general. The most appropriate starting point for developing guidance is to establish what is required for decision making. On the basis of these requirements, the methods and framework of analysis which can best meet these needs can then be identified. It will be argued that the guidance on dealing with uncertainty and, in particular, the requirement for probabilistic sensitivity analysis, is justified by the requirements of the type of decisions that NICE is asked to make. Given this foundation, the main issues and criticisms raised during and after the consultation process are reviewed. Finally, some of the methodological challenges posed by the need fully to characterise decision uncertainty and to inform the research agenda will be identified and discussed. Copyright © 2005 John Wiley & Sons, Ltd.

Number of times cited according to CrossRef: 258

  • The economic burden of kidney graft failure in the United States, American Journal of Transplantation, 10.1111/ajt.15750, 20, 5, (1323-1333), (2020).
  • A cost-effectiveness assessment of dual-mobility bearings in revision hip arthroplasty, The Bone & Joint Journal, 10.1302/0301-620X.102B9.BJJ-2019-1742.R1, 102-B, 9, (1128-1135), (2020).
  • A Review of Methodological Considerations for Economic Evaluations of Gene Therapies and Their Application in Literature, Value in Health, 10.1016/j.jval.2020.04.1833, (2020).
  • Accurately Reflecting Uncertainty When Using Patient-Level Simulation Models to Extrapolate Clinical Trial Data, Medical Decision Making, 10.1177/0272989X20916442, (0272989X2091644), (2020).
  • A Computationally Efficient Method for Probabilistic Parameter Threshold Analysis for Health Economic Evaluations, Medical Decision Making, 10.1177/0272989X20937253, (0272989X2093725), (2020).
  • Surrogate Endpoints in Health Technology Assessment: An International Review of Methodological Guidelines, PharmacoEconomics, 10.1007/s40273-020-00935-1, (2020).
  • After 20 Years of Using Economic Evaluation, Should NICE be Considered a Methods Innovator?, PharmacoEconomics, 10.1007/s40273-019-00882-6, (2020).
  • A bronchial‐airway gene‐expression classifier to improve the diagnosis of lung cancer: Clinical outcomes and cost‐effectiveness analysis, International Journal of Cancer, 10.1002/ijc.32333, 146, 3, (781-790), (2019).
  • Defining the Minimum Acceptable Diagnostic Accuracy of Noninvasive Fibrosis Testing in Cirrhosis: A Decision Analytic Modeling Study, Hepatology, 10.1002/hep.30846, 71, 2, (627-642), (2019).
  • Modelling uncertainty in survival and cost-effectiveness is vital in the era of gene therapies: the case of axicabtagene ciloleucel, Health Policy and Technology, 10.1016/j.hlpt.2019.05.009, (2019).
  • A 1‐year perspective on goal‐directed therapy in elderly with hip fracture: Secondary outcomes, Acta Anaesthesiologica Scandinavica, 10.1111/aas.13320, 63, 5, (610-614), (2019).
  • The Cost-Effectiveness of Bimodal Stimulation Compared to Unilateral and Bilateral Cochlear Implant Use in Adults with Bilateral Severe to Profound Deafness, Ear and Hearing, 10.1097/AUD.0000000000000727, 40, 6, (1425-1436), (2019).
  • Decision analytic modeling was useful to assess the impact of a prediction model on health outcomes before a randomized trial, Journal of Clinical Epidemiology, 10.1016/j.jclinepi.2019.07.010, 115, (106-115), (2019).
  • Efficacy of Malignant Hyperthermia Association of the United States–Recommended Methods of Preparation for Malignant Hyperthermia-Susceptible Patients Using Dräger Zeus Anesthesia Workstations and Associated Costs, Anesthesia & Analgesia, 10.1213/ANE.0000000000003441, 129, 1, (74-83), (2019).
  • undefined, 2019 IEEE 58th Conference on Decision and Control (CDC), 10.1109/CDC40024.2019.9029765, (361-366), (2019).
  • R You Still Using Excel? The Advantages of Modern Software Tools for Health Technology Assessment, Value in Health, 10.1016/j.jval.2019.01.003, 22, 5, (575-579), (2019).
  • “Time Traveling Is Just Too Dangerous” but Some Methods Are Worth Revisiting: The Advantages of Expected Loss Curves Over Cost-Effectiveness Acceptability Curves and Frontier, Value in Health, 10.1016/j.jval.2019.02.008, 22, 5, (611-618), (2019).
  • An intervention to improve pneumococcal vaccination uptake in high risk 50-64 year olds vs. expanded age-based recommendations: an exploratory cost-effectiveness analysis, Human Vaccines & Immunotherapeutics, 10.1080/21645515.2018.1564439, (2019).
  • Cost-effectiveness of the coronary sinus Reducer and its impact on the healthcare burden of refractory angina patients, European Heart Journal - Quality of Care and Clinical Outcomes, 10.1093/ehjqcco/qcz027, (2019).
  • Certified service dogs – A cost-effectiveness analysis appraisal, PLOS ONE, 10.1371/journal.pone.0219911, 14, 9, (e0219911), (2019).
  • Evaluating Parameter Uncertainty in a Simulation Model of Cancer Using Emulators, Medical Decision Making, 10.1177/0272989X19837631, (0272989X1983763), (2019).
  • Estimating the Expected Value of Sample Information across Different Sample Sizes Using Moment Matching and Nonlinear Regression, Medical Decision Making, 10.1177/0272989X19837983, (0272989X1983798), (2019).
  • Modeling the Economic Impact of Interventions for Older Populations with Multimorbidity: A Method of Linking Multiple Single-Disease Models, Medical Decision Making, 10.1177/0272989X19868987, (0272989X1986898), (2019).
  • One-Way Sensitivity Analysis for Probabilistic Cost-Effectiveness Analysis: Conditional Expected Incremental Net Benefit, PharmacoEconomics, 10.1007/s40273-019-00869-3, (2019).
  • A Flexible Open-Source Decision Model for Value Assessment of Biologic Treatment for Rheumatoid Arthritis, PharmacoEconomics, 10.1007/s40273-018-00765-2, (2019).
  • Cost Effectiveness of Sodium-Glucose Cotransporter-2 (SGLT2) Inhibitors, Glucagon-Like Peptide-1 (GLP-1) Receptor Agonists, and Dipeptidyl Peptidase-4 (DPP-4) Inhibitors: A Systematic Review, PharmacoEconomics, 10.1007/s40273-019-00774-9, (2019).
  • Comparison of the expected rewards between probabilistic and deterministic analyses in a Markov model, Expert Review of Pharmacoeconomics & Outcomes Research, 10.1080/14737167.2019.1615886, (1-7), (2019).
  • Cost-effectiveness of Operative Versus Non-operative Management of Acute Achilles Tendon Ruptures, HSS Journal ®, 10.1007/s11420-019-09684-0, (2019).
  • Managing Uncertainties Due to Limited Evidence in Economic Evaluations of Novel Anti-Tuberculosis Regimens: A Systematic Review, PharmacoEconomics - Open, 10.1007/s41669-019-0162-z, (2019).
  • Cohort versus patient level simulation for the economic evaluation of single versus combination immuno-oncology therapies in metastatic melanoma, Journal of Medical Economics, 10.1080/13696998.2019.1569446, (1-14), (2019).
  • The importance of accounting for the uncertainty around the preference-based health-related quality-of-life measures value sets: a systematic review, Journal of Medical Economics, 10.1080/13696998.2019.1592178, (1-13), (2019).
  • The economic case for precision medicine, Expert Review of Precision Medicine and Drug Development, 10.1080/23808993.2018.1421858, 3, 1, (1-9), (2018).
  • Economic Evaluation of CAM Use, Complementary and Alternative Medicine and Kidney Health, 10.4018/978-1-5225-2882-1.ch009, (232-271), (2018).
  • Accounting for Uncertainty in Decision Analytic Models Using Rank Preserving Structural Failure Time Modeling: Application to Parametric Survival Models, Value in Health, 10.1016/j.jval.2017.07.008, 21, 1, (105-109), (2018).
  • Cost-effectiveness of comprehensive geriatric assessment at an ambulatory geriatric unit based on the AGe-FIT trial, BMC Geriatrics, 10.1186/s12877-017-0703-1, 18, 1, (2018).
  • Cost-effectiveness of sacral nerve stimulation and percutaneous tibial nerve stimulation for faecal incontinence, Therapeutic Advances in Gastroenterology, 10.1177/1756284818802562, 11, (175628481880256), (2018).
  • Calculating the Expected Value of Sample Information Using Efficient Nested Monte Carlo: A Tutorial, Value in Health, 10.1016/j.jval.2018.05.004, 21, 11, (1299-1304), (2018).
  • Probabilistic Sensitivity Analysis in Cost-Effectiveness Models: Determining Model Convergence in Cohort Models, PharmacoEconomics, 10.1007/s40273-018-0697-3, 36, 12, (1421-1426), (2018).
  • Using Evidence from Randomised Controlled Trials in Economic Models: What Information is Relevant and is There a Minimum Amount of Sample Data Required to Make Decisions?, PharmacoEconomics, 10.1007/s40273-018-0681-y, 36, 10, (1135-1141), (2018).
  • Decision uncertainty and value of further research: a case-study in fenestrated endovascular aneurysm repair for complex abdominal aortic aneurysms, Cost Effectiveness and Resource Allocation, 10.1186/s12962-018-0098-7, 16, 1, (2018).
  • Value of External Data in the Extrapolation of Survival Data: A Study Using the NJR Data Set, Value in Health, 10.1016/j.jval.2017.12.023, 21, 7, (822-829), (2018).
  • Replacing amalgam with a high-viscosity glass-ionomer in restoring primary teeth: A cost-effectiveness study in Brasilia, Brazil, Journal of Dentistry, 10.1016/j.jdent.2017.12.012, 70, (80-86), (2018).
  • References, Network Meta‐Analysis for Decision Making, 10.1002/9781118951651, (409-445), (2018).
  • Cost-effectiveness analyses of genetic and genomic diagnostic tests, Nature Reviews Genetics, 10.1038/nrg.2017.108, 19, 4, (235-246), (2018).
  • Point-of-care haemostasis monitoring during liver transplantation is cost effective, Clinical Chemistry and Laboratory Medicine (CCLM), 10.1515/cclm-2018-0889, 0, 0, (2018).
  • Evaluating the cost-effectiveness of reduced tardive dyskinesia with second-generation antipsychotics, British Journal of Psychiatry, 10.1192/bjp.bp.106.035063, 191, 3, (238-245), (2018).
  • Cost-effectiveness analysis of haploidentical vs matched unrelated allogeneic hematopoietic stem cells transplantation in patients older than 55 years, Bone Marrow Transplantation, 10.1038/s41409-018-0133-5, (2018).
  • A New Approach for Sampling Ordered Parameters in Probabilistic Sensitivity Analysis, PharmacoEconomics, 10.1007/s40273-017-0584-3, 36, 3, (341-347), (2017).
  • Modelling the cost-effectiveness of PCSK9 inhibitors vs. ezetimibe through LDL-C reductions in a Norwegian setting, European Heart Journal - Cardiovascular Pharmacotherapy, 10.1093/ehjcvp/pvx010, 4, 1, (15-22), (2017).
  • Methods for Handling Unobserved Covariates in a Bayesian Update of a Cost-effectiveness Model, Medical Decision Making, 10.1177/0272989X17736780, 38, 2, (150-162), (2017).
  • Factors affecting the cost-effectiveness of on-farm culture prior to the treatment of clinical mastitis in dairy cows, Preventive Veterinary Medicine, 10.1016/j.prevetmed.2017.07.006, 145, (91-99), (2017).
  • Evaluation of a Stratified National Breast Screening Program in the United Kingdom: An Early Model-Based Cost-Effectiveness Analysis, Value in Health, 10.1016/j.jval.2017.04.012, 20, 8, (1100-1109), (2017).
  • Informing Reimbursement Decisions Using Cost-Effectiveness Modelling: A Guide to the Process of Generating Elicited Priors to Capture Model Uncertainties, PharmacoEconomics, 10.1007/s40273-017-0525-1, 35, 9, (867-877), (2017).
  • Percutaneous Coronary Intervention Versus Optimal Medical Therapy for Stable Angina in Advanced CKD: A Decision Analysis, American Journal of Kidney Diseases, 10.1053/j.ajkd.2016.07.024, 69, 3, (350-357), (2017).
  • Cost-Effectiveness of Acceptance and Commitment Therapy and a Workplace Intervention for Employees on Sickness Absence due to Mental Disorders, Journal of Occupational and Environmental Medicine, 10.1097/JOM.0000000000001156, 59, 12, (1211-1220), (2017).
  • Increasing the methodological quality and relevance of cost effectiveness analysis, Thrombosis Research, 10.1016/j.thromres.2016.12.011, 150, (121-122), (2017).
  • A Review of Methods for Analysis of the Expected Value of Information, Medical Decision Making, 10.1177/0272989X17697692, 37, 7, (747-758), (2017).
  • Cost-effectiveness of Antihypertensive Medication, Medical Care, 10.1097/MLR.0000000000000719, 55, 6, (552-560), (2017).
  • Economic Evaluation of Implementing a Novel Pharmacogenomic Test (IDgenetix®) to Guide Treatment of Patients with Depression and/or Anxiety, PharmacoEconomics, 10.1007/s40273-017-0587-0, 35, 12, (1297-1310), (2017).
  • Cost-effectiveness of palbociclib in hormone receptor-positive advanced breast cancer, Annals of Oncology, 10.1093/annonc/mdx201, 28, 8, (1825-1831), (2017).
  • A review of discrete event simulation in National Coordinating Centre for Health Technology Assessment-funded work and a case study exploring the cost-effectiveness of testing for thrombophilia in patients presenting with an initial idiopathic venous thromboembolism, Journal of Simulation, 10.1057/jos.2009.12, 4, 1, (14-23), (2017).
  • Choice of modelling technique for evaluating health care interventions, Journal of the Operational Research Society, 10.1057/palgrave.jors.2602230, 58, 2, (168-176), (2017).
  • Six ways to improve a simulation analysis, Journal of Simulation, 10.1057/palgrave.jos.4250006, 1, 1, (21-28), (2017).
  • Diagnostic and therapeutic medical devices for safer blood management in cardiac surgery: systematic reviews, observational studies and randomised controlled trials, Programme Grants for Applied Research, 10.3310/pgfar05170, 5, 17, (1-406), (2017).
  • Effects of antenatal diet and physical activity on maternal and fetal outcomes: individual patient data meta-analysis and health economic evaluation, Health Technology Assessment, 10.3310/hta21410, 21, 41, (1-158), (2017).
  • Sensitivity Analysis in Sequential Decision Models, Medical Decision Making, 10.1177/0272989X16670605, 37, 2, (243-252), (2016).
  • When Simple Becomes Complicated: Why Excel Should Lose its Place at the Top Table, Global & Regional Health Technology Assessment: Italian; Northern Europe and Spanish, 10.5301/grhta.5000247, 4, 1, (grhta.5000247), (2016).
  • Estimating the expected value of partial perfect information in health economic evaluations using integrated nested Laplace approximation, Statistics in Medicine, 10.1002/sim.6983, 35, 23, (4264-4280), (2016).
  • A Framework for Developing the Structure of Public Health Economic Models, Value in Health, 10.1016/j.jval.2016.02.011, 19, 5, (588-601), (2016).
  • Cost-effectiveness analysis of tenofovir disoproxil fumarate for treatment of chronic hepatitis B in China, Hepatology International, 10.1007/s12072-016-9741-6, 10, 6, (924-936), (2016).
  • Human health benefits and burdens of a pharmaceutical treatment: Discussion of a conceptual integrated approach, Environmental Research, 10.1016/j.envres.2015.10.027, 144, (19-31), (2016).
  • Cost-Effectiveness Analyses of Lung Cancer Screening Strategies Using Low-Dose Computed Tomography: a Systematic Review, Applied Health Economics and Health Policy, 10.1007/s40258-016-0226-5, 14, 4, (409-418), (2016).
  • Temperature-controlled laminar airflow in severe asthma for exacerbation reduction (The LASER Trial): study protocol for a randomised controlled trial, Trials, 10.1186/s13063-015-1134-y, 17, 1, (2016).
  • Patienten- und Bürgerpartizipation in der Entscheidungsfindung im Gesundheitswesen insbesondere bei der Bewertung von Arzneimitteln, Zeitschrift für Evidenz, Fortbildung und Qualität im Gesundheitswesen, 10.1016/j.zefq.2015.12.001, 110-111, (36-44), (2016).
  • Mindfulness-based cognitive therapy for recurrent major depression: A ‘ best buy ’ for health care? , Australian & New Zealand Journal of Psychiatry, 10.1177/0004867416642847, 50, 10, (1001-1013), (2016).
  • Cost-effectiveness of national mandatory screening of all admissions to English National Health Service hospitals for meticillin-resistant Staphylococcus aureus: a mathematical modelling study, The Lancet Infectious Diseases, 10.1016/S1473-3099(15)00417-X, 16, 3, (348-356), (2016).
  • A comparison of two methods for expert elicitation in health technology assessments, BMC Medical Research Methodology, 10.1186/s12874-016-0186-3, 16, 1, (2016).
  • Cost-effectiveness of once-daily versus twice-daily regimens in the treatment of HIV infection in sub-Saharan Africa: a probabilistic decision model, F1000Research, 10.12688/f1000research.9954.1, 5, (2681), (2016).
  • Real-world cost effectiveness of MitraClip combined with Medical Therapy Versus Medical therapy alone in patients with moderate or severe mitral regurgitation, International Journal of Cardiology, 10.1016/j.ijcard.2016.01.212, 209, (153-160), (2016).
  • Patient-Focused Benefit-Risk Analysis to Inform Regulatory Decisions: The European Union Perspective, Value in Health, 10.1016/j.jval.2016.04.006, 19, 6, (734-740), (2016).
  • Making a decision to wait for more evidence: when the National Institute for Health and Clinical Excellence recommends a technology only in the context of research, Journal of the Royal Society of Medicine, 10.1177/014107680710001013, 100, 10, (453-460), (2016).
  • Estimation of Mortality Rates for Disease Simulation Models Using Bayesian Evidence Synthesis, Medical Decision Making, 10.1177/0272989X06291326, 26, 5, (497-511), (2016).
  • A cost-effectiveness modelling study of strategies to reduce risk of infection following primary hip replacement based on a systematic review, Health Technology Assessment, 10.3310/hta20540, 20, 54, (1-144), (2016).
  • CATheter Infections in CHildren (CATCH): a randomised controlled trial and economic evaluation comparing impregnated and standard central venous catheters in children, Health Technology Assessment, 10.3310/hta20180, 20, 18, (1-220), (2016).
  • Generalisability and Cost-Impact of Antibiotic-Impregnated Central Venous Catheters for Reducing Risk of Bloodstream Infection in Paediatric Intensive Care Units in England, PLOS ONE, 10.1371/journal.pone.0151348, 11, 3, (e0151348), (2016).
  • Cost-Effectiveness of a National Initiative to Improve Hand Hygiene Compliance Using the Outcome of Healthcare Associated Staphylococcus aureus Bacteraemia, PLOS ONE, 10.1371/journal.pone.0148190, 11, 2, (e0148190), (2016).
  • Handling Parameter Uncertainty in Cost-Effectiveness Models Simply and Responsibly, Medical Decision Making, 10.1177/0272989X14567475, 35, 5, (567-569), (2015).
  • Evaluación económica de los tratamientos orales para el sangrado menstrual abundante en España, PharmacoEconomics Spanish Research Articles, 10.1007/s40277-015-0043-5, 12, 3, (105-114), (2015).
  • Comparing Preoperative Targets to Failure-to-Rescue for Surgical Mortality Improvement, Journal of the American College of Surgeons, 10.1016/j.jamcollsurg.2015.02.036, 220, 6, (1096-1106), (2015).
  • Use of Bayesian Markov Chain Monte Carlo Methods to Estimate EQ-5D Utility Scores from EORTC QLQ Data in Myeloma for Use in Cost-Effectiveness Analysis, Medical Decision Making, 10.1177/0272989X15575285, 35, 3, (351-360), (2015).
  • Análisis coste-efectividad del uso de ticagrelor frente a clopidogrel en el tratamiento del síndrome coronario agudo en España, PharmacoEconomics Spanish Research Articles, 10.1007/s40277-015-0044-4, 12, 4, (137-146), (2015).
  • Análisis coste-efectividad de rivaroxabán en el tratamiento del tromboembolismo venoso en España, PharmacoEconomics Spanish Research Articles, 10.1007/s40277-015-0040-8, 12, 4, (147-156), (2015).
  • Cost-Effectiveness Analysis of Antiviral Therapies for Hepatitis B e Antigen-Positive Chronic Hepatitis B Patients in China, Clinical Drug Investigation, 10.1007/s40261-015-0273-y, 35, 3, (197-209), (2015).
  • Cost–effectiveness of volar locking plate versus percutaneous fixation for distal radial fractures , The Bone & Joint Journal, 10.1302/0301-620X.97B9.35560, 97-B, 9, (1264-1270), (2015).
  • Economic Evaluations with Agent-Based Modelling: An Introduction, PharmacoEconomics, 10.1007/s40273-015-0254-2, 33, 5, (423-433), (2015).
  • Advanced Methodological Aspects in the Economic Evaluation, Economic Evaluation in Genomic Medicine, 10.1016/B978-0-12-801497-4.00005-9, (65-96), (2015).
  • Cost-utility analysis of nanoparticle albumin-bound paclitaxel ( nab -paclitaxel) in combination with gemcitabine in metastatic pancreatic cancer in Spain: results of the PANCOSTABRAX study , Expert Review of Pharmacoeconomics & Outcomes Research, 10.1586/14737167.2015.1047349, 15, 4, (579-589), (2015).
  • Systematic critical review of previous economic evaluations of smoking cessation during pregnancy, BMJ Open, 10.1136/bmjopen-2015-008998, 5, 11, (e008998-e008998), (2015).
  • undefined, 56th AIAA/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference, 10.2514/6.2015-0804, (2015).
  • Cost-effectiveness and cost-utility analysis of OTC use of simvastatin 10 mg for the primary prevention of myocardial infarction in Iranian men, DARU Journal of Pharmaceutical Sciences, 10.1186/s40199-015-0129-2, 23, 1, (2015).
  • See more

The full text of this article hosted at iucr.org is unavailable due to technical difficulties.