Calibration of Disease Simulation Model Using an Engineering Approach
Version of Record online: 12 JAN 2009
© 2009, International Society for Pharmacoeconomics and Outcomes Research (ISPOR)
Value in Health
Volume 12, Issue 4, pages 521–529, June 2009
How to Cite
Kong, C. Y., McMahon, P. M. and Gazelle, G. S. (2009), Calibration of Disease Simulation Model Using an Engineering Approach. Value in Health, 12: 521–529. doi: 10.1111/j.1524-4733.2008.00484.x
- Issue online: 28 MAY 2009
- Version of Record online: 12 JAN 2009
- lung cancer;
- simulation model
Objectives: Calibrating a disease simulation model's outputs to existing clinical data is vital to generate confidence in the model's predictive ability. Calibration involves two challenges: 1) defining a total goodness-of-fit (GOF) score for multiple targets if simultaneous fitting is required, and 2) searching for the optimal parameter set that minimizes the total GOF score (i.e., yields the best fit). To address these two prominent challenges, we have applied an engineering approach to calibrate a microsimulation model, the Lung Cancer Policy Model (LCPM).
Methods: First, 11 targets derived from clinical and epidemiologic data were combined into a total GOF score by a weighted-sum approach, accounting for the user-defined relative importance of the calibration targets. Second, two automated parameter search algorithms, simulated annealing (SA) and genetic algorithm (GA), were independently applied to a simultaneous search of 28 natural history parameters to minimize the total GOF score. Algorithm performance metrics were defined for speed and model fit.
Results: Both search algorithms obtained total GOF scores below 95 within 1000 search iterations. Our results show that SA outperformed GA in locating a lower GOF. After calibrating our LCPM, the predicted natural history of lung cancer was consistent with other mathematical models of lung cancer development.
Conclusion: An engineering-based calibration method was able to simultaneously fit LCPM output to multiple calibration targets, with the benefits of fast computational speed and reduced the need for human input and its potential bias.