Optimization of a quantitative signal detection algorithm for spontaneous reports of adverse events post immunization
Article first published online: 17 DEC 2012
Copyright © 2012 John Wiley & Sons, Ltd.
Pharmacoepidemiology and Drug Safety
Volume 22, Issue 5, pages 477–487, May 2013
How to Cite
Van Holle, L. and Bauchau, V. (2013), Optimization of a quantitative signal detection algorithm for spontaneous reports of adverse events post immunization. Pharmacoepidem. Drug Safe., 22: 477–487. doi: 10.1002/pds.3392
- Issue published online: 3 MAY 2013
- Article first published online: 17 DEC 2012
- Manuscript Accepted: 20 NOV 2012
- Manuscript Revised: 5 NOV 2012
- Manuscript Received: 26 JUN 2012
- vaccine safety;
- signal detection;
To optimize the efficiency of signal detection by maximizing the proportion of true positive (TP) signals among signals detected by a disproportionality algorithm.
We compared 176 different combinations of stratification factors, sex (S), age (A), region (R) and year of report (Y), and cut-off values of a Multi-Item Gamma Poisson Schrinker (MGPS) algorithm. Spontaneous adverse event reports of eight vaccines from the GlaxoSmithKline Biologicals safety database were used. Defining events listed in the Product Information as proxy of true safety signals, we compared each algorithm performance in terms of positive predictive value (PPV). For each vaccine, each algorithm was ranked according to PPV. Median rank and overall PPV were computed across vaccines.
For a standard cut-off of 2, the optimal stratification factors differed by vaccine and led to a set of algorithms with a median rank of 34.5 (PPV = 0.22; 34 TP). Keeping the original SARY stratification led to optimal cut-offs that differed by vaccine and a set of algorithms with a median rank of 1.75 (PPV = 0.20; 142 TP). The optimal combination of cut-off and stratification led to different algorithms by vaccine with a median rank of 1 (PPV = 0.19; 139 TP). The best unique algorithm parameterization across vaccines was 0.8-SARY (cut-off-stratification), with a median rank of 3 (PPV = 0.20; 195 TP). The original 2-SARY was one of the worst algorithms, with a median rank of 150.75 (PPV = 0.13; 8 TP).
Within the scope of this study, a unique MGPS algorithm across vaccines with the original full stratification but a lowered cut-off provided major performance improvement. Copyright © 2012 John Wiley & Sons, Ltd.