Sample size recalculation for binary data in internal pilot study designs
Abstract
For binary endpoints, the required sample size depends not only on the known values of significance level, power and clinically relevant difference but also on the overall event rate. However, the overall event rate may vary considerably between studies and, as a consequence, the assumptions made in the planning phase on this nuisance parameter are to a great extent uncertain. The internal pilot study design is an appealing strategy to deal with this problem. Here, the overall event probability is estimated during the ongoing trial based on the pooled data of both treatment groups and, if necessary, the sample size is adjusted accordingly. From a regulatory viewpoint, besides preserving blindness it is required that eventual consequences for the Type I error rate should be explained. We present analytical computations of the actual Type I error rate for the internal pilot study design with binary endpoints and compare them with the actual level of the chi‐square test for the fixed sample size design. A method is given that permits control of the specified significance level for the chi‐square test under blinded sample size recalculation. Furthermore, the properties of the procedure with respect to power and expected sample size are assessed. Throughout the paper, both the situation of equal sample size per group and unequal allocation ratio are considered. The method is illustrated with application to a clinical trial in depression. Copyright © 2004 John Wiley & Sons Ltd.
Citing Literature
Number of times cited according to CrossRef: 33
- Munyaradzi Dimairo, Philip Pallmann, James Wason, Susan Todd, Thomas Jaki, Steven A. Julious, Adrian P. Mander, Christopher J. Weir, Franz Koenig, Marc K. Walton, Jon P. Nicholl, Elizabeth Coates, Katie Biggs, Toshimitsu Hamasaki, Michael A. Proschan, John A. Scott, Yuki Ando, Daniel Hind, Douglas G. Altman, The adaptive designs CONSORT extension (ACE) statement: a checklist with explanation and elaboration guideline for reporting randomised trials that use an adaptive design, Trials, 10.1186/s13063-020-04334-x, 21, 1, (2020).
- Munyaradzi Dimairo, Philip Pallmann, James Wason, Susan Todd, Thomas Jaki, Steven A Julious, Adrian P Mander, Christopher J Weir, Franz Koenig, Marc K Walton, Jon P Nicholl, Elizabeth Coates, Katie Biggs, Toshimitsu Hamasaki, Michael A Proschan, John A Scott, Yuki Ando, Daniel Hind, Douglas G Altman, The Adaptive designs CONSORT Extension (ACE) statement: a checklist with explanation and elaboration guideline for reporting randomised trials that use an adaptive design, BMJ, 10.1136/bmj.m115, (m115), (2020).
- Mickael Vourc’h, Donatien Huard, Fanny Feuillet, Gabrielle Baud, Arthur Guichoux, Marielle Surbled, Melanie Tissot, Anne Chiffoleau, Christophe Guitton, Samir Jaber, Karim Asehnoune, Preoxygenation in difficult airway management: high-flow oxygenation by nasal cannula versus face mask (the PREOPTIDAM study). Protocol for a single-centre randomised study, BMJ Open, 10.1136/bmjopen-2018-025909, 9, 4, (e025909), (2019).
- Annpey Pong, Shein-Chung Chow, Adaptive Trial Design in Clinical Research, Biopharmaceutical Applied Statistics Symposium, 10.1007/978-981-10-7829-3_3, (75-99), (2018).
- T. Friede, M. Kieser, Sample Size Reassessment in Non-inferiority Trials, Methods of Information in Medicine, 10.3414/ME09-01-0063, 50, 03, (237-243), (2018).
- Katharina Hees, Meinhard Kieser, Blinded sample size recalculation in clinical trials incorporating historical data, Contemporary Clinical Trials, 10.1016/j.cct.2017.07.013, 63, (2-7), (2017).
- Christy Chuang-Stein, Keaven Anderson, Paul Gallo, Sylva Collins, Sample Size Reestimation: A Review and Recommendations, Drug Information Journal, 10.1177/216847900604000413, 40, 4, (475-484), (2017).
- Anja Sander, Geraldine Rauch, Meinhard Kieser, Blinded sample size recalculation in clinical trials with binary composite endpoints, Journal of Biopharmaceutical Statistics, 10.1080/10543406.2016.1198371, 27, 4, (705-715), (2016).
- Mickael Vourc’h, Fanny Feuillet, Pierre-Joachim Mahe, Véronique Sebille, Karim Asehnoune, Baclofen to prevent agitation in alcohol-addicted patients in the ICU: study protocol for a randomised controlled trial, Trials, 10.1186/s13063-016-1539-2, 17, 1, (2016).
- Thomas D. Cook, Rebecca J. Benner, Marian R. Fisher, The WIZARD Trial as a Case Study of Flexible Clinical Trial Design, Drug Information Journal, 10.1177/009286150604000313, 40, 3, (345-353), (2016).
- Martin Posch, Florian Klinglmueller, Franz König, Frank Miller, Estimation after blinded sample size reassessment, Statistical Methods in Medical Research, 10.1177/0962280216670424, (096228021667042), (2016).
- Magdalena Żebrowska, Martin Posch, Dominic Magirr, Maximum type I error rate inflation from sample size reassessment when investigators are blind to treatment labels, Statistics in Medicine, 10.1002/sim.6848, 35, 12, (1972-1984), (2015).
- Katharina Ingel, Antje Jahn‐Eimermacher, Sample‐size calculation and reestimation for a semiparametric analysis of recurrent event data taking robust standard errors into account, Biometrical Journal, 10.1002/bimj.201300090, 56, 4, (631-648), (2014).
- Jin Xu, Menggang Yu, Sample size determination and re‐estimation for matched pair designs with multiple binary endpoints, Biometrical Journal, 10.1002/bimj.201100231, 55, 3, (430-443), (2014).
- Monika Pobiruchin, Meinhard Kieser, Sample Size Calculation and Blinded Sample Size Recalculation in Clinical Trials Where the Treatment Effect is Measured by the Relative Risk, Communications in Statistics - Simulation and Computation, 10.1080/03610918.2012.674595, 42, 7, (1643-1653), (2013).
- Wei Zhong, Joseph S. Koopmeiners, Bradley P. Carlin, A two-stage Bayesian design with sample size reestimation and subgroup analysis for phase II binary response trials, Contemporary Clinical Trials, 10.1016/j.cct.2013.03.011, 36, 2, (587-596), (2013).
- Thomas P. Ryan, Proportions and Rates, Sample Size Determination and Power, undefined, (103-144), (2013).
- Shein‐Chung Chow, Jen‐Pei Liu, References, Design and Analysis of Clinical Trials, undefined, (799-844), (2013).
- Daniel Wachtlin, Meinhard Kieser, Blinded Sample Size Recalculation in Longitudinal Clinical Trials Using Generalized Estimating Equations, Therapeutic Innovation & Regulatory Science, 10.1177/2168479013486658, 47, 4, (460-467), (2013).
- Susan Todd, Elsa Valdés‐Márquez, Jodie West, A practical comparison of blinded methods for sample size reviews in survival data clinical trials, Pharmaceutical Statistics, 10.1002/pst.516, 11, 2, (141-148), (2012).
- undefined Chin-Tsai Chou, undefined Che-Sheng Wen, undefined Shyh-Liang Lou, undefined, 2012 International Symposium on Information Technologies in Medicine and Education, 10.1109/ITiME.2012.6291415, (764-767), (2012).
- Chih‐Yi Chien, Yuan‐Chin Ivan Chang, Huey‐Miin Hsueh, Optimal sampling in retrospective logistic regression via two‐stage method, Biometrical Journal, 10.1002/bimj.200900253, 53, 1, (5-18), (2011).
- Matthew J. Gurka, Christopher S. Coffey, Kelly K. Gurka, Internal pilots for observational studies, Biometrical Journal, 10.1002/bimj.201000050, 52, 5, (590-603), (2010).
- Tim Friede, Heinz Schmidli, Blinded sample size reestimation with count data: Methods and applications in multiple sclerosis, Statistics in Medicine, 10.1002/sim.3861, 29, 10, (1145-1156), (2010).
- Shein-Chung Chow, Annpey Pong, Shein-Chung Chow, Adaptive Design Methods in Clinical Trials, Encyclopedia of Biopharmaceutical Statistics, 10.3109/9781439822463, (16-27), (2010).
- Annpey Pong, Shein-Chung Chow, Overview of Adaptive Design Methods in Clinical Trials, Handbook of Adaptive Designs in Pharmaceutical and Clinical Development, 10.1201/b10279, (1-1-1-19), (2010).
- Feng-Shou Ko, Hsiao-Hui Tsou, Jen-Pei Liu, Chin-Fu Hsiao, Sample Size Determination for a Specific Region in a Multiregional Trial, Journal of Biopharmaceutical Statistics, 10.1080/10543401003618900, 20, 4, (870-885), (2010).
- Shein-Chung Chow, Mark Chang, Adaptive design methods in clinical trials – a review, Orphanet Journal of Rare Diseases, 10.1186/1750-1172-3-11, 3, 1, (2008).
- Tim Friede, Charles Mitchell, Günther Müller‐Velten, Blinded Sample Size Reestimation in Non‐Inferiority Trials with Binary Endpoints, Biometrical Journal, 10.1002/bimj.200610373, 49, 6, (903-916), (2007).
- Meinhard Kieser, Tim Friede, Planning and analysis of three‐arm non‐inferiority trials with binary endpoints, Statistics in Medicine, 10.1002/sim.2543, 26, 2, (253-273), (2006).
- Tim Friede, Meinhard Kieser, Sample Size Recalculation in Internal Pilot Study Designs: A Review, Biometrical Journal, 10.1002/bimj.200510238, 48, 4, (537-555), (2006).
- Alan J. Phillips, Oliver N. Keene, Adaptive designs for pivotal trials: discussion points from the PSI Adaptive Design Expert Group, Pharmaceutical Statistics, 10.1002/pst.206, 5, 1, (61-66), (2006).
- Kirsten Wüst, Meinhard Kieser, Including long- and short-term data in blinded sample size recalculation for binary endpoints, Computational Statistics & Data Analysis, 10.1016/j.csda.2004.04.006, 48, 4, (835-855), (2005).




