Research Article
Re‐calculating the sample size in internal pilot study designs with control of the type I error rate
First published: 28 March 2000
Citations: 82
Abstract
When designing a clinical trial, there is usually some uncertainty about the variability of the primary outcome variable. This may lead to an unnecessarily high or inadequately low sample size. The internal pilot study approach uses data from patients recruited up to an interim stage to re‐estimate the variance and to re‐calculate the final sample size accordingly. Previously, simulation studies have shown that this methodology may highly improve the chance to obtain a well‐powered trial. However, it also turned out that the type I error rate may be inflated by this procedure. We quantify the maximum excess of the type I error rate for normally distributed outcomes. If strict control of the α‐level is considered to be an important issue, a method is proposed to achieve this when re‐calculating the sample size in internal pilot studies. The characteristics of the power distributions are investigated for various sample size adaptation rules and implications are discussed. Copyright © 2000 John Wiley & Sons, Ltd.
Citing Literature
Number of times cited according to CrossRef: 82
- Elie Nkwabong, Diane N. Mayane, Esther Meka, Felix Essiben, Malaria in the third trimester and maternal‐perinatal outcome, International Journal of Gynecology & Obstetrics, 10.1002/ijgo.13261, 151, 1, (103-108), (2020).
- Daniel I. Sessler, Paul S. Myles, Novel Clinical Trial Designs to Improve the Efficiency of Research, Anesthesiology, 10.1097/ALN.0000000000002989, 132, 1, (69-81), (2020).
- Aroldo A. Dargél, Elise Mosconi, Marc Masson, Marion Plaze, Fabien Taieb, Cassandra Von Platen, Tan Phuc Buivan, Guillaume Pouleriguen, Marie Sanchez, Stephane Fournier, Pierre-Marie Lledo, Chantal Henry, Toi Même: A mHealth Platform for Measuring Bipolar Illness Activity – Feasibility Study Protocol (Preprint), JMIR Research Protocols, 10.2196/18818, (2020).
- Elie Nkwabong, Pernelle Ngoundjou Dongmo, Claude Tayou, Théophile Nana Njamen, Outcome of pregnancies among women with sickle cell disease, The Journal of Maternal-Fetal & Neonatal Medicine, 10.1080/14767058.2020.1743657, (1-5), (2020).
- Daniel I. Sessler, Alparslan Turan, Wolf H. Stapelfeldt, Edward J. Mascha, Dongsheng Yang, Ehab Farag, Jacek Cywinski, Claudene Vlah, Tatyana Kopyeva, Allen L. Keebler, Mauricio Perilla, Mangakalaraip Ramachandran, Sean Drahuschak, Kristina Kaple, Andrea Kurz, Triple-low Alerts Do Not Reduce Mortality, Anesthesiology, 10.1097/ALN.0000000000002480, 130, 1, (72-82), (2019).
- Tim Friede, Harald Pohlmann, Heinz Schmidli, Blinded sample size reestimation in event‐driven clinical trials: Methods and an application in multiple sclerosis, Pharmaceutical Statistics, 10.1002/pst.1927, 18, 3, (351-365), (2019).
- Elie Nkwabong, Elisabeth Ekuka Ilue, Théophile Nana Njamen, Factors associated with the resumption of sexual intercourse before the scheduled six-week postpartum visit, Tropical Doctor, 10.1177/0049475519855294, (004947551985529), (2019).
- Franck Pires Cerqueira, Angelo Miguel Cardoso Jesus, Maria Dulce Cotrim, Adaptive Design: A Review of the Technical, Statistical, and Regulatory Aspects of Implementation in a Clinical Trial, Therapeutic Innovation & Regulatory Science, 10.1177/2168479019831240, (216847901983124), (2019).
- Elie Nkwabong, Fadimatou Njikam, Ginette Kalla, Outcome of pregnancies with marginal umbilical cord insertion, The Journal of Maternal-Fetal & Neonatal Medicine, 10.1080/14767058.2019.1628206, (1-5), (2019).
- Elie Nkwabong, Ingrid Laure Bessi Badjan, Zacharie Sando, Pap smear accuracy for the diagnosis of cervical precancerous lesions, Tropical Doctor, 10.1177/0049475518798532, 49, 1, (34-39), (2018).
- Julia Werner, Oliver Hunsicker, Anja Schneider, Henryk Stein, Christian von Heymann, Adrian Freitag, Aarne Feldheiser, Klaus-Dieter Wernecke, Claudia Spies, Balanced 10% hydroxyethyl starch compared with balanced 6% hydroxyethyl starch and balanced crystalloid using a goal-directed hemodynamic algorithm in pancreatic surgery, Medicine, 10.1097/MD.0000000000010579, 97, 17, (e0579), (2018).
- Elie Nkwabong, Romuald Meboulou Nguel, Nelly Kamgaing, Anne Sylvie Keddi Jippe, Knowledge, attitudes and practices of health personnel of maternities in the prevention of mother-to-child transmission of HIV in a sub-Saharan African region with high transmission rate: some solutions proposed, BMC Pregnancy and Childbirth, 10.1186/s12884-018-1876-0, 18, 1, (2018).
- T. Friede, M. Kieser, Sample Size Reassessment in Non-inferiority Trials, Methods of Information in Medicine, 10.3414/ME09-01-0063, 50, 03, (237-243), (2018).
- Maria M Ciarleglio, Christopher D Arendt, Sample size re-estimation in a superiority clinical trial using a hybrid classical and Bayesian procedure, Statistical Methods in Medical Research, 10.1177/0962280218776991, (096228021877699), (2018).
- Umair Majid, Research Fundamentals: Study Design, Population, and Sample Size, Undergraduate Research in Natural and Clinical Science and Technology (URNCST) Journal, 10.26685/urncst.16, 2, 1, (1-7), (2018).
- Xinrui Zhang, Keith E. Muller, Maureen M. Goodenow, Yueh‐Yun Chi, Internal pilot design for balanced repeated measures, Statistics in Medicine, 10.1002/sim.7524, 37, 3, (375-389), (2017).
- Joshua S. Richman, Judy C. Boughey, Adaptive Trial Designs, Clinical Trials Design in Operative and Non Operative Invasive Procedures, 10.1007/978-3-319-53877-8, (99-107), (2017).
- W. W. Muir, Can the quality and clinical relevance of Equine Veterinary Journal publications be improved? A time for reflection and refinement, Equine Veterinary Journal, 10.1111/evj.12660, 49, 2, (135-137), (2017).
- Tobias Mütze, Tim Friede, Blinded sample size re‐estimation in three‐arm trials with ‘gold standard’ design, Statistics in Medicine, 10.1002/sim.7356, 36, 23, (3636-3653), (2017).
- Vladimir Dragalin, Adaptive Designs: Terminology and Classification, Drug Information Journal, 10.1177/216847900604000408, 40, 4, (425-435), (2017).
- Cornelia U. Kunz, Nigel Stallard, Nicholas Parsons, Susan Todd, Tim Friede, Blinded versus unblinded estimation of a correlation coefficient to inform interim design adaptations, Biometrical Journal, 10.1002/bimj.201500233, 59, 2, (344-357), (2016).
- Anja Sander, Geraldine Rauch, Meinhard Kieser, Blinded sample size recalculation in clinical trials with binary composite endpoints, Journal of Biopharmaceutical Statistics, 10.1080/10543406.2016.1198371, 27, 4, (705-715), (2016).
- Zhong Gao, Anindya Roy, Ming Tan, A Two-Stage Adaptive Targeted Clinical Trial Design for Biomarker Performance-Based Sample Size Re-Estimation, Statistics in Biosciences, 10.1007/s12561-015-9139-3, 8, 1, (66-76), (2016).
- Gernot Wassmer, Werner Brannath, Gernot Wassmer, Werner Brannath, Adaptive Group Sequential Tests, Group Sequential and Confirmatory Adaptive Designs in Clinical Trials, 10.1007/978-3-319-32562-0_6, (133-169), (2016).
- Elie Nkwabong, Joseph Nelson Fomulu, Fabrice Lionel Djomkam Youmsi, Trial of Labor After Cesarean Section Among Women with Unique Lower Segment Scarred Uterus and Fetal Weight >3500 g: Prognostic Factors for a Safe Vaginal Delivery, The Journal of Obstetrics and Gynecology of India, 10.1007/s13224-015-0835-1, 66, S1, (202-206), (2016).
- Kaifeng Lu, Distribution of the two‐sample t‐test statistic following blinded sample size re‐estimation, Pharmaceutical Statistics, 10.1002/pst.1737, 15, 3, (208-215), (2016).
- Gernot Wassmer, Reinhard Eisebitt, Silke Coburger, Flexible Interim Analyses in Clinical Trials Using Multistage Adaptive Test Designs, Drug Information Journal, 10.1177/009286150103500410, 35, 4, (1131-1146), (2016).
- Tim Friede, Meinhard Kieser, Sample Size Adjustment in Clinical Trials for Proving Equivalence, Drug Information Journal, 10.1177/009286150103500436, 35, 4, (1401-1408), (2016).
- Peter Bauer, Frank Bretz, Vladimir Dragalin, Franz König, Gernot Wassmer, Twenty‐five years of confirmatory adaptive designs: opportunities and pitfalls, Statistics in Medicine, 10.1002/sim.6472, 35, 3, (325-347), (2015).
- Daniel Golkowski, Tim Friede, Meinhard Kieser, Blinded sample size re‐estimation in crossover bioequivalence trials, Pharmaceutical Statistics, 10.1002/pst.1617, 13, 3, (157-162), (2014).
- Herman Kado, Ambar M. Patel, Siva Suryadevara, Martin M. Zenni, Lyndon C. Box, Dominick J. Angiolillo, Theodore A. Bass, Luis A. Guzman, Operator Radiation Exposure and Physical Discomfort During a Right Versus Left Radial Approach for Coronary Interventions, JACC: Cardiovascular Interventions, 10.1016/j.jcin.2013.11.026, 7, 7, (810-816), (2014).
- Tim Friede, Meinhard Kieser, Blinded sample size re‐estimation in superiority and noninferiority trials: bias versus variance in variance estimation, Pharmaceutical Statistics, 10.1002/pst.1564, 12, 3, (141-146), (2013).
- Simon Schneider, Heinz Schmidli, Tim Friede, Blinded and unblinded internal pilot study designs for clinical trials with count data, Biometrical Journal, 10.1002/bimj.201200189, 55, 4, (617-633), (2013).
- Thomas P. Ryan, Methods of Determining Sample Sizes, Sample Size Determination and Power, undefined, (17-55), (2013).
- Kohei Uemura, Sample Size Re-estimation in Clinical Trials: Overview of Methods and the Statistical View Points to Consider, Japanese Journal of Biometrics, 10.5691/jjb.33.77, 33, 1, (77-99), (2012).
- Kyle J Jeray, Stephanie L Tanner, Pilot Randomized Trials: Is There a Need?, The Journal of Bone and Joint Surgery-American Volume, 10.2106/JBJS.L.00180, 94, Suppl 1, (15-18), (2012).
- Chih‐Yi Chien, Yuan‐Chin Ivan Chang, Huey‐Miin Hsueh, Optimal sampling in retrospective logistic regression via two‐stage method, Biometrical Journal, 10.1002/bimj.200900253, 53, 1, (5-18), (2011).
- Mark Chang, Bibliography, Adaptive Design Methods in Clinical Trials, Second Edition, 10.1201/b11505-19, (329-350), (2011).
- Lehana Thabane, Jinhui Ma, Rong Chu, Ji Cheng, Afisi Ismaila, Lorena P Rios, Reid Robson, Marroon Thabane, Lora Giangregorio, Charles H Goldsmith, A tutorial on pilot studies: the what, why and how, BMC Medical Research Methodology, 10.1186/1471-2288-10-1, 10, 1, (2010).
- Matthew J. Gurka, Christopher S. Coffey, Kelly K. Gurka, Internal pilots for observational studies, Biometrical Journal, 10.1002/bimj.201000050, 52, 5, (590-603), (2010).
- Qing Liu, George Y. H. Chi, Understanding the FDA Guidance on Adaptive Designs: Historical, Legal, and Statistical Perspectives, Journal of Biopharmaceutical Statistics, 10.1080/10543406.2010.514462, 20, 6, (1178-1219), (2010).
- Vladimir Dragalin, Sequential Methods in Multi-Arm Clinical Trials, Sequential Analysis, 10.1080/07474946.2010.487416, 29, 4, (444-462), (2010).
- Tim Friede, Holger Stammer, Blinded Sample Size Recalculation in Noninferiority Trials: A Case Study in Dermatology, Drug Information Journal, 10.1177/009286151004400507, 44, 5, (599-607), (2010).
- Paola Facchin, Melissa Rosa-Rizzotto, Anna Carla Turconi, Emanuela Pagliano, Elisa Fazzi, Massimo Stortini, Ermellina Fedrizzi, Multisite Trial on Efficacy of Constraint-Induced Movement Therapy in Children with Hemiplegia, American Journal of Physical Medicine & Rehabilitation, 10.1097/PHM.0b013e3181951382, 88, 3, (216-230), (2009).
- Steven Julious, Bibliography, Sample Sizes for Clinical Trials, 10.1201/9781584887409, (277-284), (2009).
- Michael A. Proschan, Sample size re‐estimation in clinical trials, Biometrical Journal, 10.1002/bimj.200800266, 51, 2, (348-357), (2009).
- Joachim Calderon, Philippe Richebe, Jean Philippe Guibaud, Alain Coiffic, Olivier Branchard, Julien Asselineau, Gérard Janvier, Prospective Randomized Study of Early Pulmonary Evaluation of Patients Scheduled for Aortic Valve Surgery Performed by Ministernotomy or Total Median Sternotomy, Journal of Cardiothoracic and Vascular Anesthesia, 10.1053/j.jvca.2009.03.011, 23, 6, (795-801), (2009).
- Jitendra Ganju, Biao Xing, Re‐estimating the sample size of an on‐going blinded trial based on the method of randomization block sums, Statistics in Medicine, 10.1002/sim.3442, 28, 1, (24-38), (2008).
- Suzhen Wang, Jielai Xia, Lili Yu, Chanjuan Li, Li Xu, A SAS macro for sample size adjustment and randomization test for internal pilot study, Computer Methods and Programs in Biomedicine, 10.1016/j.cmpb.2007.11.016, 90, 1, (66-88), (2008).
- Joanne Zhang, Stella G. Machado, Statistical Issues Including Design and Sample Size Calculation in Thorough QT/QTc Studies∗, Journal of Biopharmaceutical Statistics, 10.1080/10543400802020938, 18, 3, (451-467), (2008).
- Christopher S Coffey, John A Kairalla, Adaptive Clinical Trials, Drugs in R & D, 10.2165/00126839-200809040-00003, 9, 4, (229-242), (2008).
- Diane Potvin, Charles E. DiLiberti, Walter W. Hauck, Alan F. Parr, Donald J. Schuirmann, Robert A. Smith, Sequential design approaches for bioequivalence studies with crossover designs, Pharmaceutical Statistics, 10.1002/pst.294, 7, 4, (245-262), (2007).
- Christopher S. Coffey, John A. Kairalla, Keith E. Muller, Practical Methods for Bounding Type I Error Rate with an Internal Pilot Design, Communications in Statistics - Theory and Methods, 10.1080/03610920601143634, 36, 11, (2143-2157), (2007).
- Christopher Jennison, Bruce W. Turnbull, Adaptive Seamless Designs: Selection and Prospective Testing of Hypotheses, Journal of Biopharmaceutical Statistics, 10.1080/10543400701645215, 17, 6, (1135-1161), (2007).
- Tim Friede, Charles Mitchell, Günther Müller‐Velten, Blinded Sample Size Reestimation in Non‐Inferiority Trials with Binary Endpoints, Biometrical Journal, 10.1002/bimj.200610373, 49, 6, (903-916), (2007).
- Matthew J. Gurka, Christopher S. Coffey, Keith E. Muller, Internal pilots for a class of linear mixed models with Gaussian and compound symmetric data, Statistics in Medicine, 10.1002/sim.2840, 26, 22, (4083-4099), (2007).
- Susan Todd, A 25‐year review of sequential methodology in clinical studies, Statistics in Medicine, 10.1002/sim.2763, 26, 2, (237-252), (2006).
- Nina Timmesfeld, Helmut Schäfer, Hans‐Helge Müller, Increasing the sample size during clinical trials with t‐distributed test statistics without inflating the type I error rate, Statistics in Medicine, 10.1002/sim.2725, 26, 12, (2449-2464), (2006).
- Alan J. Phillips, Oliver N. Keene, Adaptive designs for pivotal trials: discussion points from the PSI Adaptive Design Expert Group, Pharmaceutical Statistics, 10.1002/pst.206, 5, 1, (61-66), (2006).
- Cyrus R. Mehta, Yannis Jemiai, A Consultant's Perspective on the Regulatory Hurdles to Adaptive Trials, Biometrical Journal, 10.1002/bimj.200610249, 48, 4, (604-608), (2006).
- Armin Koch, Confirmatory Clinical Trials with an Adaptive Design, Biometrical Journal, 10.1002/bimj.200510239, 48, 4, (574-585), (2006).
- Tim Friede, Meinhard Kieser, Sample Size Recalculation in Internal Pilot Study Designs: A Review, Biometrical Journal, 10.1002/bimj.200510238, 48, 4, (537-555), (2006).
- Helmut Schäfer, Nina Timmesfeld, Hans‐Helge Müller, An Overview of Statistical Approaches for Adaptive Designs and Design Modifications, Biometrical Journal, 10.1002/bimj.200510234, 48, 4, (507-520), (2006).
- Peter Bauer, Franz Koenig, The reassessment of trial perspectives from interim data—a critical view, Statistics in Medicine, 10.1002/sim.2180, 25, 1, (23-36), (2005).
- Michael A. Proschan, Two-Stage Sample Size Re-Estimation Based on a Nuisance Parameter: A Review, Journal of Biopharmaceutical Statistics, 10.1081/BIP-200062852, 15, 4, (559-574), (2005).
- Frank Miller, Variance Estimation in Clinical Studies with Interim Sample Size Reestimation, Biometrics, 10.1111/j.1541-0420.2005.00315.x, 61, 2, (355-361), (2005).
- John Whitehead, Stopping clinical trials by design, Nature Reviews Drug Discovery, 10.1038/nrd1553, 3, 11, (973-977), (2004).
- Peter Bauer, Werner Brannath, The advantages and disadvantages of adaptive designs for clinical trials, Drug Discovery Today, 10.1016/S1359-6446(04)03023-5, 9, 8, (351-357), (2004).
- Gillian A. Lancaster, Susanna Dodd, Paula R. Williamson, Design and analysis of pilot studies: recommendations for good practice, Journal of Evaluation in Clinical Practice, 10.1111/j..2002.384.doc.x, 10, 2, (307-312), (2004).
- Steven A. Julious, Sample sizes for clinical trials with Normal data, Statistics in Medicine, 10.1002/sim.1783, 23, 12, (1921-1986), (2004).
- Tim Friede, Meinhard Kieser, Sample size recalculation for binary data in internal pilot study designs, Pharmaceutical Statistics, 10.1002/pst.140, 3, 4, (269-279), (2004).
- Christopher S. Coffey, Keith E. Muller, Controlling Test Size While Gaining the Benefits of an Internal Pilot Design, Biometrics, 10.1111/j.0006-341X.2001.00625.x, 57, 2, (625-631), (2004).
- Martin Posch, Peter Bauer, Interim Analysis and Sample Size Reassessment, Biometrics, 10.1111/j.0006-341X.2000.01170.x, 56, 4, (1170-1176), (2004).
- Michael A. Proschan, Qing Liu, Sally Hunsberger, Practical midcourse sample size modification in clinical trials, Controlled Clinical Trials, 10.1016/S0197-2456(02)00240-4, 24, 1, (4-15), (2003).
- Meinhard Kieser, Tim Friede, Simple procedures for blinded sample size adjustment that do not affect the type I error rate, Statistics in Medicine, 10.1002/sim.1585, 22, 23, (3571-3581), (2003).
- Christopher S. Coffey, Keith E. Muller, Properties of internal pilots with the univariate approach to repeated measures, Statistics in Medicine, 10.1002/sim.1466, 22, 15, (2469-2485), (2003).
- Tim Friede, Meinhard Kieser, Blinded sample size reassessment in non‐inferiority and equivalence trials, Statistics in Medicine, 10.1002/sim.1456, 22, 6, (995-1007), (2003).
- Todd A. Schwartz, Jonathan S. Denne, Common threads between sample size recalculation and group sequential procedures, Pharmaceutical Statistics, 10.1002/pst.68, 2, 4, (263-271), (2003).
- Stephen Lake, Erin Kammann, Neil Klar, Rebecca Betensky, Sample size re‐estimation in cluster randomization trials, Statistics in Medicine, 10.1002/sim.1121, 21, 10, (1337-1350), (2002).
- Tim Friede, Meinhard Kieser, A comparison of methods for adaptive sample size adjustment, Statistics in Medicine, 10.1002/sim.972, 20, 24, (3861-3873), (2001).
- Neil Klar, Allan Donner, Current and future challenges in the design and analysis of cluster randomization trials, Statistics in Medicine, 10.1002/sim.1115, 20, 24, (3729-3740), (2001).
- Gernot Wassmer, Basic concepts of group sequential and adaptive group sequential test procedures, Statistical Papers, 10.1007/BF02925923, 41, 3, (253-279), (2000).
