Sample size calculations for micro‐randomized trials in mHealth
Abstract
The use and development of mobile interventions are experiencing rapid growth. In “just‐in‐time” mobile interventions, treatments are provided via a mobile device, and they are intended to help an individual make healthy decisions ‘in the moment,’ and thus have a proximal, near future impact. Currently, the development of mobile interventions is proceeding at a much faster pace than that of associated data science methods. A first step toward developing data‐based methods is to provide an experimental design for testing the proximal effects of these just‐in‐time treatments. In this paper, we propose a ‘micro‐randomized’ trial design for this purpose. In a micro‐randomized trial, treatments are sequentially randomized throughout the conduct of the study, with the result that each participant may be randomized at the 100s or 1000s of occasions at which a treatment might be provided. Further, we develop a test statistic for assessing the proximal effect of a treatment as well as an associated sample size calculator. We conduct simulation evaluations of the sample size calculator in various settings. Rules of thumb that might be used in designing a micro‐randomized trial are discussed. This work is motivated by our collaboration on the HeartSteps mobile application designed to increase physical activity. Copyright © 2015 John Wiley & Sons, Ltd.
Citing Literature
Number of times cited according to CrossRef: 33
- Suresh Kumar Mukhiya, Jo Dugstad Wake, Yavuz Inal, Yngve Lamo, Adaptive Systems for Internet-Delivered Psychological Treatments, IEEE Access, 10.1109/ACCESS.2020.3002793, 8, (112220-112236), (2020).
- N. Bidargaddi, G. Schrader, P. Klasnja, J. Licinio, S. Murphy, Designing m-Health interventions for precision mental health support, Translational Psychiatry, 10.1038/s41398-020-00895-2, 10, 1, (2020).
- O. T. Inan, P. Tenaerts, S. A. Prindiville, H. R. Reynolds, D. S. Dizon, K. Cooper-Arnold, M. Turakhia, M. J. Pletcher, K. L. Preston, H. M. Krumholz, B. M. Marlin, K. D. Mandl, P. Klasnja, B. Spring, E. Iturriaga, R. Campo, P. Desvigne-Nickens, Y. Rosenberg, S. R. Steinhubl, R. M. Califf, Digitizing clinical trials, npj Digital Medicine, 10.1038/s41746-020-0302-y, 3, 1, (2020).
- Shuang Li, Alexandra M. Psihogios, Elise R. McKelvey, Annisa Ahmed, Mashfiqui Rabbi, Susan Murphy, Micro-Randomized Trials for Promoting Engagement in Mobile Health Data Collection: Adolescent/Young Adult Oral Chemotherapy Adherence as an Example, Current Opinion in Systems Biology, 10.1016/j.coisb.2020.07.002, (2020).
- Peng Liao, Kristjan Greenewald, Predrag Klasnja, Susan Murphy, Personalized HeartSteps, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 10.1145/3381007, 4, 1, (1-22), (2020).
- Predrag Klasnja, Dori E Rosenberg, Jing Zhou, Jane Anau, Anirban Gupta, David E Arterburn, A quality-improvement optimization pilot of BariFit, a mobile health intervention to promote physical activity after bariatric surgery, Translational Behavioral Medicine, 10.1093/tbm/ibaa040, (2020).
- Eric Hekler, Jasmin A Tiro, Christine M Hunter, Camille Nebeker, Precision Health: The Role of the Social and Behavioral Sciences in Advancing the Vision, Annals of Behavioral Medicine, 10.1093/abm/kaaa018, (2020).
- Stephanie M. Carpenter, Marianne Menictas, Inbal Nahum-Shani, David W. Wetter, Susan A. Murphy, Developments in Mobile Health Just-in-Time Adaptive Interventions for Addiction Science, Current Addiction Reports, 10.1007/s40429-020-00322-y, (2020).
- Peng Liao, Predrag Klasnja, Susan Murphy, Off-Policy Estimation of Long-Term Average Outcomes with Applications to Mobile Health, Journal of the American Statistical Association, 10.1080/01621459.2020.1807993, (1-23), (2020).
- Danielle Arigo, Danielle E. Jake-Schoffman, Kathleen Wolin, Ellen Beckjord, Eric B. Hekler, Sherry L. Pagoto, The history and future of digital health in the field of behavioral medicine, Journal of Behavioral Medicine, 10.1007/s10865-018-9966-z, 42, 1, (67-83), (2019).
- Jinhyuk Kim, David Marcusson-Clavertz, Kazuhiro Yoshiuchi, Joshua M. Smyth, Potential benefits of integrating ecological momentary assessment data into mHealth care systems, BioPsychoSocial Medicine, 10.1186/s13030-019-0160-5, 13, 1, (2019).
- Shivayogi V. Hiremath, Amir Mohammad Amiri, Binod Thapa-Chhetry, Gretchen Snethen, Mary Schmidt-Read, Marlyn Ramos-Lamboy, Donna L. Coffman, Stephen S. Intille, Mobile health-based physical activity intervention for individuals with spinal cord injury in the community: A pilot study, PLOS ONE, 10.1371/journal.pone.0223762, 14, 10, (e0223762), (2019).
- Nicholas J. Seewald, Shawna N. Smith, Andy Jinseok Lee, Predrag Klasnja, Susan A. Murphy, Practical Considerations for Data Collection and Management in Mobile Health Micro-randomized Trials, Statistics in Biosciences, 10.1007/s12561-018-09228-w, (2019).
- Severin Haug, Raquel Paz Castro, Urte Scholz, Tobias Kowatsch, Michael Patrick Schaub, Theda Radtke, Efficacy of a mobile phone-delivered just-in-time planning intervention to reduce alcohol use in adolescents: results of a randomized controlled crossover trial (Preprint), JMIR mHealth and uHealth, 10.2196/16937, (2019).
- Emily B Kroska, Sydney Hoel, Amanda Victory, Susan A Murphy, Melvin G McInnis, Zachary N Stowe, Amy Cochran, Optimizing Acceptance and Commitment Therapy Microintervention via a Mobile App with Two Cohorts: Protocol for Micro-Randomized Trials (Preprint), JMIR Research Protocols, 10.2196/17086, (2019).
- Predrag Klasnja, Shawna Smith, Nicholas J Seewald, Andy Lee, Kelly Hall, Brook Luers, Eric B Hekler, Susan A Murphy, Efficacy of Contextually Tailored Suggestions for Physical Activity: A Micro-randomized Optimization Trial of HeartSteps, Annals of Behavioral Medicine, 10.1093/abm/kay067, 53, 6, (573-582), (2018).
- Brook Luers, Predrag Klasnja, Susan Murphy, Standardized Effect Sizes for Preventive Mobile Health Interventions in Micro-randomized Trials, Prevention Science, 10.1007/s11121-017-0862-5, 20, 1, (100-109), (2018).
- Linda M. Collins, Linda M. Collins, Introduction to Adaptive Interventions, Optimization of Behavioral, Biobehavioral, and Biomedical Interventions, 10.1007/978-3-319-72206-1_8, (267-287), (2018).
- Kathleen Gray, Cecily Gilbert, Digital Health Research Methods and Tools: Suggestions and Selected Resources for Researchers, Advances in Biomedical Informatics, 10.1007/978-3-319-67513-8_2, (5-34), (2018).
- Sunmoo Yoon, Joseph E. Schwartz, Matthew M. Burg, Ian M. Kronish, Carmela Alcantara, Jacob Julian, Faith Parsons, Karina W. Davidson, Keith M. Diaz, Using Behavioral Analytics to Increase Exercise: A Randomized N-of-1 Study, American Journal of Preventive Medicine, 10.1016/j.amepre.2017.12.011, 54, 4, (559-567), (2018).
- Claire McCallum, John Rooksby, Cindy M Gray, Evaluating the Impact of Physical Activity Apps and Wearables: Interdisciplinary Review, JMIR mHealth and uHealth, 10.2196/mhealth.9054, 6, 3, (e58), (2018).
- Mashfiqui Rabbi, Meredith Philyaw Kotov, Rebecca Cunningham, Erin E Bonar, Inbal Nahum-Shani, Predrag Klasnja, Maureen Walton, Susan Murphy, Toward Increasing Engagement in Substance Use Data Collection: Development of the Substance Abuse Research Assistant App and Protocol for a Microrandomized Trial Using Adolescents and Emerging Adults, JMIR Research Protocols, 10.2196/resprot.9850, 7, 7, (e166), (2018).
- Amy Cochran, Livia Belman-Wells, Melvin McInnis, Engagement Strategies for Self-Monitoring Symptoms of Bipolar Disorder With Mobile and Wearable Technology: Protocol for a Randomized Controlled Trial, JMIR Research Protocols, 10.2196/resprot.9899, 7, 5, (e130), (2018).
- Daniel J. Luckett, Eric B. Laber, Anna R. Kahkoska, David M. Maahs, Elizabeth Mayer-Davis, Michael R. Kosorok, Estimating Dynamic Treatment Regimes in Mobile Health Using V-Learning, Journal of the American Statistical Association, 10.1080/01621459.2018.1537919, (1-34), (2018).
- Audrey Boruvka, Daniel Almirall, Katie Witkiewitz, Susan A. Murphy, Assessing Time-Varying Causal Effect Moderation in Mobile Health, Journal of the American Statistical Association, 10.1080/01621459.2017.1305274, 113, 523, (1112-1121), (2017).
- Rute Vieira, Suzanne McDonald, Vera Araújo-Soares, Falko F. Sniehotta, Robin Henderson, Dynamic modelling of n-of-1 data: powerful and flexible data analytics applied to individualised studies, Health Psychology Review, 10.1080/17437199.2017.1343680, 11, 3, (222-234), (2017).
- undefined, Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17, 10.1145/3025453.3026013, (3071-3082), (2017).
- Wendy Nilsen, Emre Ertin, Eric B. Hekler, Santosh Kumar, Insup Lee, Rahul Mangharam, Misha Pavel, James M. Rehg, William Riley, Daniel E. Rivera, Donna Spruijt-Metz, Modeling Opportunities in mHealth Cyber-Physical Systems, Mobile Health, 10.1007/978-3-319-51394-2, (443-453), (2017).
- undefined, Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers on - UbiComp '17, 10.1145/3123024.3125611, (781-789), (2017).
- Andrea T. Kozak, Joanna Buscemi, Misty A. W. Hawkins, Monica L. Wang, Jessica Y. Breland, Kathryn M. Ross, Anupama Kommu, Technology-based interventions for weight management: current randomized controlled trial evidence and future directions, Journal of Behavioral Medicine, 10.1007/s10865-016-9805-z, 40, 1, (99-111), (2016).
- Daniel Almirall, Andrea Chronis-Tuscano, Adaptive Interventions in Child and Adolescent Mental Health, Journal of Clinical Child & Adolescent Psychology, 10.1080/15374416.2016.1152555, 45, 4, (383-395), (2016).
- Eric B. Laber, Eric J. Rose, Marie Davidian, Anastasios A. Tsiatis, Q‐Learning, Wiley StatsRef: Statistics Reference Online, 10.1002/9781118445112, (1-10), (2014).
- Gongjun Xu, Zhenke Wu, Susan A. Murphy, Micro‐Randomized Trial, Wiley StatsRef: Statistics Reference Online, 10.1002/9781118445112, (1-6), (2014).




