A note on the tests for clustered matched‐pair binary data
Abstract
McNemar's test is used to assess the difference between two different procedures (treatments) using independent matched‐pair data. For matched‐pair data collected in clusters, the tests proposed by Durkalski et al. and Obuchowski are popular and commonly used in practice since these tests do not require distributional assumptions or assumptions on the structure of the within‐cluster correlation of the data. Motivated by these tests, this note proposes a modified Obuchowski test and illustrates comparisons of the proposed test with the extant methods. An extensive Monte Carlo simulation study suggests that the proposed test performs well with respect to the nominal size, and has higher power; Obuchowski's test is most conservative, and the performance of the Durkalski's test varies between the modified Obuchowski test and the original Obuchowski's test. These results form the basis for our recommendation that (i) for equal cluster size, the modified Obuchowski test is always preferred; (ii) for varying cluster size Durkalski's test can be used for a small number of clusters (e.g. K < 50), whereas for a large number of clusters (e.g. K ≥ 50) the modified Obuchowski test is preferred. Finally, to illustrate practical application of the competing tests, two real collections of clustered matched‐pair data are analyzed.
Citing Literature
Number of times cited according to CrossRef: 25
- Minh Nguyen, Gia H. Ngo, Nancy F. Chen, Hierarchical Character Embeddings: Learning Phonological and Semantic Representations in Languages of Logographic Origin Using Recursive Neural Networks, IEEE/ACM Transactions on Audio, Speech, and Language Processing, 10.1109/TASLP.2019.2955246, 28, (461-473), (2020).
- Ken Wu, Chen Lin, Alexander Ka-Ngai Lam, Leo Chan, Christopher Kai-Shun Leung, Wide-field Trend-based Progression Analysis of Combined Retinal Nerve Fiber Layer and Ganglion Cell Inner Plexiform Layer Thickness, Ophthalmology, 10.1016/j.ophtha.2020.03.019, (2020).
- Scott Mayer McKinney, Marcin Sieniek, Varun Godbole, Jonathan Godwin, Natasha Antropova, Hutan Ashrafian, Trevor Back, Mary Chesus, Greg C. Corrado, Ara Darzi, Mozziyar Etemadi, Florencia Garcia-Vicente, Fiona J. Gilbert, Mark Halling-Brown, Demis Hassabis, Sunny Jansen, Alan Karthikesalingam, Christopher J. Kelly, Dominic King, Joseph R. Ledsam, David Melnick, Hormuz Mostofi, Lily Peng, Joshua Jay Reicher, Bernardino Romera-Paredes, Richard Sidebottom, Mustafa Suleyman, Daniel Tse, Kenneth C. Young, Jeffrey De Fauw, Shravya Shetty, International evaluation of an AI system for breast cancer screening, Nature, 10.1038/s41586-019-1799-6, 577, 7788, (89-94), (2020).
- Feihui Zheng, Marco Yu, Christopher Kai-Shun Leung, Diagnostic criteria for detection of retinal nerve fibre layer thickness and neuroretinal rim width abnormalities in glaucoma, British Journal of Ophthalmology, 10.1136/bjophthalmol-2018-313581, 104, 2, (270-275), (2019).
- Antoinette Alas Bhattacharya, Elizabeth Allen, Nasir Umar, Adamu Umar Usman, Habila Felix, Ahmed Audu, Joanna RM Schellenberg, Tanya Marchant, Monitoring childbirth care in primary health facilities: a validity study in Gombe State, northeastern Nigeria, Journal of Global Health, 10.7189/jogh.09.020411, 9, 2, (2019).
- Jan Feld, Alexander Maxwell, Sampling error in lexicostatistical measurements, DiachronicaDiachronica. International Journal for Historical Linguistics, 10.1075/dia.18004.fel, 36, 1, (100-120), (2019).
- Yougui Wu, A robust adjustment to McNemar test when the data are clustered, Communications in Statistics - Theory and Methods, 10.1080/03610926.2019.1651864, (1-15), (2019).
- Christos Sachpekidis, P. Bäumer, K. Kopka, B. A. Hadaschik, M. Hohenfellner, A. Kopp-Schneider, U. Haberkorn, A. Dimitrakopoulou-Strauss, 68Ga-PSMA PET/CT in the evaluation of bone metastases in prostate cancer, European Journal of Nuclear Medicine and Molecular Imaging, 10.1007/s00259-018-3936-0, 45, 6, (904-912), (2018).
- Chin Man Poon, Ngai Sze Wong, Tsz Ho Kwan, Horas Tze Hoo Wong, Kenny Chi Wai Chan, Shui Shan Lee, Changes of sexual risk behaviors and sexual connections among HIV-positive men who have sex with men along their HIV care continuum, PLOS ONE, 10.1371/journal.pone.0209008, 13, 12, (e0209008), (2018).
- J. Kaspar, D. Kendal, R. Sore, S.J. Livesley, Random point sampling to detect gain and loss in tree canopy cover in response to urban densification, Urban Forestry & Urban Greening, 10.1016/j.ufug.2017.03.013, 24, (26-34), (2017).
- Donald A. Redelmeier, Robert J. Tibshirani, A simple method for analyzing matched designs with double controls: McNemar's test can be extended, Journal of Clinical Epidemiology, 10.1016/j.jclinepi.2016.08.006, 81, (51-55.e2), (2017).
- Sasapin.G. Prakalapakorn, Laura A. Vickers, Rolando Estrada, Sharon F. Freedman, Carlo Tomasi, Sina Farsiu, David K. Wallace, Using an Image Fusion Methodology to Improve Efficiency and Traceability of Posterior Pole Vessel Analysis by ROPtool, The Open Ophthalmology Journal, 10.2174/1874364101711010143, 11, 1, (143-151), (2017).
- Hiroyuki Saeki, Toshiro Tango, Jinfang Wang, Statistical inference for noninferiority of difference in proportions of clustered matched-pair data from multiple raters, Journal of Biopharmaceutical Statistics, 10.1080/10543406.2016.1148709, 27, 1, (70-83), (2016).
- Nathalie Jazmati, Rebecca Hein, Axel Hamprecht, Use of an Enrichment Broth Improves Detection of Extended-Spectrum-Beta-Lactamase-Producing Enterobacteriaceae in Clinical Stool Samples, Journal of Clinical Microbiology, 10.1128/JCM.02926-15, 54, 2, (467-470), (2015).
- Christina M. Lalama, Cheryl Jennings, Victoria A. Johnson, Robert W. Coombs, John E. McKinnon, James W. Bremer, Bryan R. Cobb, Gavin A. Cloherty, John W. Mellors, Heather J. Ribaudo, Comparison of Three Different FDA-Approved Plasma HIV-1 RNA Assay Platforms Confirms the Virologic Failure Endpoint of 200 Copies per Milliliter Despite Improved Assay Sensitivity, Journal of Clinical Microbiology, 10.1128/JCM.00801-15, 53, 8, (2659-2666), (2015).
- Zhao Yang, Ming Zhou, Kappa statistic for clustered matched‐pair data, Statistics in Medicine, 10.1002/sim.6113, 33, 15, (2612-2633), (2014).
- Guogen Shan, Changxing Ma, Exact Methods for Testing the Equality of Proportions for Binary Clustered Data From Otolaryngologic Studies, Statistics in Biopharmaceutical Research, 10.1080/19466315.2013.861767, 6, 1, (115-122), (2014).
- Gijs van Tulder, Marleen de Bruijne, Learning Features for Tissue Classification with the Classification Restricted Boltzmann Machine, Medical Computer Vision: Algorithms for Big Data, 10.1007/978-3-319-13972-2_5, (47-58), (2014).
- Paul D. Evans, Chad M. Miller, Daniele Marin, Sandra S. Stinnett, Terence Z. Wong, Erik K. Paulson, Lisa M. Ho, FDG-PET/CT Characterization of Adrenal Nodules, Academic Radiology, 10.1016/j.acra.2013.02.010, 20, 8, (923-929), (2013).
- Zhao Yang, Xuezheng Sun, James W. Hardin, Confidence intervals for the difference of marginal probabilities in clustered matched‐pair binary data, Pharmaceutical Statistics, 10.1002/pst.1523, 11, 5, (386-393), (2012).
- Zhao Yang, Xuezheng Sun, James W. Hardin, Testing non-inferiority for clustered matched-pair binary data in diagnostic medicine, Computational Statistics & Data Analysis, 10.1016/j.csda.2011.06.019, 56, 5, (1301-1320), (2012).
- Zhao Yang, Xuezheng Sun, James W. Hardin, Testing ratio of marginal probabilities in clustered matched-pair binary data, Computational Statistics & Data Analysis, 10.1016/j.csda.2011.10.025, 56, 6, (1829-1836), (2012).
- Eric H. Weiss, Faisal M. Merchant, Andre d'Avila, Lori Foley, Vivek Y. Reddy, Jagmeet P. Singh, Theofanie Mela, Jeremy N. Ruskin, Antonis A. Armoundas, A Novel Lead Configuration for Optimal Spatio-Temporal Detection of Intracardiac Repolarization Alternans, Circulation: Arrhythmia and Electrophysiology, 10.1161/CIRCEP.109.934208, 4, 3, (407-417), (2011).
- Zhao Yang, Xuezheng Sun, James W. Hardin, Testing marginal homogeneity in clustered matched-pair data, Journal of Statistical Planning and Inference, 10.1016/j.jspi.2010.10.002, 141, 3, (1313-1318), (2011).
- Carolyn Parker, Jeffrey Grigg, Stephanie D'Souza, Charlie Mitchell, Erica Smith, Informed aspirations in science and engineering with upper elementary students after 1 year of a STEM intensive university‐school district partnership, School Science and Mathematics, 10.1111/ssm.12428, 0, 0, (undefined).




