Raised conditional level of significance for the 2 × 2‐table when testing the equality of two probabilities
Summary
In this paper it is to be shown that Fisher's non‐randomizing exact test for 2 × 2‐tables, which is a conditional test, can by simple means be changed into an unconditional test using raised levels of significance; not seldom, especially for not too large samples, the level of significance can be doubled. This leads in many cases to a considerable increase of power of the test. A table with raised levels has been prepared up to sample sizes of 50 and a rule of thumb, which can be used if this table is not available, has been developEd.
Citing Literature
Number of times cited according to CrossRef: 102
- Tullio Basaglia, Maria Grazia Pia, Paolo Saracco, Evolutions in Photoelectric Cross Section Calculations and Their Validation, IEEE Transactions on Nuclear Science, 10.1109/TNS.2020.2971173, 67, 3, (492-501), (2020).
- Stefan Wellek, On powerful exact nonrandomized tests for the Poisson two-sample setting, Statistical Methods in Medical Research, 10.1177/0962280219900901, (096228021990090), (2020).
- Venla Kumpulainen, Satu J. Lehtola, Jetro J. Tuulari, Eero Silver, Anni Copeland, Riikka Korja, Hasse Karlsson, Linnea Karlsson, Harri Merisaari, Riitta Parkkola, Jani Saunavaara, Tuire Lähdesmäki, Noora M. Scheinin, Prevalence and Risk Factors of Incidental Findings in Brain MRIs of Healthy Neonates—The FinnBrain Birth Cohort Study, Frontiers in Neurology, 10.3389/fneur.2019.01347, 10, (2020).
- Wolfgang Bömicke, Friederike Rathmann, Maximilian Pilz, Justo Lorenzo Bermejo, Moritz Waldecker, Brigitte Ohlmann, Peter Rammelsberg, Andreas Zenthöfer, Clinical Performance of Posterior Inlay‐Retained and Wing‐Retained Monolithic Zirconia Resin‐Bonded Fixed Partial Dentures: Stage One Results of a Randomized Controlled Trial, Journal of Prosthodontics, 10.1111/jopr.13258, 0, 0, (2020).
- Louis Ehwerhemuepha, Heng Sok, Cyril Rakovski, A more powerful unconditional exact test of homogeneity for 2 × c contingency table analysis , Journal of Applied Statistics, 10.1080/02664763.2019.1601689, (1-11), (2019).
- Tullio Basaglia, Matteo Bonanomi, Federico Cattorini, Min Cheol Han, Gabriela Hoff, Chan Hyeong Kim, Sung Hun Kim, Matteo Marcoli, Maria Grazia Pia, Paolo Saracco, Validation of Shell Ionization Cross Sections for Monte Carlo Electron Transport, IEEE Transactions on Nuclear Science, 10.1109/TNS.2018.2851921, 65, 8, (2279-2302), (2018).
- Chris J. Lloyd, Enrico Ripamonti, An exhaustive numerical assessment of alternative unconditional tests of a binary treatment effect, Journal of Statistical Computation and Simulation, 10.1080/00949655.2018.1452018, 88, 11, (2150-2169), (2018).
- David Ellenberger, Tim Friede, An Unconditional Test for Change Point Detection in Binary Sequences with Applications to Clinical Registries, Methods of Information in Medicine, 10.3414/ME15-02-0020, 55, 04, (367-372), (2018).
- Robin Ristl, Susanne Urach, Gerd Rosenkranz, Martin Posch, Methods for the analysis of multiple endpoints in small populations: A review, Journal of Biopharmaceutical Statistics, 10.1080/10543406.2018.1489402, (1-29), (2018).
- Guogen Shan, Hua Zhang, Tao Jiang, Determining sample size for a binary diagnostic test in the presence of verification bias, Journal of Biopharmaceutical Statistics, 10.1080/10543406.2018.1452029, (1-10), (2018).
- Erin E. Gabriel, Martha Nason, Michael P. Fay, Dean A. Follmann, A boundary‐optimized rejection region test for the two‐sample binomial problem, Statistics in Medicine, 10.1002/sim.7579, 37, 7, (1047-1058), (2017).
- Michael A. Woodley, Shameem Younuskunju, Bipin Balan, Davide Piffer, Holocene Selection for Variants Associated With General Cognitive Ability: Comparing Ancient and Modern Genomes, Twin Research and Human Genetics, 10.1017/thg.2017.37, 20, 4, (271-280), (2017).
- Min Chen, Thiruma V. Arumugam, Gayeshika Leanage, Quang M. Tieng, Ashwin Yadav, Jeremy F. P. Ullmann, David T. She, Vy Truong, Marc J. Ruitenberg, David C. Reutens, Disease-modifying effect of intravenous immunoglobulin in an experimental model of epilepsy, Scientific Reports, 10.1038/srep40528, 7, 1, (2017).
- Kevin A. Naudé, Jean H. Greyling, Dieter Vogts, A polygraph test for trustworthy structural similarity, Information Systems, 10.1016/j.is.2016.07.005, 64, (194-205), (2017).
- Simon Bartke, Andreas Friedl, Felix Gelhaar, Laura Reh, Social comparison nudges—Guessing the norm increases charitable giving, Economics Letters, 10.1016/j.econlet.2016.12.023, 152, (73-75), (2017).
- Tullio Basaglia, Min Cheol Han, Gabriela Hoff, Chan Hyeong Kim, Sung Hun Kim, Maria Grazia Pia, Paolo Saracco, Quantitative Test of the Evolution of Geant4 Electron Backscattering Simulation, IEEE Transactions on Nuclear Science, 10.1109/TNS.2016.2617834, 63, 6, (2849-2865), (2016).
- Min Cheol Han, Han Sung Kim, Maria Grazia Pia, Tullio Basaglia, Matej Batic, Gabriela Hoff, Chan Hyeong Kim, Paolo Saracco, Validation of Cross Sections for Monte Carlo Simulation of the Photoelectric Effect, IEEE Transactions on Nuclear Science, 10.1109/TNS.2016.2521876, 63, 2, (1117-1146), (2016).
- C. Harry Hui, Sing-Hang Cheung, Esther Yuet Ying Lau, Doris Shui Ying Mok, Shu-Fai Cheung, Yuen Wai Kwan, Bereavement Hits Harder on Those Who Believe in Fate, Journal of Social and Clinical Psychology, 10.1521/jscp.2016.35.8.609, 35, 8, (609-628), (2016).
- Guogen Shan, Exact Statistical Inference for a 2×2 Table, Exact Statistical Inference for Categorical Data, 10.1016/B978-0-08-100681-8.00001-4, (1-27), (2016).
- Bibliography, Exact Statistical Inference for Categorical Data, 10.1016/B978-0-08-100681-8.09996-6, (49-54), (2016).
- Guogen Shan, Exact Statistical Inference for a 2×K Table, Exact Statistical Inference for Categorical Data, 10.1016/B978-0-08-100681-8.00002-6, (29-42), (2016).
- I SF Chan, Proving non-inferiority or equivalence of two treatments with dichotomous endpoints using exact methods, Statistical Methods in Medical Research, 10.1191/0962280203sm314ra, 12, 1, (37-58), (2016).
- Russell J. Sojourner, Jonathan F. Antin, The Effects of a Simulated Head-Up Display Speedometer on Perceptual Task Performance, Human Factors: The Journal of the Human Factors and Ergonomics Society, 10.1177/001872089003200306, 32, 3, (329-339), (2016).
- Joseph D. Warfield, Sarah Elise Roberts, Comparison of Test Sizing Approaches for Initial and Follow-On Evaluation of Strategic Weapon Systems, Quality Engineering, 10.1080/08982112.2014.957402, 27, 2, (230-252), (2015).
- Stefan Wellek, Nearly exact sample size calculation for powerful non‐randomized tests for differences between binomial proportions, Statistica Neerlandica, 10.1111/stan.12063, 69, 4, (358-373), (2015).
- A. Martín Andrés, I. Herranz Tejedor, M. Álvarez Hernández, Conditional and Unconditional Tests (and Sample Size) Based on Multiple Comparisons for Stratified 2 × 2 Tables, Computational and Mathematical Methods in Medicine, 10.1155/2015/147038, 2015, (1-8), (2015).
- BM Hardy, KL Pope, J Piovia-Scott, RN Brown, JE Foley, Itraconazole treatment reduces Batrachochytrium dendrobatidis prevalence and increases overwinter field survival in juvenile Cascades frogs, Diseases of Aquatic Organisms, 10.3354/dao02813, 112, 3, (243-250), (2015).
- Kevin A. Naudé, Jean H. Greyling, Dieter Vogts, When Similarity Measures Lie, Similarity Search and Applications, 10.1007/978-3-319-25087-8_11, (113-124), (2015).
- Sung Hun Kim, Maria Grazia Pia, Tullio Basaglia, Min Cheol Han, Gabriela Hoff, Chan Hyeong Kim, Paolo Saracco, Validation Test of Geant4 Simulation of Electron Backscattering, IEEE Transactions on Nuclear Science, 10.1109/TNS.2015.2401055, 62, 2, (451-479), (2015).
- Paul M. Lantos, Sallie R. Permar, Kate Hoffman, Geeta K. Swamy, The Excess Burden of Cytomegalovirus in African American Communities: A Geospatial Analysis, Open Forum Infectious Diseases, 10.1093/ofid/ofv180, 2, 4, (ofv180), (2015).
- Chris J. Lloyd, On the Exact Size of Tests of Treatment Effects in Multi‐Arm Clinical Trials, Australian & New Zealand Journal of Statistics, 10.1111/anzs.12089, 56, 4, (359-369), (2014).
- Jason T. Connor, Peter B. Imrey, Proportions: Inferences and Comparisons, Methods and Applications of Statistics in Clinical Trials, 10.1002/9781118596333, (570-594), (2014).
- Dungang Liu, Regina Liu, Min‐ge Xie, Exact Inference Methods for Rare Events, Wiley StatsRef: Statistics Reference Online, 10.1002/9781118445112, (1-6), (2014).
- Jason T. Connor, Peter B. Imrey, Proportions, Inferences and Comparisons, Wiley StatsRef: Statistics Reference Online, 10.1002/9781118445112, (2014).
- Dungang Liu, Regina Y. Liu, Min-ge Xie, Exact Meta-Analysis Approach for Discrete Data and its Application to 2 × 2 Tables With Rare Events, Journal of the American Statistical Association, 10.1080/01621459.2014.946318, 109, 508, (1450-1465), (2014).
- Mariana Blanco, Dirk Engelmann, Alexander K. Koch, Hans-Theo Normann, Preferences and beliefs in a sequential social dilemma: a within-subjects analysis, Games and Economic Behavior, 10.1016/j.geb.2014.05.005, 87, (122-135), (2014).
- Guogen Shan, Gregory E. Wilding, Powerful Exact Unconditional Tests for Agreement between Two Raters with Binary Endpoints, PLoS ONE, 10.1371/journal.pone.0097386, 9, 5, (e97386), (2014).
- Denni D Boos, L A Stefanski, Dennis D Boos, L. A Stefanski, Hypothesis Tests under Misspecification and Relaxed Assumptions, Essential Statistical Inference, 10.1007/978-1-4614-4818-1_8, (339-359), (2013).
- Denni D Boos, L A Stefanski, Dennis D Boos, L. A Stefanski, Large Sample Results for Likelihood-Based Methods, Essential Statistical Inference, 10.1007/978-1-4614-4818-1_6, (275-293), (2013).
- Denni D Boos, L A Stefanski, Dennis D Boos, L. A Stefanski, Bayesian Inference, Essential Statistical Inference, 10.1007/978-1-4614-4818-1_4, (163-203), (2013).
- Denni D Boos, L A Stefanski, Dennis D Boos, L. A Stefanski, Permutation and Rank Tests, Essential Statistical Inference, 10.1007/978-1-4614-4818-1_12, (449-530), (2013).
- Denni D Boos, L A Stefanski, Dennis D Boos, L. A Stefanski, Monte Carlo Simulation Studies, Essential Statistical Inference, 10.1007/978-1-4614-4818-1_9, (363-383), (2013).
- Denni D Boos, L A Stefanski, Dennis D Boos, L. A Stefanski, M-Estimation (Estimating Equations), Essential Statistical Inference, 10.1007/978-1-4614-4818-1_7, (297-337), (2013).
- Denni D Boos, L A Stefanski, Dennis D Boos, L. A Stefanski, Likelihood-Based Tests and Confidence Regions, Essential Statistical Inference, 10.1007/978-1-4614-4818-1_3, (125-161), (2013).
- George A. F. Seber, George A.F. Seber, Multivariate Hypothesis Tests, Statistical Models for Proportions and Probabilities, 10.1007/978-3-642-39041-8_4, (41-57), (2013).
- Denni D Boos, L A Stefanski, Dennis D Boos, L. A Stefanski, Large Sample Theory: The Basics, Essential Statistical Inference, 10.1007/978-1-4614-4818-1_5, (207-274), (2013).
- Denni D Boos, L A Stefanski, Dennis D Boos, L. A Stefanski, Jackknife, Essential Statistical Inference, 10.1007/978-1-4614-4818-1_10, (385-411), (2013).
- Denni D Boos, L A Stefanski, Dennis D Boos, L. A Stefanski, Roles of Modeling in Statistical Inference, Essential Statistical Inference, 10.1007/978-1-4614-4818-1_1, (3-23), (2013).
- E. L. Korn, L. M. McShane, B. Freidlin, Statistical Challenges in the Evaluation of Treatments for Small Patient Populations, Science Translational Medicine, 10.1126/scitranslmed.3004018, 5, 178, (178sr3-178sr3), (2013).
- Guogen Shan, More efficient unconditional tests for exchangeable binary data with equal cluster sizes, Statistics & Probability Letters, 10.1016/j.spl.2012.11.014, 83, 2, (644-649), (2013).
- Matej Batic, Gabriela Hoff, Maria Grazia Pia, Paolo Saracco, Georg Weidenspointner, Validation of Geant4 Simulation of Electron Energy Deposition, IEEE Transactions on Nuclear Science, 10.1109/TNS.2013.2272404, 60, 4, (2934-2957), (2013).
- Guogen Shan, A Note on Exact Conditional and Unconditional Tests for Hardy-Weinberg Equilibrium, Human Heredity, 10.1159/000353205, 76, 1, (10-17), (2013).
- Denni D Boos, L A Stefanski, Dennis D Boos, L. A Stefanski, Bootstrap, Essential Statistical Inference, 10.1007/978-1-4614-4818-1_11, (413-448), (2013).
- Guogen Shan, Changxing Ma, Unconditional tests for comparing two ordered multinomials, Statistical Methods in Medical Research, 10.1177/0962280212450957, 25, 1, (241-254), (2012).
- Markus Neuhäuser, Bibliography, Nonparametric Statistical Tests, 10.1201/b11427, (203-226), (2011).
- Ivan Chan, Inference on Proportions, Design and Analysis of Non-Inferiority Trials, 10.1201/b11039-12, (251-317), (2011).
- Mariana Blanco, Dirk Engelmann, Alexander K. Koch, Hans-Theo Normann, Belief elicitation in experiments: is there a hedging problem?, Experimental Economics, 10.1007/s10683-010-9249-1, 13, 4, (412-438), (2010).
- Graeme D. Ruxton, Markus Neuhäuser, Good practice in testing for an association in contingency tables, Behavioral Ecology and Sociobiology, 10.1007/s00265-010-1014-0, 64, 9, (1505-1513), (2010).
- Stefen Wellek, References, Testing Statistical Hypotheses of Equivalence and Noninferiority, Second Edition, 10.1201/EBK1439808184, (387-401), (2010).
- Chris J. Lloyd, P-values based on approximate conditioning and, Journal of Statistical Planning and Inference, 10.1016/j.jspi.2009.10.007, 140, 4, (1073-1081), (2010).
- Chris J. Lloyd, Exact tests based on pre-estimation and second order pivotals: non-inferiority trials, Journal of Statistical Computation and Simulation, 10.1080/00949650902806476, 80, 8, (841-851), (2010).
- Lee-Shen Chen, Ming-Chung Yang, Improved P -Values for Testing Marginal Homogeneity in 2 × 2 Contingency Tables , Communications in Statistics - Theory and Methods, 10.1080/03610920802678644, 38, 10, (1649-1663), (2009).
- Stian Lydersen, Morten W. Fagerland, Petter Laake, Recommended tests for association in 2×2 tables, Statistics in Medicine, 10.1002/sim.3531, 28, 7, (1159-1175), (2009).
- Axel Munk, Matthias Mielke, Gudrun Freitag, Guido Skipka, Testing noninferiority in three‐armed clinical trials based on likelihood ratio statistics, Canadian Journal of Statistics, 10.1002/cjs.5550350306, 35, 3, (413-431), (2009).
- A. Martín Andrés, I. Herranz Tejedor, Comments on ‘How conservative is Fisher's exact test? A quantitative evaluation of the two‐sample comparative binomial trial’ by G. G. Crans and J. J. Shuster, Statistics in Medicine 2008; 27:3598–3611, Statistics in Medicine, 10.1002/sim.3454, 28, 1, (173-174), (2008).
- Karl H. Schlag, Bringing Game Theory to Hypothesis Testing: Establishing Finite Sample Bounds on Inference, SSRN Electronic Journal, 10.2139/ssrn.1266059, (2008).
- Che-Yang Lin, Ming-Chung Yang, Improved p -Value Tests for Comparing Two Independent Binomial Proportions , Communications in Statistics - Simulation and Computation, 10.1080/03610910802417812, 38, 1, (78-91), (2008).
- Egbert A. van der Meulen, A Nonrandomized, Nonconservative Version of the Fisher Exact Test, Communications in Statistics - Theory and Methods, 10.1080/03610920701669827, 37, 5, (699-708), (2008).
- Willem Schaafsma, The Neyman‐Pearson theory for testing statistical hypotheses, Statistica Neerlandica, 10.1111/j.1467-9574.1971.tb00130.x, 25, 1, (1-27), (2008).
- Cong Han, Comparing two independent incidence rates using conditional and unconditional exact tests, Pharmaceutical Statistics, 10.1002/pst.289, 7, 3, (195-201), (2007).
- Chris J. Lloyd, Max V. Moldovan, Unconditional efficient one‐sided confidence limits for the odds ratio based on conditional likelihood, Statistics in Medicine, 10.1002/sim.2896, 26, 28, (5136-5146), (2007).
- Jason T. Connor, Peter B. Imrey, Proportions, Inferences, and Comparisons, Wiley Encyclopedia of Clinical Trials, 10.1002/9780471462422, (1-15), (2007).
- Mary C. Phipps, Peter M. Byron, A filter for “confidence interval -values”, Computational Statistics & Data Analysis, 10.1016/j.csda.2007.02.015, 51, 12, (6435-6446), (2007).
- Hardeo Sahai, Anwer Khurshid, On analysis of epidemiological data involving a 2×2 contingency table: an overview of fisher's exact test and yates' correction for continuity, Journal of Biopharmaceutical Statistics, 10.1080/10543409508835098, 5, 1, (43-70), (2007).
- H. J. A. Schouten, I. W. Molenaar, R. Van Strik, A. Boomsma, Comparing two independent binomial proportions by a modified chi square test, Biometrical Journal, 10.1002/bimj.4710220305, 22, 3, (241-248), (2007).
- Karim Hirji, References, Exact Analysis of Discrete Data, 10.1201/9781420036190, (485-513), (2005).
- Stefan Wellek, Statistical Methods for the Analysis of Two‐Arm Non‐inferiority Trials with Binary Outcomes, Biometrical Journal, 10.1002/bimj.200410090, 47, 1, (48-61), (2005).
- Jason T. Connor, Peter B. Imrey, Proportions, Inferences, and Comparisons, Encyclopedia of Biostatistics, 10.1002/0470011815, (2005).
- A. Munk, G. Skipka, B. Stratmann, Testing general hypotheses under binomial sampling: the two sample case—asymptotic theory and exact procedures, Computational Statistics & Data Analysis, 10.1016/j.csda.2004.05.035, 49, 3, (723-739), (2005).
- Lawrence Brown, Xuefeng Li, Confidence intervals for two sample binomial distribution, Journal of Statistical Planning and Inference, 10.1016/j.jspi.2003.09.039, 130, 1-2, (359-375), (2005).
- A. Martı́n Andrés, A.Silva Mato, J.M.Tapia Garcı́a, M.J.Sánchez Quevedo, Comparing the asymptotic power of exact tests in 2×2 tables, Computational Statistics & Data Analysis, 10.1016/j.csda.2003.11.012, 47, 4, (745-756), (2004).
- Seung‐Ho Kang, Su‐Jin Kim, A Comparison of the Three Conditional Exact Tests in Two‐way Contingency Tables Using the Unconditional Exact Power, Biometrical Journal, 10.1002/bimj.200310031, 46, 3, (320-330), (2004).
- G. Skipka, A. Munk, G. Freitag, Unconditional exact tests for the difference of binomial probabilities—contrasted and compared, Computational Statistics & Data Analysis, 10.1016/j.csda.2003.11.013, 47, 4, (757-773), (2004).
- Charles A. Graessle, Prenatal influence of mild decompressions on hooded rats, Developmental Psychobiology, 10.1002/dev.420130406, 13, 4, (399-407), (2004).
- Mary C. Phipps, Inequalities between hypergeometric tails, Journal of Applied Mathematics and Decision Sciences, 10.1155/S1173912603000154, 7, 3, (165-174), (2003).
- Mary Phipps, Inequalities Between Hypergeometric Tails, Journal of Applied Mathematics and Decision Sciences, 10.1207/S15327612JAMD0703_03, 7, 3, (165-174), (2003).
- Devan V. Mehrotra, Ivan S. F. Chan, Roger L. Berger, A Cautionary Note on Exact Unconditional Inference for a Difference between Two Independent Binomial Proportions, Biometrics, 10.1111/1541-0420.00051, 59, 2, (441-450), (2003).
- H. Finner, K. Strassburger, Structural properties of UMPU-tests for 2×2 tables and some applications, Journal of Statistical Planning and Inference, 10.1016/S0378-3758(01)00122-7, 104, 1, (103-120), (2002).
- Joachim Röhmel, Statistical considerations of FDA and CPMP rules for the investigation of new anti‐bacterial products, Statistics in Medicine, 10.1002/sim.729, 20, 17‐18, (2561-2571), (2001).
- Eugene Seneta, Mary C. Phipps, On the Comparison of Two Observed Frequencies, Biometrical Journal, 10.1002/1521-4036(200102)43:1<23::AID-BIMJ23>3.0.CO;2-8, 43, 1, (23-43), (2001).
- Joachim Röhmel, Ulrich Mansmann, Exact tests of equivalence and efficacy with a non‐zero lower bound for comparative studies by I. S. F. Chan, Statistics in Medicine, 17, 1403–1413 (1998), Statistics in Medicine, 10.1002/(SICI)1097-0258(19990715)18:13<1734::AID-SIM201>3.0.CO;2-7, 18, 13, (1734-1735), (1999).
- A. Martín Andrés, M.J. Sánchez Quevedo, A. Silva Mato, Fisher's Mid-P-value arrangement in 2×2 Comparative trials, Computational Statistics & Data Analysis, 10.1016/S0167-9473(98)90179-7, 29, 1, (107-115), (1998).
- Roger L. Berger, More Powerful Tests from Confidence Interval p Values , The American Statistician, 10.1080/00031305.1996.10473559, 50, 4, (314-318), (1996).
- Letters to the Editor, The American Statistician, 10.1080/00031305.1994.10476051, 48, 2, (174-177), (1994).
- A.Martín Andrés, A.Silva Mato, Choosing the optimal unconditioned test for comparing two independent proportions, Computational Statistics & Data Analysis, 10.1016/0167-9473(94)90148-1, 17, 5, (555-574), (1994).
- Philip H. Ramsey, Determining the best test for the 2×2 comparative trial, Journal of Statistical Computation and Simulation, 10.1080/00949658908811206, 34, 1, (51-65), (1989).
- Albert Madansky, Albert Madansky, Analysis of Cross-Classified Data, Prescriptions for Working Statisticians, 10.1007/978-1-4612-3794-5_9, (252-287), (1988).
- E. L. Lehmann, E. L. Lehmann, Unbiasedness: Theory and First Applications, Testing Statistical Hypotheses, 10.1007/978-1-4757-1923-9_4, (134-187), (1986).
- Letters to the Editor, The American Statistician, 10.1080/00031305.1977.10479221, 31, 3, (134-135), (1977).
- Lyman L. McDonald, Bruce M. Davis, George A. Milliken, A Nonrandomized Unconditional Test for Comparing Two Proportions in 2×2 Contingency Tables, Technometrics, 10.1080/00401706.1977.10489522, 19, 2, (145-157), (1977).
- See more
