Volume 21, Issue 16
Research Article

A solution to the problem of separation in logistic regression

Georg Heinze

Corresponding Author

E-mail address: georg.heinze@akh‐wien.ac.at

Section of Clinical Biometrics, Department of Medical Computer Sciences, University of Vienna, Spitalgasse 23, A‐1090 Vienna, Austria

Department of Medical Computer Sciences, University of Vienna, Spitalgasse 23, A‐1090 Vienna, AustriaSearch for more papers by this author
Michael Schemper

Section of Clinical Biometrics, Department of Medical Computer Sciences, University of Vienna, Spitalgasse 23, A‐1090 Vienna, Austria

Search for more papers by this author
First published: 26 July 2002
Citations: 813

Abstract

The phenomenon of separation or monotone likelihood is observed in the fitting process of a logistic model if the likelihood converges while at least one parameter estimate diverges to ± infinity. Separation primarily occurs in small samples with several unbalanced and highly predictive risk factors. A procedure by Firth originally developed to reduce the bias of maximum likelihood estimates is shown to provide an ideal solution to separation. It produces finite parameter estimates by means of penalized maximum likelihood estimation. Corresponding Wald tests and confidence intervals are available but it is shown that penalized likelihood ratio tests and profile penalized likelihood confidence intervals are often preferable. The clear advantage of the procedure over previous options of analysis is impressively demonstrated by the statistical analysis of two cancer studies. Copyright © 2002 John Wiley & Sons, Ltd.

Number of times cited according to CrossRef: 813

  • A Nested Mixed Effects Multicenter Model Examining the Risk Factors for Pediatric Trauma Return Visits Within 72 h, Journal of Surgical Research, 10.1016/j.jss.2020.08.021, 257, (370), (2021).
  • Bee pollination services and the enhancement of fruit yield associated with seed number in self-incompatible tangelos, Scientia Horticulturae, 10.1016/j.scienta.2020.109743, 276, (109743), (2021).
  • Cross-border cooperation between securities regulators, Journal of Accounting and Economics, 10.1016/j.jacceco.2020.101301, (101301), (2020).
  • Endosonography-guided gallbladder drainage versus percutaneous cholecystostomy in very high-risk surgical patients with acute cholecystitis: an international randomised multicentre controlled superiority trial (DRAC 1), Gut, 10.1136/gutjnl-2019-319996, 69, 6, (1085-1091), (2020).
  • What influences windpower decisions? A statistical analysis of licensing in Norway, Journal of Cleaner Production, 10.1016/j.jclepro.2020.122860, (122860), (2020).
  • Gallbladder disease, cholecystectomy, and pancreatic cancer risk in the International Pancreatic Cancer Case-Control Consortium (PanC4), European Journal of Cancer Prevention, 10.1097/CEJ.0000000000000572, 29, 5, (408-415), (2020).
  • Epidemiology of invasive meningococcal disease in Cyprus 2004 to 2018, Eurosurveillance, 10.2807/1560-7917.ES.2020.25.30.1900534, 25, 30, (2020).
  • An advanced prediction model for postoperative complications and early implant failure, Clinical Oral Implants Research, 10.1111/clr.13636, 31, 10, (928-935), (2020).
  • Discrepant glomerular filtration rate trends from creatinine and cystatin C in patients with chronic kidney disease: results from the KNOW-CKD cohort, BMC Nephrology, 10.1186/s12882-020-01932-4, 21, 1, (2020).
  • A multicenter mixed-effects model for inference and prediction of 72-h return visits to the emergency department for adult patients with trauma-related diagnoses, Journal of Orthopaedic Surgery and Research, 10.1186/s13018-020-01863-8, 15, 1, (2020).
  • Bark attributes determine variation in fire resistance in resprouting tree species, Forest Ecology and Management, 10.1016/j.foreco.2020.118385, 474, (118385), (2020).
  • Atenolol in cats with subclinical hypertrophic cardiomyopathy: a double-blind, placebo-controlled, randomized clinical trial of effect on quality of life, activity, and cardiac biomarkers, Journal of Veterinary Cardiology, 10.1016/j.jvc.2020.06.002, 30, (77-91), (2020).
  • An epistatic interaction between pre-natal smoke exposure and socioeconomic status has a significant impact on bronchodilator drug response in African American youth with asthma, BioData Mining, 10.1186/s13040-020-00218-7, 13, 1, (2020).
  • Drivers of future alien species impacts: An expert‐based assessment, Global Change Biology, 10.1111/gcb.15199, 26, 9, (4880-4893), (2020).
  • Quality of care and maternal mortality in a tertiary-level hospital in Mozambique: a retrospective study of clinicopathological discrepancies, The Lancet Global Health, 10.1016/S2214-109X(20)30236-9, 8, 7, (e965-e972), (2020).
  • undefined, 2020 5th International Conference on Computer and Communication Systems (ICCCS), 10.1109/ICCCS49078.2020.9118568, (15-19), (2020).
  • Robust estimation of the effect of an exposure on the change in a continuous outcome, BMC Medical Research Methodology, 10.1186/s12874-020-01027-6, 20, 1, (2020).
  • The analysis of influences of attitudes on mode choice under highly unbalanced mode share patterns., Journal of Choice Modelling, 10.1016/j.jocm.2020.100227, (100227), (2020).
  • Abnormal preoperative cognitive screening in aged surgical patients: a retrospective cohort analysis, British Journal of Anaesthesia, 10.1016/j.bja.2020.08.026, (2020).
  • Social support for de-carbonizing the energy system: The role of expressive partisanship, Environmental Science & Policy, 10.1016/j.envsci.2020.03.013, 109, (83-94), (2020).
  • Prediction of 7-Day Readmission Risk for Pediatric Trauma Patients, Journal of Surgical Research, 10.1016/j.jss.2020.03.068, 253, (254-261), (2020).
  • Telemedicine and Outpatient Subspecialty Visits among Pediatric Medicaid Beneficiaries, Academic Pediatrics, 10.1016/j.acap.2020.03.014, (2020).
  • Common Symptom Presentations in Individuals With Probable Comorbid Obsessive-Compulsive Disorder and Posttraumatic Stress Disorder, Journal of Nervous & Mental Disease, 10.1097/NMD.0000000000001211, 208, 10, (777-784), (2020).
  • Propensity-Matched Outcomes of Transcarotid Artery Revascularization Versus Carotid Endarterectomy, Journal of Surgical Research, 10.1016/j.jss.2019.12.003, 252, (22-29), (2020).
  • Efficacy of Single-Operator Cholangioscopy-Guided Lithotripsy Compared With Large Balloon Sphincteroplasty in Management of Difficult Bile Duct Stones in a Randomized Trial, Clinical Gastroenterology and Hepatology, 10.1016/j.cgh.2020.02.003, (2020).
  • Enterococcal Bacteremia in Children With Malignancies and Following Hematopoietic Stem Cell Transplantation, The Pediatric Infectious Disease Journal, 10.1097/INF.0000000000002579, 39, 4, (318-324), (2020).
  • A Comparative Study of the Bias Correction Methods for Differential Item Functioning Analysis in Logistic Regression with Rare Events Data, BioMed Research International, 10.1155/2020/1632350, 2020, (1-12), (2020).
  • Chimpanzee Coordination and Potential Communication in a Two-touchscreen Turn-taking Game, Scientific Reports, 10.1038/s41598-020-60307-9, 10, 1, (2020).
  • American Academy of Orthopedic Surgeons Appropriate Use Criteria for Hip Preservation Surgery: Variables That Drive Appropriateness for Surgery, Arthritis Care & Research, 10.1002/acr.23828, 72, 3, (405-411), (2020).
  • Calibration of probability predictions from machine‐learning and statistical models, Global Ecology and Biogeography, 10.1111/geb.13070, 29, 4, (760-765), (2020).
  • Costs and factors associated with heart failure following kidney transplantation – a single‐center retrospective cohort study, Transplant International, 10.1111/tri.13571, 33, 4, (414-422), (2020).
  • Supination adduction ankle fractures: Ankle fracture or pilon variant?, Injury, 10.1016/j.injury.2020.01.008, (2020).
  • Artificial eyespots on cattle reduce predation by large carnivores, Communications Biology, 10.1038/s42003-020-01156-0, 3, 1, (2020).
  • Propofol for endotracheal intubation in neonates: a dose-finding trial, Archives of Disease in Childhood - Fetal and Neonatal Edition, 10.1136/archdischild-2019-318474, 105, 5, (489-495), (2020).
  • Morphologic Factors Associated with Open Conversion During Holmium Laser Enucleation of the Prostate, Urology, 10.1016/j.urology.2020.08.017, (2020).
  • Risk factors for cutaneous reactions to allopurinol in Kinh Vietnamese: results from a case-control study, Arthritis Research & Therapy, 10.1186/s13075-020-02273-1, 22, 1, (2020).
  • Influence of Male Partners on HIV Disclosure Among South African Women in a Cluster Randomized PMTCT Intervention, AIDS and Behavior, 10.1007/s10461-020-03021-x, (2020).
  • Omission of cortical renorrhaphy during robotic partial nephrectomy: a Vattikuti Collective Quality Initiative (VCQI) database analysis, Urology, 10.1016/j.urology.2020.09.003, (2020).
  • Perceived Impact of COVID-19 on Pediatric Radiology Departments Around the World: WFPI COVID-19 Task Force Survey Results from 6 Continents, Radiology: Cardiothoracic Imaging, 10.1148/ryct.2020200422, 2, 5, (e200422), (2020).
  • Minimal Inhibitory Concentration of Clofazimine among Clinical Isolates of Nontuberculous Mycobacteria and Its Impact on Treatment Outcome, Chest, 10.1016/j.chest.2020.07.040, (2020).
  • Vancomycin Dosing Practices among Critical Care Pharmacists: A Survey of Society of Critical Care Medicine Pharmacists, Infectious Diseases: Research and Treatment, 10.1177/1178633720952078, 13, (117863372095207), (2020).
  • Minimally Invasive Stage 1 to Protect Against the Risk of Liver Failure: Results from the Hepatocellular Carcinoma Series of the Associating Liver Partition and Portal Vein Ligation for Staged Hepatectomy Italian Registry, Journal of Laparoendoscopic & Advanced Surgical Techniques, 10.1089/lap.2020.0563, 30, 10, (1082-1089), (2020).
  • Safety effectiveness and performance of lane support systems for driving assistance and automation – Experimental test and logistic regression for rare events, Accident Analysis & Prevention, 10.1016/j.aap.2020.105791, 148, (105791), (2020).
  • Multi-subject Stochastic Blockmodels for adaptive analysis of individual differences in human brain network cluster structure, NeuroImage, 10.1016/j.neuroimage.2020.116611, (116611), (2020).
  • Psychological Flexibility and Depression in Advanced CKD and Dialysis, Kidney Medicine, 10.1016/j.xkme.2020.07.004, (2020).
  • Towards a better understanding of the benefits and risks of country food consumption using the case of walruses in Nunavik (Northern Quebec, Canada), Science of The Total Environment, 10.1016/j.scitotenv.2020.137307, 719, (137307), (2020).
  • Is there a healthy migrant effect in relation to oral health among adults in England?, Public Health, 10.1016/j.puhe.2019.11.025, 181, (53-58), (2020).
  • Non -fatal overdose among people who inject drugs in Tehran, Iran, Substance Abuse Treatment, Prevention, and Policy, 10.1186/s13011-020-00323-0, 15, 1, (2020).
  • Discovering Cross-Reactivity in Urine Drug Screening Immunoassays through Large-Scale Analysis of Electronic Health Records, Clinical Chemistry, 10.1373/clinchem.2019.305409, 65, 12, (1522-1531), (2020).
  • Breaking seed coat impermeability to aid conservation and utilization of wild Vigna species, Genetic Resources and Crop Evolution, 10.1007/s10722-019-00872-9, (2020).
  • A Lectin Disrupts Vector Transmission of a Grapevine Ampelovirus, Viruses, 10.3390/v12080843, 12, 8, (843), (2020).
  • Pilot Observational Study to Detect Diurnal Variation and Misalignment in Heart Rate Among Critically Ill Patients, Frontiers in Neurology, 10.3389/fneur.2020.00637, 11, (2020).
  • Which Chronic Low Back Pain Patients Respond Favorably to Yoga, Physical Therapy, and a Self-care Book? Responder Analyses from a Randomized Controlled Trial, Pain Medicine, 10.1093/pm/pnaa153, (2020).
  • A comparative study on the performance of frequentist and Bayesian estimation methods under separation in logistic regression, Communications Faculty Of Science University of Ankara Series A1Mathematics and Statistics, 10.31801/cfsuasmas.614492, (89-109), (2020).
  • Meta‐analysis results do not reflect the real safety of biologics in psoriasis, British Journal of Dermatology, 10.1111/bjd.19244, 0, 0, (2020).
  • First identification of genotypes of Enterocytozoon bieneusi (Microsporidia) among symptomatic and asymptomatic children in Mozambique, PLOS Neglected Tropical Diseases, 10.1371/journal.pntd.0008419, 14, 6, (e0008419), (2020).
  • Distinctive Pathophysiology Underlying Constipation in Parkinson’s Disease: Implications for Cognitive Inefficiency, Journal of Clinical Medicine, 10.3390/jcm9061916, 9, 6, (1916), (2020).
  • What Motivates Behavior Change? Analyzing User Intentions to Adopt Clean Technologies in Low-Resource Settings Using the Theory of Planned Behavior, Energies, 10.3390/en13113021, 13, 11, (3021), (2020).
  • Influenza Vaccine Effectiveness by A(H3N2) Phylogenetic Subcluster and Prior Vaccination History: 2016–2017 and 2017–2018 Epidemics in Canada, The Journal of Infectious Diseases, 10.1093/infdis/jiaa138, (2020).
  • Cervical length surveillance for predicting spontaneous preterm birth in women with uterine anomalies: A cohort study, Acta Obstetricia et Gynecologica Scandinavica, 10.1111/aogs.13923, 0, 0, (2020).
  • Associations between obesity, dental caries, erosive tooth wear and periodontal disease in adolescents: a case–control study, European Archives of Paediatric Dentistry, 10.1007/s40368-020-00534-w, (2020).
  • Catalytic prior distributions with application to generalized linear models, Proceedings of the National Academy of Sciences, 10.1073/pnas.1920913117, (201920913), (2020).
  • Regression shrinkage methods for clinical prediction models do not guarantee improved performance: Simulation study, Statistical Methods in Medical Research, 10.1177/0962280220921415, (096228022092141), (2020).
  • Effects of Socialization on Adolescent Sexual Behaviors in Lao PDR, Journal of Child and Family Studies, 10.1007/s10826-020-01713-5, (2020).
  • Investigating discharge communication for chronic disease patients in three hospitals in India, PLOS ONE, 10.1371/journal.pone.0230438, 15, 4, (e0230438), (2020).
  • Can compassion, happiness and sympathetic concern be differentiated on the basis of facial expression?, Cognition and Emotion, 10.1080/02699931.2020.1747989, (1-13), (2020).
  • Comparing statistical analyses to estimate thresholds in ecotoxicology, PLOS ONE, 10.1371/journal.pone.0231149, 15, 4, (e0231149), (2020).
  • Ileocolic vascular curvature: a new CT finding of cecal volvulus, Abdominal Radiology, 10.1007/s00261-020-02491-w, (2020).
  • When Do Pediatricians Call the Ethics Consultation Service? Impact of Clinical Experience and Formal Ethics Training, AJOB Empirical Bioethics, 10.1080/23294515.2020.1737983, (1-8), (2020).
  • Farm Exit Among Smallholder Farmers of Nepal: A Bayesian Logistic Regression Models Approach, Agricultural Research, 10.1007/s40003-020-00465-4, (2020).
  • Single versus Multiple Dose Ivermectin Regimen in Onchocerciasis-Infected Persons with Epilepsy Treated with Phenobarbital: A Randomized Clinical Trial in the Democratic Republic of Congo, Pathogens, 10.3390/pathogens9030205, 9, 3, (205), (2020).
  • Probabilistic flood prediction for urban sub-catchments using sewer models combined with logistic regression models, Urban Water Journal, 10.1080/1573062X.2020.1726409, (1-11), (2020).
  • Defending the Faith? Assessing the Impact of State Religious Exclusivity on Territorial MID Initiation, Politics and Religion, 10.1017/S1755048319000488, (1-27), (2020).
  • Parental Knowledge and Attitudes About Universal Lipid Screening Among Children Aged 9 to 11 Years, Clinical Pediatrics, 10.1177/0009922820903043, (000992282090304), (2020).
  • Anisakis Sensitization in the Croatian Fish Processing Workers: Behavioral Instead of Occupational Risk Factors?, PLOS Neglected Tropical Diseases, 10.1371/journal.pntd.0008038, 14, 1, (e0008038), (2020).
  • Demographic, clinical, and scintigraphic comparison of patients affected by palmoplantar pustulosis and severe acne: a retrospective study, Clinical Rheumatology, 10.1007/s10067-019-04904-8, (2020).
  • Machine learning workflows to estimate class probabilities for precision cancer diagnostics on DNA methylation microarray data, Nature Protocols, 10.1038/s41596-019-0251-6, (2020).
  • Response of Strawberry Cultivars Inoculated with Macrophomina phaseolina in Australia , International Journal of Fruit Science, 10.1080/15538362.2019.1709114, (1-14), (2020).
  • Manipulating aspen ( Populus tremuloides ) seedling size characteristics to improve initial establishment and growth on competitive sites , Scandinavian Journal of Forest Research, 10.1080/02827581.2019.1707274, (1-17), (2020).
  • Drivers of primate richness and occurrence in a naturally patchy landscape in the Brazilian Amazon, Biodiversity and Conservation, 10.1007/s10531-020-02028-z, (2020).
  • Do successful PhD outcomes reflect the research environment rather than academic ability?, PLOS ONE, 10.1371/journal.pone.0236327, 15, 8, (e0236327), (2020).
  • Maternal and infant predictors of infant mortality in California, 2007–2015, PLOS ONE, 10.1371/journal.pone.0236877, 15, 8, (e0236877), (2020).
  • Exposure to family and domestic violence is associated with increased childhood hospitalisations, PLOS ONE, 10.1371/journal.pone.0237251, 15, 8, (e0237251), (2020).
  • Effectiveness and safety of vedolizumab in biologically naïve patients: A real-world multi-centre study, United European Gastroenterology Journal, 10.1177/2050640620948802, (205064062094880), (2020).
  • Daily Exposure to Air Pollution Particulate Matter Is Associated with Atrial Fibrillation in High-Risk Patients, International Journal of Environmental Research and Public Health, 10.3390/ijerph17176017, 17, 17, (6017), (2020).
  • Selection of influential variables in ordinal data with preponderance of zeros, Statistica Neerlandica, 10.1111/stan.12225, 0, 0, (2020).
  • Too Good to Be True: Firm Social Performance and the Risk of Data Breach, Information Systems Research, 10.1287/isre.2020.0939, (2020).
  • Forward variable selection for sparse ultra-high-dimensional generalized varying coefficient models, Japanese Journal of Statistics and Data Science, 10.1007/s42081-020-00090-z, (2020).
  • Firth's penalized method in Cox proportional hazard framework for developing predictive models for sparse or heavily censored survival data, Journal of Statistical Computation and Simulation, 10.1080/00949655.2020.1817924, (1-19), (2020).
  • The Impact of Police Attitudes Towards Offenders on Law-Enforcement Assisted Diversion Decisions, Police Quarterly, 10.1177/1098611120960714, (109861112096071), (2020).
  • Engagement in Harm Reduction Strategies After Suspected Fentanyl Contamination Among Opioid-Dependent Individuals, Journal of Community Health, 10.1007/s10900-020-00928-3, (2020).
  • Rare gems or mundane practice? Resource constraints as drivers of frugal innovation, Innovation, 10.1080/14479338.2020.1825089, (1-34), (2020).
  • What Turns the Taxman on? Tax Aggressiveness, Financial Statement Audits, and Tax Return Adjustments in Small Private Companies, The International Journal of Accounting, 10.1142/S1094406020500110, (2050011), (2020).
  • Jeffreys-prior penalty, finiteness and shrinkage in binomial-response generalized linear models, Biometrika, 10.1093/biomet/asaa052, (2020).
  • Plant response to habitat amount and configuration in Swedish forests, Diversity and Distributions, 10.1111/ddi.13019, 26, 3, (329-339), (2019).
  • Logistic Regression Procedure Using Penalized Maximum Likelihood Estimation for Differential Item Functioning, Journal of Educational Measurement, 10.1111/jedm.12253, 57, 3, (443-457), (2019).
  • Random‐effects meta‐analysis of few studies involving rare events, Research Synthesis Methods, 10.1002/jrsm.1370, 11, 1, (74-90), (2019).
  • Comment on unplanned out-of-hospital birth and risk factors of adverse perinatal outcome: findings from a prospective cohort, Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine, 10.1186/s13049-019-0626-2, 27, 1, (2019).
  • National energy transition, local partisanship? Elite cues, community identity, and support for clean power in the United States, Energy Research & Social Science, 10.1016/j.erss.2018.11.020, 50, (143-150), (2019).
  • Predictors of attrition and attendance in a fatherhood education program, Children and Youth Services Review, 10.1016/j.childyouth.2019.05.007, (2019).
  • See more

The full text of this article hosted at iucr.org is unavailable due to technical difficulties.