Address correspondence to Peter J. Veazie, Ph.D., Department of Community and Preventive Medicine, University of Rochester, 601 Elmwood Ave., Box 644, Rochester, NY 14642.
When to Combine Hypotheses and Adjust for Multiple Tests
Article first published online: 21 FEB 2006
Health Services Research
Volume 41, Issue 3p1, pages 804–818, June 2006
How to Cite
Veazie, P. J. (2006), When to Combine Hypotheses and Adjust for Multiple Tests. Health Services Research, 41: 804–818. doi: 10.1111/j.1475-6773.2006.00512.x
- Issue published online: 21 FEB 2006
- Article first published online: 21 FEB 2006
- Composite hypotheses;
- joint tests;
- multiple hypotheses;
- significance level adjustment
Objective. To provide guidelines for identifying composite hypotheses and addressing the probability of false rejection for multiple hypotheses.
Data Sources and Study Setting. Examples from the literature in health services research are used to motivate the discussion of composite hypothesis tests and multiple hypotheses.
Methods. This article is a didactic presentation.
Principal Findings. It is not rare to find mistaken inferences in health services research because of inattention to appropriate hypothesis generation and multiple hypotheses testing. Guidelines are presented to help researchers identify composite hypotheses and set significance levels to account for multiple tests.
Conclusions. It is important for the quality of scholarship that inferences are valid: properly identifying composite hypotheses and accounting for multiple tests provides some assurance in this regard.