Measurement error and outcomes defined by exceeding a threshold: biased findings in comparative effectiveness trials
Article first published online: 12 AUG 2012
Copyright © 2012 John Wiley & Sons, Ltd.
Volume 11, Issue 6, pages 429–441, November/December 2012
How to Cite
Bůžková, P. (2012), Measurement error and outcomes defined by exceeding a threshold: biased findings in comparative effectiveness trials. Pharmaceut. Statist., 11: 429–441. doi: 10.1002/pst.1530
- Issue published online: 6 NOV 2012
- Article first published online: 12 AUG 2012
- Agency for Healthcare Research and Quality. Grant Number: R21HS019516
- comparative effectiveness;
- measurement error;
- responder analysis;
- threshold-defined outcome
In medical studies, the long-term level of a risk factor exceeding a threshold is often an outcome of interest. In practice, such a risk factor may not be directly measurable. Instead, outcome variables are based on a single or multiple biomedical measurements that have substantial variability. This variability is due to measurement error in a strict sense, true day-to-day variability, or a combination of the two. Estimates of prevalence based on such outcomes are biased; some individuals with long-term levels below the threshold will be diagnosed, and some with long-term levels above the threshold will not be diagnosed. From a public health point of view, this is a relatively minor concern; it is much less important than the fact that many individuals are not tested at all. However, in comparative effectiveness research studies, such as clinical trials evaluating a new treatment as compared with a placebo or a gold standard treatment, the combination of a noisy measurement and a threshold can distort the studies’ conclusions in important ways. Using simulations and theoretical formulas, we systematically describe the bias of prevalence difference and prevalence ratio when comparing arms and its effect on trial conclusions. Copyright © 2012 John Wiley & Sons, Ltd.