Influence of Random Measurement Error on Estimated Rates of Headache Chronification and Remission

Authors


  • Financial Support: Research reported in this publication was supported by the National Institute of Neurological Disorders and Stroke of the National Institutes of Health under award number R01NS065257. The original study was funded by the National Headache Foundation through a grant from Ortho-McNeil Neurologics, Inc.
  • Conflicts of Interest: Timothy T. Houle: Dr. Houle receives research support from GlaxoSmithKline and Merck; Dana P. Turner: Ms. Turner receives research support from Merck; Todd A. Smitherman: Dr. Smitherman receives research support from Merck; Donald B. Penzien: Dr. Penzien receives research support from Merck; Richard B. Lipton: Dr. Richard B. Lipton receives research support from the NIH [PO1 AG03949 (Program Director), PO1AG027734 (Project Leader), RO1AG025119 (Investigator), RO1AG022374-06A2 (Investigator), RO1AG034119 (Investigator), RO1AG12101 (Investigator), K23AG030857 (Mentor), K23NS05140901A1 (Mentor), and K23NS47256 (Mentor)], the National Headache Foundation, and the Migraine Research Fund; serves on the editorial boards of Neurology and Cephalalgia and as senior advisor to Headache, has reviewed for the NIA and NINDS, holds stock options in eNeura Therapeutics (a company without commercial products); serves as consultant, advisory board member, or has received honoraria from: Allergan, American Headache Society, Autonomic Technologies, Boehringer-Ingelheim Pharmaceuticals, Boston Scientific, Bristol Myers Squibb, Cognimed, Colucid, Eli Lilly, eNeura Therapeutics, GlaxoSmithKline, MAP, Merck, Nautilus Neuroscience, Novartis, NuPathe, Vedanta, Zogenix.

Address all correspondence to T.T. Houle, Department of Anesthesiology, Wake Forest University School of Medicine, Medical Center Boulevard, Winston-Salem, NC 27157, USA, email: thoule@wakehealth.edu

Abstract

Objective

To examine the potential influence of random measurement error on estimated rates of chronification and remission.

Background

Studies of headache chronification and remission examine the proportion of headache sufferers that move across a boundary of 15 headache days per month between 2 points in time. At least part of that apparent movement may represent measurement error or random variation in headache activity over time.

Methods

A mathematical simulation was conducted to examine the influence of varying degrees of measurement error on rates of chronic migraine onset and remission. Using data from the American Migraine Prevalence and Prevention Study, we estimated a starting distribution of headache days from 0 to 30 in the migraine population. Assuming various levels of measurement error, we then simulated 2 sets of data for Time 1 and Time 2. The “individuals” in this study were assumed to have no real change in headache frequency from Time 1 to Time 2. The observed variations in headache frequency were those influenced by imputed random variance to resemble typical measurement error or natural variability. Using this simulation approach, we estimated the amount of chronification and remission rates that might be attributed simply to statistical artifacts such as unreliability or regression to the mean.

Results

As the degree of measurement error increased, the amounts of illusory chronification and remission increased substantially. For example, if the headache frequency of sufferers randomly varies by only 2 headache days each month due to chance alone, a substantial degree of illusory chronification (0.6% to 1.3%) and illusory remission (10.3% to 23.5%) rates are expected simply due to random variation.

Conclusions

Random variation, without real change, has the potential to influence estimated rates of progression and remission in longitudinal migraine studies. The magnitude of random variation needed to fully reproduce observed rates of progression and remission are implausibly large. Recommendations are offered to improve estimation of rates of progression and remission, reducing the influence of random variation.

Ancillary