Address correspondence to Michael Davern, Ph.D., Assistant Professor, Division of Health Policy and Management, University of Minnesota, School of Public Health, 2221 University Avenue, S.E., Minneapolis, MN. Holly Rodin, Ph.D., is with the Service Employees International Union, St. Paul, MN. Lynn A. Blewett, Ph.D., Associate Professor, and Kathleen Thiede Call, Ph.D., Associate Professor, are with the Division of Health Policy and Management, University of Minnesota, School of Public Health, Minneapolis, MN.
Are the Current Population Survey Uninsurance Estimates Too High? An Examination of the Imputation Process
Article first published online: 16 FEB 2007
Health Services Research
Volume 42, Issue 5, pages 2038–2055, October 2007
How to Cite
Davern, M., Rodin, H., Blewett, L. A. and Call, K. T. (2007), Are the Current Population Survey Uninsurance Estimates Too High? An Examination of the Imputation Process. Health Services Research, 42: 2038–2055. doi: 10.1111/j.1475-6773.2007.00703.x
- Issue published online: 16 FEB 2007
- Article first published online: 16 FEB 2007
- Health insurance coverage;
- current population survey;
- annual social and economic supplement;
- hotdeck imputation;
- item nonresponse;
- missing data
Research Objective. To determine whether the imputation procedure used to replace missing data by the U.S. Census Bureau produces bias in the estimates of health insurance coverage in the Current Population Survey's (CPS) Annual Social and Economic Supplement (ASEC).
Data Source. 2004 CPS-ASEC.
Study Design. Eleven percent of the respondents to the monthly CPS do not take the ASEC supplement and the entire supplement for these respondents is imputed by the Census Bureau. We compare the health insurance coverage of these “full-supplement imputations” with those respondents answering the ASEC supplement. We then compare demographic characteristics of the two groups and model the likelihood of having insurance coverage given the data are imputed controlling for demographic characteristics. Finally, in order to gauge the impact of imputation on the uninsurance rate we remove the full-supplement imputations and reweight the data, and we also use the multivariate regression model to simulate what the uninsurance rate would be under the counter-factual simulation that no cases had the full-supplement imputation.
Population Studied. The noninstitutionalized U.S. population under 65 years of age in 2004.
Data Extraction Methods. The CPS-ASEC survey was extracted from the U.S. Census Bureau's FTP web page in September of 2004 (http://www.bls.census.gov/ferretftp.htm).
Principal Findings. In the 2004 CPS-ASEC, 59.3 percent of the full-supplement imputations under age 65 years had private health insurance coverage as compared with 69.1 percent of the nonfull-supplement imputations. Furthermore, full-supplement imputations have a 26.4 percent uninsurance rate while all others have an uninsurance rate of 16.6 percent. Having imputed data remains a significant predictor of health insurance coverage in multivariate models with demographic controls. Both our reweighting strategy and our counterfactual modeling show that the uninsured rate is approximately one percentage point higher than it should be for people under 65 (i.e., approximately 2.5 million more people are counted as uninsured due to this imputation bias).
Conclusions. The imputed ASEC data are coding too many people to be uninsured. The situation is complicated by the current survey items in the ASEC instrument allowing all members of a household to be assigned coverage with the single press of a button. The Census Bureau should consider altering its imputation specifications and, more importantly, altering how it collects survey data from those who respond to the supplement.
Implications for Policy Delivery or Practice. The bias affects many different policy simulations, policy evaluations and federal funding allocations that rely on the CPS-ASEC data.
Primary Funding Source. The Robert Wood Johnson Foundation.