Get access

Can Additional Patient Experience Items Improve the Reliability of and Add New Domains to the CAHPS® Hospital Survey?

Authors

  • Arlyss Anderson Rothman,

    1. Phillip R. Lee Institute for Health Policy Studies, 401 Miner Road, Orinda, CA 94563,
    Search for more papers by this author
    • Address correspondence to Arlyss Anderson Rothman, Ph.D., M.H.S., R.N.-C., F.N.P., UCSF, Phillip R. Lee Institute for Health Policy Studies, 401 Miner Road, Orinda, CA 94563; e-mail: arlyssar@aol.com. Hayoung Park, Ph.D., is with the Seoul National University, Seoul, South Korea. Ron D. Hays, Ph.D., is with the UCLA Department of Medicine/Division of General Internal Medicine and Health Services Research, Los Angeles, CA. Carol Edwards, B.A., is with the Rand Corporation, Santa Monica, CA. R. Adams Dudley, M.D., M.B.A., is with the UCSF, Phillip R. Lee Institute for Health Policy Studies, San Francisco, CA.

  • Hayoung Park,

    1. Seoul National University, Seoul, South Korea,
    Search for more papers by this author
  • Ron D. Hays,

    1. UCLA Department of Medicine/Division of General Internal Medicine and Health Services Research, Los Angeles, CA,
    Search for more papers by this author
  • Carol Edwards,

    1. Rand Corporation, Santa Monica, CA
    Search for more papers by this author
  • R.Adams Dudley

    1. UCSF, Phillip R. Lee Institute for Health Policy Studies, San Francisco, CA
    Search for more papers by this author

Abstract

Context. The Centers for Medicare and Medicaid Services will introduce the reporting of patient surveys in 2008. The Consumer Assessment of Health Care Providers and Systems (CAHPS®) Hospital Survey contains 18 questions about hospital care. Internal consistency reliability of the discharge information scale is relatively low and some important domains of care are not represented.

Objective. To determine whether adding questions increases the reliability and validity of the survey.

Data Sources and Study Setting. Surveys of patients at 181 hospitals participating in the California Hospitals Assessment and Reporting Taskforce (CHART), an initiative for voluntary public reporting of hospital performance in California.

Study Design. CHART added nine questions to the CAHPS Hospital Survey; two to improve reliability of the discharge information domain, five to create a coordination of care domain, and two relating to interpreter services.

Data Collection. Surveys were sent to randomly selected patients from each CHART hospital.

Principal Findings. A total of 40,172 surveys were included. Adding the new discharge information questions improved the internal consistency reliability from 0.45 to 0.72 and the hospital-level reliability from 0.75 to 0.81. New coordination of care composites had good internal consistency reliabilities ranging from 0.58 to 0.70 and hospital-level reliabilities ranging from 0.84 to 0.87. The new coordination of care composites were more closely correlated with overall hospital ratings and willingness to recommend than six of the seven original domains.

Conclusions. The additional discharge information questions and the new coordination of care questions significantly improved the psychometric properties of the CAHPS Hospital Survey.

Get access to the full text of this article

Ancillary