Statistical Benchmarks for Health Care Provider Performance Assessment: A Comparison of Standard Approaches to a Hierarchical Bayesian Histogram-Based Method
Article first published online: 24 JAN 2014
© Published 2014. This article is a U.S. Government work and is in the public domain in the U.S.A.
Health Services Research
Volume 49, Issue 3, pages 1056–1073, June 2014
How to Cite
Paddock, S. M. (2014), Statistical Benchmarks for Health Care Provider Performance Assessment: A Comparison of Standard Approaches to a Hierarchical Bayesian Histogram-Based Method. Health Services Research, 49: 1056–1073. doi: 10.1111/1475-6773.12149
- Issue published online: 16 MAY 2014
- Article first published online: 24 JAN 2014
- Agency for Healthcare Research and Quality. Grant Number: R21HS021860
- Bayesian statistics;
- hierarchical model;
- provider profiling;
- public reporting;
- statistical benchmark
Examine how widely used statistical benchmarks of health care provider performance compare with histogram-based statistical benchmarks obtained via hierarchical Bayesian modeling.
Publicly available data from 3,240 hospitals during April 2009–March 2010 on two process-of-care measures reported on the Medicare Hospital Compare website.
Secondary data analyses of two process-of-care measures comparing statistical benchmark estimates and threshold exceedance determinations under various combinations of hospital performance measure estimates and benchmarking approaches.
Statistical benchmarking approaches for determining top 10 percent performance varied with respect to which hospitals exceeded the performance benchmark; such differences were not found at the 50 percent threshold. Benchmarks derived from the histogram of provider performance under hierarchical Bayesian modeling provide a compromise between benchmarks based on direct (raw) estimates, which are overdispersed relative to the true distribution of provider performance and prone to high variance for small providers, and posterior mean provider performance, for which over-shrinkage and under-dispersion relative to the true provider performance distribution is a concern.
Given the rewards and penalties associated with characterizing top performance, the ability of statistical benchmarks to summarize key features of the provider performance distribution should be examined.