A new permutation-based method for assessing agreement between two observers making replicated quantitative readings
Article first published online: 13 MAR 2012
Copyright © 2012 John Wiley & Sons, Ltd.
Statistics in Medicine
Volume 31, Issue 20, pages 2249–2261, 10 September 2012
How to Cite
Pan, Y., Haber, M., Gao, J. and Barnhart, H. X. (2012), A new permutation-based method for assessing agreement between two observers making replicated quantitative readings. Statist. Med., 31: 2249–2261. doi: 10.1002/sim.5323
- Issue published online: 16 AUG 2012
- Article first published online: 13 MAR 2012
- Manuscript Accepted: 5 DEC 2011
- Manuscript Received: 8 MAR 2011
- coefficient of individual equivalence;
- quantitative measurements
The coefficient of individual equivalence is a permutation-based measure of agreement between two observers making replicated readings on each subject. It compares the observed disagreement between the observers to the expected disagreement under individual equivalence. Individual equivalence of observers requires that for every study subject, the conditional distributions of the readings of the observers given the subject's characteristics are identical. Therefore, under individual equivalence it does not matter which observer is making a particular reading on a given subject. We introduce both nonparametric and parametric methods to estimate the coefficient as well as its standard error. We compare the new coefficient with the coefficient of individual agreement and with the concordance correlation coefficient. We also evaluate the performance of the estimates of the new coefficient via simulations and illustrate this new approach using data from a study comparing two noninvasive techniques for measuring carotid stenosis to an invasive gold standard. Copyright © 2012 John Wiley & Sons, Ltd.