International Statistical Reviewto Line Intersect Sampling
Published Online: 15 AUG 2006
Copyright © 2004 by John Wiley & Sons, Inc. All rights reserved.
Encyclopedia of Statistical Sciences
How to Cite
Banerjee, M. 2006. Interrater Agreement. Encyclopedia of Statistical Sciences.
- Published Online: 15 AUG 2006
Analysis of interrater or interobserver agreement data provides a useful means of assessing the reliability of a rating system. This article presents various interrater agreement measures as well as models for studying agreement, when the relevant data comprise either continuous or categorical ratings from multiple raters. Descriptions and characterizations of the underlying models are presented in detail, as well as methods for estimation and confidence interval construction. The scenarios and designs that underlie the development of the agreement measures are described, and the interrelationships between these measures discussed.
- Cohen's kappa;
- intraclass correlation coefficient;
- tetrachoric correlation coefficient;
- concordance correlation coefficient;
- log-linear models