A goodness-of-fit approach to inference procedures for the kappa statistic: Confidence interval construction, significance-testing and sample size estimation

Authors

  • Allan Donner,

    1. Department of Epidemiology and Biostatistics, The University of Western Ontario, London, Ontario, Canada N6A 5C1
    Search for more papers by this author
  • Michael Eliasziw

    1. Clinical Trials Resources Group, The John P. Robarts Research Institute, and Department of Epidemiology and Biostatistics, The University of Western Ontario, P.O. Box 5015, 100 Perth Drive, London, Ontario, Canada N6A 5K8
    Search for more papers by this author

Abstract

We propose a new procedure for constructing a confidence interval about the kappa statistic in the case of two raters and a dichotomous outcome. The procedure is based on a chi-square goodness-of-fit test as applied to a model frequently used for clustered binary data. The procedure provides coverage levels that are accurate in samples of smaller size than those required for other procedures. The procedure also has use for significance-testing and the planning of corresponding sample size requirements.

Ancillary