Improvement in precision of counting actinic keratoses
Article first published online: 13 JAN 2014
Published 2013. This article is a U.S. Government work and is in the public domain in the USA.
British Journal of Dermatology
Volume 170, Issue 1, pages 188–191, January 2014
How to Cite
Lee, K.C., Lew, R., Weinstock, M.A. (2014), Improvement in precision of counting actinic keratoses. British Journal of Dermatology, 170: 188–191. doi: 10.1111/bjd.12629
Funding source: This study was supported by the VA Cooperative Studies Program (CSP #562), Office of Research and Development, Department of Veterans Affairs.
Role of the sponsor: A VA CSP trial, the VA necessarily played a role in the analysis and interpretation of data, in the preparation review, and approval of the manuscript, in the design and conduct of the study, the collection of data (which was obtained from VA patients at VA Medical Centers).
Conflicts of interest: None declared.
- Issue published online: 13 JAN 2014
- Article first published online: 13 JAN 2014
- Accepted manuscript online: 14 SEP 2013 08:07AM EST
- Manuscript Accepted: 6 SEP 2013
- VA Cooperative Studies Program. Grant Number: CSP #562
- Office of Research and Development
- Department of Veterans Affairs
Actinic keratoses (AKs) often serve as a primary endpoint for clinical studies. However, reliability of counting these lesions is poor, even among expert dermatologists.
To investigate the reliability of counting AKs before and after a yearly consensus meeting, held annually for 4 years.
As part of the Veterans Affairs (VA) Keratinocyte Carcinoma Chemoprevention Trial, board-certified dermatologists convened annually for 4 years to individually count the number of actinic keratoses on three to five test subjects. The dermatologists then met as a group for a consensus discussion on what constituted an AK lesion on each subject. Afterwards, each dermatologist repeated the independent counting exercise on three to five new subjects. The intraclass correlation coefficient (ICC) was used to analyze the reliability of counting AKs among the dermatologists.
Eight dermatologists participated in this exercise for 4 consecutive years. Pre-consensus discussion ICCs over 4 years were 0·18, 0·34, 0·38, 0·75, respectively, showing sustained improvement with each consensus discussion. The greatest improvement in reliability of AK counts was shown during the first year of consensus discussions, when the ICC improved from 0·18 to 0·67. There was no improvement by the fourth year of consensus discussion, with pre- and post-consensus ICCs of 0·75 and 0·75, respectively.
Annual consensus discussions can lead to improvement in reliability of AK counts. This improvement was sustained over 4 years. By the fourth year, the discussion meeting had no effect on improvement in reliability. A consensus meeting discussion may be helpful for improving reliability in other trials.