Presented at the Combined Otolaryngology Spring Meeting (COSM), Phoenix, Arizona, U.S.A., May 28–31, 2009.
Pilot testing of an assessment tool for competency in mastoidectomy†
Article first published online: 2 NOV 2009
Copyright © 2009 The American Laryngological, Rhinological, and Otological Society, Inc.
Volume 119, Issue 12, pages 2402–2410, December 2009
How to Cite
Laeeq, K., Bhatti, N. I., Carey, J. P., Della Santina, C. C., Limb, C. J., Niparko, J. K., Minor, L. B. and Francis, H. W. (2009), Pilot testing of an assessment tool for competency in mastoidectomy. The Laryngoscope, 119: 2402–2410. doi: 10.1002/lary.20678
- Issue published online: 20 NOV 2009
- Article first published online: 2 NOV 2009
- Manuscript Accepted: 9 JUL 2009
- operative competency;
- surgical skills;
To determine the feasibility, validity, and reliability of an evaluation tool for the assessment of competency in mastoid surgery. This study tests the hypothesis that residents of dissimilar training levels differ in their technical performance as measured by this tool.
Cross-sectional validation study.
Two or more faculty otolaryngologists evaluated each resident performing a cortical mastoidectomy on a cadaveric temporal bone. Performance was rated using global and checklist components of a mastoidectomy assessment tool.
Fifteen internal and external faculty members evaluated 23 residents over 3 years resulting in 118 evaluations. Construct validity was observed as scores increased with clinical training year. These differences were greater for more complex tasks. There was a percentage agreement of 78.5% between evaluator pairs in the determination of pass (score 3–5) versus fail (score 1–2) for the checklist instrument, and an agreement of 74.4% for the global instrument. Although agreement was lower for the exact score on a scale of 1 to 5, differences of 1 or less occurred in over 80% of evaluator pairs. Regression analysis confirmed faculty perception that sharpening of the posterior external auditory canal cortex and opening of the antrum from posterior to anterior are strong predictors of overall surgical performance.
Our results indicate that the tool we have developed is a feasible, valid, and reliable instrument for the assessment of competency in mastoidectomy. The instrument can be used to provide formative feedback and to identify procedural tasks for which additional training may be necessary. Laryngoscope, 2009