Disclosures: JLC is an advisor to the GMC and has recieved only direct costs associated with presentation of this work. The other authors have no conflicts of interest.
Self-Other Agreement in Multisource Feedback: The Influence of Doctor and Rater Group Characteristics†
Article first published online: 19 MAR 2013
Copyright © 2013 The Alliance for Continuing Education in the Health Professions, the Society for Academic Continuing Medical Education, and the Council on CME, Association for Hospital Medical Education
Journal of Continuing Education in the Health Professions
Volume 33, Issue 1, pages 14–23, Winter 2013
How to Cite
Roberts, M. J., Campbell, J. L., Richards, S. H. and Wright, C. (2013), Self-Other Agreement in Multisource Feedback: The Influence of Doctor and Rater Group Characteristics. J. Contin. Educ. Health Prof., 33: 14–23. doi: 10.1002/chp.21162
- Issue published online: 19 MAR 2013
- Article first published online: 19 MAR 2013
- multisource feedback;
- patient surveys;
- peer assessment;
- self-other agreement;
- continuous professional development
Multisource feedback (MSF) ratings provided by patients and colleagues are often poorly correlated with doctors' self-assessments. Doctors' reactions to feedback depend on its agreement with their own perceptions, but factors influencing self-other agreement in doctors' MSF ratings have received little attention. We aimed to identify the characteristics of doctors and their rater groups that affect self-other agreement in MSF ratings.
We invited 2454 doctors to obtain patient and colleague feedback using the UK General Medical Council's MSF questionnaires and to self-assess on core items from both patient (PQ) and colleague (CQ) questionnaires. Correlations and differences between doctor, patient and colleague mean feedback scores were examined. Regression analyses identified the characteristics of doctors and their rater groups that influenced self-other score agreement.
1065 (43%) doctors returned at least one questionnaire, of whom 773 (73%) provided self and patient PQ scores and 1026 (96%) provided self and colleague CQ scores. Most doctors rated themselves less favourably than they were rated by either their patients or their colleagues. This tendency to underrate performance in comparison to external feedback was influenced by the doctor's place of training, clinical specialty, ethnicity and the profile of his/her patient and colleague rater samples but, in contrast to studies undertaken in nonmedical settings, was unaffected by age or gender.
Self-other agreement in MSF ratings is influenced by characteristics of both raters and ratees. Managers, appraisers, and others responsible for interpreting and reviewing feedback results with the doctor need to be aware of these influences.