Address correspondence to A. Lynn Snow, Ph.D., 2002 Holcombe Blvd., (152), Houston, TX 77030. A. Lynn Snow and Robert O. Morgan, Ph.D., are with the Houston Center for Quality of Care and Utilization Studies, Michael E. DeBakey Veterans Affairs Medical Center, Houston, TX. Dr. Snow is also with the Veterans Affairs South Central Mental Illness Research, Education, and Clinical Center (MIRECC), Houston, TX. Dr. Snow is also with the Medicine and Psychiatry and Behavioral Sciences Departments, Baylor College of Medicine, Houston, TX. Dr. Morgan is also with the Medicine Department, Baylor College of Medicine, Houston, TX. Karon F. Cook, Ph.D., is with the Department of Physical Medicine, University of Washington, Seattle, WA. Pay-shin Lin, Dr. PH., M.S., L.P.T., is with the Department of Physical Therapy, Graduate Institute of Rehabilitation Science, Chang Gung University, Taiwan. Jay Magaziner, Ph.D., is with the Department of Epidemiology, University of Maryland at Baltimore, Baltimore, MD.
Proxies and Other External Raters: Methodological Considerations
Article first published online: 11 AUG 2005
Health Services Research
Volume 40, Issue 5p2, pages 1676–1693, October 2005
How to Cite
Lynn Snow, A., Cook, K. F., Lin, P.-S., Morgan, R. O. and Magaziner, J. (2005), Proxies and Other External Raters: Methodological Considerations. Health Services Research, 40: 1676–1693. doi: 10.1111/j.1475-6773.2005.00447.x
- Issue published online: 11 AUG 2005
- Article first published online: 11 AUG 2005
Objective. The purpose of this paper is to introduce researchers to the measurement and subsequent analysis considerations involved when using externally rated data. We will define and describe two categories of externally rated data, recommend methodological approaches for analyzing and interpreting data in these two categories, and explore factors affecting agreement between self-rated and externally rated reports. We conclude with a discussion of needs for future research.
Data Sources/Study Setting. Data sources for this paper are previous published studies and reviews comparing self-rated with externally rated data.
Study Design/Data Collection/Extraction Methods. This is a psychometric conceptual paper.
Principal Findings. We define two types of externally rated data: proxy data and other-rated data. Proxy data refer to those collected from someone who speaks for a patient who cannot, will not, or is unavailable to speak for him or herself, whereas we use the term other-rater data to refer to situations in which the researcher collects ratings from a person other than the patient to gain multiple perspectives on the assessed construct. These two types of data differ in the way the measurement model is defined, the definition of the gold standard against which the measurements are validated, the analysis strategies appropriately used, and how the analyses are interpreted. There are many factors affecting the discrepancies between self- and external ratings, including characteristics of the patient, the proxy, and of the rated construct. Several psychological theories can be helpful in predicting such discrepancies.
Conclusions. Externally rated data have an important place in health services research, but use of such data requires careful consideration of the nature of the data and how it will be analyzed and interpreted.