Development of a consumer constructed scale to evaluate mental health service provision
Article first published online: 25 JUN 2010
© 2010 Blackwell Publishing Ltd
Journal of Evaluation in Clinical Practice
Volume 17, Issue 6, pages 1102–1107, December 2011
How to Cite
Oades, L. G., Law, J. and Marshall, S. L. (2011), Development of a consumer constructed scale to evaluate mental health service provision. Journal of Evaluation in Clinical Practice, 17: 1102–1107. doi: 10.1111/j.1365-2753.2010.01474.x
- Issue published online: 3 NOV 2011
- Article first published online: 25 JUN 2010
- Accepted for publication: 24 February 2010
- consumer participation;
- mental health services;
- service evaluation
Objective Most mental health outcome and satisfaction measures have been developed by academic researchers or service providers. Consumers have been limited to the role of participant or advisor. The validity and reliability of these satisfaction measures have been challenged. This paper reports the development of a consumer satisfaction questionnaire in which consumers work as collaborative researchers to increase its face validity and relevance.
Method Eleven themes from a previous participatory study were used by consumer researchers and university-based researchers to generate questionnaire items, with four items reflecting each theme. The internal consistency and factor structure were examined in public and non-government mental health service centres based on data of 202 mental health consumers.
Results Principal Components Analysis with oblique rotation yielded a two-factor structure: Empowerment and Dehumanization. The two factors together explained 36.7% of the total variance. The scale demonstrated high internal consistency, with Cronbach's alpha for the total scale at 0.92, and for the two factors at 0.92 and 0.80.
Conclusions The questionnaire was developed in accordance with an evaluation framework of consumer directed evaluation of mental health services. The final questionnaire consists of 26 items. It has satisfactory internal consistency and appeared to be useful with inpatients and outpatients. Further research will be performed to establish its test–retest reliability and criterion validity.