An earlier version of this study was presented at the 2010 annual meeting of the Society for Industrial and Psychology.
Rater training revisited: An updated meta-analytic review of frame-of-reference training
Article first published online: 4 NOV 2011
©2011 The British Psychological Society
Journal of Occupational and Organizational Psychology
Volume 85, Issue 2, pages 370–395, June 2012
How to Cite
Roch, S. G., Woehr, D. J., Mishra, V. and Kieszczynska, U. (2012), Rater training revisited: An updated meta-analytic review of frame-of-reference training. Journal of Occupational and Organizational Psychology, 85: 370–395. doi: 10.1111/j.2044-8325.2011.02045.x
- Issue published online: 8 MAY 2012
- Article first published online: 4 NOV 2011
- Received 16 February 2011; revised version received 25 August 2011
The present study updates Woehr and Huffcutt's (1994) rater training meta-analysis and demonstrates that frame-of-reference (FOR) training is an effective method of improving rating accuracy. The current meta-analysis includes over four times as many studies as included in the Woehr and Huffcutt meta-analysis and also provides a snapshot of current rater training studies. The present meta-analysis also extends the previous meta-analysis by showing that not all operationalizations of accuracy are equally improved by FOR training; Borman's differential accuracy appears to be the most improved by FOR training, along with behavioural accuracy, which provides a snapshot into the cognitive processes of the raters. We also investigate the extent to which FOR training protocols differ, the implications of protocol differences, and if the criteria of interest to FOR researchers have changed over time.