An earlier version of this paper was presented at the 25th annual SIOP conference in May 2010, Atlanta. We are grateful to George Thornton and Nigel Povah for helpful comments on earlier version of this manuscript.
More than a mirage: A large-scale assessment centre with more dimension variance than exercise variance
Article first published online: 28 SEP 2012
© 2012 The British Psychological Society
Journal of Occupational and Organizational Psychology
Volume 86, Issue 1, pages 5–21, March 2013
How to Cite
Guenole, N., Chernyshenko, O. S., Stark, S., Cockerill, T. and Drasgow, F. (2013), More than a mirage: A large-scale assessment centre with more dimension variance than exercise variance. Journal of Occupational and Organizational Psychology, 86: 5–21. doi: 10.1111/j.2044-8325.2012.02063.x
- Issue published online: 4 FEB 2013
- Article first published online: 28 SEP 2012
- Manuscript Revised: 10 AUG 2012
- Manuscript Received: 16 JAN 2012
Assessment centres (ACs) are widely recognized to be among the best tools for assessing and developing management talent (Assessment Centres and Global Talent Management, 2011, Gower: London). Yet, the current consensus about the construct validity of ACs is that exercises rather than dimensions explain the majority of variance in ratings. Because much of the data on which these conclusions are based are now old, it is worthwhile to periodically re-examine this issue to see whether well-implemented designs produce better measurements of dimensions. We present results from 1,205 executive-level leaders from Fortune 500 firms across Europe and North America, who participated in developmental ACs that use modern design principles where assessors were formally examined to ensure they had a common frame or reference. Our results showed that while dimensions and exercises mutually determined ratings, more variation was owing to dimensions.
- Modern assessment centre designs can yield dimension scores that reflect dimensions more than exercises;
- The psychometric characteristics of operational ACs should be regularly monitored as the characteristics of any single AC may differ widely from meta-analytic averages.