We thank the editor, two anonymous reviewers, Amy Hooper, and Barbara Bobko for helpful comments on earlier versions of this work.
Reviewing, Categorizing, and Analyzing the Literature on Black–White Mean Differences for Predictors of Job Performance: Verifying Some perceptions and Updating/Correcting Others
Article first published online: 25 OCT 2012
© 2012 Wiley Periodicals, Inc.
Volume 66, Issue 1, pages 91–126, Spring 2013
How to Cite
Bobko, P. and Roth, P. L. (2013), Reviewing, Categorizing, and Analyzing the Literature on Black–White Mean Differences for Predictors of Job Performance: Verifying Some perceptions and Updating/Correcting Others. Personnel Psychology, 66: 91–126. doi: 10.1111/peps.12007
- Issue published online: 13 FEB 2013
- Article first published online: 25 OCT 2012
- Accepted manuscript online: 23 AUG 2012 03:15AM EST
In both theoretical and applied literatures, there is confusion regarding accurate values for expected Black–White subgroup differences in personnel selection test scores. Much confusion arises because empirical estimates of standardized subgroup differences (d) are subject to many of the same biasing factors associated with validity coefficients (i.e., d is functionally related to a point-biserial r). To address such issues, we review/cumulate, categorize, and analyze a systematic set of many predictor-specific meta-analyses in the literature. We focus on confounds due to general use of concurrent, versus applicant, samples in the literature on Black–White d. We also focus on potential confusion due to different constructs being assessed within the same selection test method, as well as the influence of those constructs on d. It is shown that many types of predictors (such as biodata inventories or assessment centers) can have magnitudes of d that are much larger than previously thought. Indeed, some predictors (such as work samples) can have ds similar to that associated with paper-and-pencil tests of cognitive ability. We present more realistic values of d for both researcher and practitioner use. Implications for practice and future research are noted.