SELECTION BIAS: MULTIPLE MEANINGS
This paper is based on a presidential address to the Division of Evaluation and Measurement at the annual meeting of the American Psychological Association, August 1982.
Abstract
The common approach to studies of predictive bias is analyzed within the context of a conceptual model in which predictors and criterion measures are viewed as fallible indicators of idealized qualifications. Selection on the basis of idealized qualifications depends on acceptance of a meritocratic principle, a principle which is itself subject to debate. Even with acceptance of this principle, however, it is shown that there will generally be a wide range of uncertainty as the result of the fallible nature of the indicators. Only when boundary conditions defined by Birnbaum (1979) are exceeded will the results be unambiguous. An example of such a case is presented. It is argued, however, that such instances are probably somewhat rare.
Number of times cited according to CrossRef: 18
- Michael Kane and Brent Bridgeman, Research on Validity Theory and Practice at ETS, Advancing Human Assessment, 10.1007/978-3-319-58689-2_16, (489-552), (2017).
- Steven Andrew Culpepper, An Improved Correction for Range Restricted Correlations Under Extreme, Monotonic Quadratic Nonlinearity and Heteroscedasticity, Psychometrika, 81, 2, (550), (2016).
- Molly Faulkner-Bond and Stephen G. Sireci, Validity Issues in Assessing Linguistic Minorities, International Journal of Testing, 15, 2, (114), (2015).
- Margarita Olivera-Aguilar and Roger E. Millsap, Statistical Power for a Simultaneous Test of Factorial and Predictive Invariance, Multivariate Behavioral Research, 48, 1, (96), (2013).
- Steven Andrew Culpepper, Using the Criterion-Predictor Factor Model to Compute the Probability of Detecting Prediction Bias with Ordinary Least Squares Regression, Psychometrika, 77, 3, (561), (2012).
- Christopher D. Nye, Bradley J. Brummel and Fritz Drasgow, Too Good to Be True? Understanding Change in Organizational Outcomes, Journal of Management, 36, 6, (1555), (2010).
- Roger E. Millsap, Invariance in Measurement and Prediction Revisited, Psychometrika, 10.1007/s11336-007-9039-7, 72, 4, (461-473), (2007).
- Stephen G. Sireci and Eileen Talento-Miller, Evaluating the Predictive Validity of Graduate Management Admission Test Scores, Educational and Psychological Measurement, 66, 2, (305), (2006).
- Razia Azen, Shmuel Bronner and Naomi Gafni, Examination of Gender Bias in University Admissions, Applied Measurement in Education, 10.1207/S15324818AME1501_05, 15, 1, (75-94), (2002).
- Nancy S. Cole and Michael J. Zieky, The New Faces of Fairness, Journal of Educational Measurement, 38, 4, (369-382), (2006).
- Michal Beller, Admission to Higher Education in Israel and the Role of the Psychometric Entrance Test: Educational and political dilemmas, Assessment in Education: Principles, Policy & Practice, 8, 3, (315), (2001).
- Brent Bridgeman and Charles Lewis, Gender Differences in College Mathematics Grades and SAT‐M Scores: A Reanalysis of Wainer and Steinberg, Journal of Educational Measurement, 33, 3, (257-270), (2005).
- Brent Bridgeman and Frederick McHale, GENDER AND ETHNIC GROUP DIFFERENCES ON THE GMAT ANALYTICAL WRITING ASSESSMENT, ETS Research Report Series, 1996, 1, (i), (1996).
- Brent Bridgeman and Charles Lewis, GENDER DIFFERENCES IN COLLEGE MATHEMATICS GRADES AND SAT‐M SCORES: A REANALYSIS OF WAINER AND STEINBERG, ETS Research Report Series, 1995, 1, (i-29), (2014).
- Roger E. Millsap and William Meredith, Inferential Conditions in the Statistical Detection of Measurement Bias, Applied Psychological Measurement, 16, 4, (389), (1992).
- Lawrence J. Stricker, Donald A. Rock and Nancy W. Burton, SEX DIFFERENCES IN SAT® PREDICTIONS OF COLLEGE GRADES, ETS Research Report Series, 1991, 2, (i-45), (2014).
- Samuel Messick, VALIDITY, ETS Research Report Series, 1987, 2, (i-208), (2014).
- RICHARD SAWYER, USING DEMOGRAPHIC SUBGROUP AND DUMMY VARIABLE EQUATIONS TO PREDICT COLLEGE FRESHMAN GRADE AVERAGE, Journal of Educational Measurement, 23, 2, (131-145), (2005).
