Sandip Sinharay conducted this study and wrote this report while on staff at Educational Testing Service. He is currently at CTB/McGraw-Hill in Monterey, CA.
Does subgroup membership information lead to better estimation of true subscores?
Article first published online: 29 OCT 2012
© 2012 The British Psychological Society
British Journal of Mathematical and Statistical Psychology
Volume 66, Issue 3, pages 452–469, November 2013
How to Cite
Haberman, S. J. and Sinharay, S. (2013), Does subgroup membership information lead to better estimation of true subscores?. British Journal of Mathematical and Statistical Psychology, 66: 452–469. doi: 10.1111/j.2044-8317.2012.02061.x
- Issue published online: 8 OCT 2013
- Article first published online: 29 OCT 2012
- Manuscript Accepted: 11 JUL 2012
- Manuscript Received: 28 FEB 2012
Haberman (2008) suggested a method to determine if subtest scores have added value over the total score. The method is based on classical test theory and considers the estimation of the true subscores. Performance of subgroups, for example, those based on gender or ethnicity, on subtests is often of interest. Researchers such as Stricker (1993) and Livingston and Rupp (2004) found that the difference in performance between the subgroups often varies over the different subtests. We suggest a method to examine whether the knowledge of the subgroup membership of the examinees leads to a better estimation of the true subscores. We apply our suggested method to data from two operational testing programmes. The knowledge of the subgroup membership of the examinees does not lead to a better estimation of the true subscore for the data sets.