The writing of this paper was partially supported by a faculty mini-grant from the Race and Ethnic Studies Institute of Texas A&M University, awarded to Winfred Arthur Jr.
MULTIPLE-CHOICE AND CONSTRUCTED RESPONSE TESTS OF ABILITY: RACE-BASED SUBGROUP PERFORMANCE DIFFERENCES ON ALTERNATIVE PAPER-AND-PENCIL TEST FORMATS
Article first published online: 7 DEC 2006
Volume 55, Issue 4, pages 985–1008, December 2002
How to Cite
ARTHUR, W., EDWARDS, B. D. and BARRETT, G. V. (2002), MULTIPLE-CHOICE AND CONSTRUCTED RESPONSE TESTS OF ABILITY: RACE-BASED SUBGROUP PERFORMANCE DIFFERENCES ON ALTERNATIVE PAPER-AND-PENCIL TEST FORMATS. Personnel Psychology, 55: 985–1008. doi: 10.1111/j.1744-6570.2002.tb00138.x
- Issue published online: 7 DEC 2006
- Article first published online: 7 DEC 2006
We present an example of an innovative constructed response test format–a write-in/mark-in paper-and-pencil test–as an alternative to the traditional multiple-choice paper-and-pencil test, with the potential for reducing subgroup differences. We present subgroup differences data on these 2 paper-and-pencil test formats on an operational promotional exam in a sample of African American and White firefighters. The tests were designed to measure the same content domain. Using within-subjects data that compared the performance of 13 African American and 14 White fire captains, and between-subjects data that compared the performance of 21 African American and 49 White fire captains, several results were in the predicted direction such that subgroup differences were reduced on the constructed response test. However, these results did not reach statistical significance. Therefore, the study points to the need for additional research to further evaluate the promise of the constructed response test format.