Rater Cognition: Implications for Validity

Authors


Isaac I. Bejar, Educational Testing Service, Rosedale Road, Princeton, NJ 08541; ibejar@ets.org

Abstract

The scoring process is critical in the validation of tests that rely on constructed responses. Documenting that readers carry out the scoring in ways consistent with the construct and measurement goals is an important aspect of score validity. In this article, rater cognition is approached as a source of support for a validity argument for scores based on constructed responses, whether such scores are to be used on their own or as the basis for other scoring processes, for example, automated scoring.

Ancillary