Get access

Validity of Survey Response Propensity Indicators: A Behavior Genetics Approach

Authors


Direct correspondence to Levente Littvay, Central European University Department of Political Science, Nádor u. 9, Budapest 1051, Hungary 〈littvayl@ceu-budapest.edu〉.

Abstract

Objectives

This study explains how behavior genetic analysis using a twin design can help us assess the validity of our measures.

Methods

We test multiple indicators of response propensity, a measure used by survey researchers to better understand the similarities and differences between survey respondents and nonrespondents. The response propensity indicators evaluated include response to follow-up surveys and subsequent waves of a panel and the completion of a sensitive recontact information sheet to aid subsequent recontact efforts.

Results

A classical and the newly proposed method of validation all point to insufficient validity of our response propensity measures. Construct validation using data from the National Survey of Midlife Development in the United States exhibited little correlation between indicators. Genetic analysis suggests that the success of subsequent data-collection efforts is predominantly driven by additive genetic effects, while nonresponse to inquiries for recontact information is influenced predominantly by familial environmental predictors.

Conclusion

Our results indicate that different underlying constructs drive the response propensity indicators, suggesting that nonresponse is, at minimum, multidimensional.

Get access to the full text of this article

Ancillary