11 Research Designs for Program Evaluation
Research Methods in Psychology
II. RESEARCH METHODS IN SPECIFIC CONTENT AREAS
Published Online: 26 SEP 2012
Copyright © 2013 John Wiley & Sons, Inc. All rights reserved.
Handbook of Psychology, Second Edition
How to Cite
Wong, V. C., Wing, C., Steiner, P. M., Wong, M. and Cook, T. D. 2012. Research Designs for Program Evaluation. Handbook of Psychology, Second Edition. 2:II:11.
- Published Online: 26 SEP 2012
Over the past two decades, the program evaluation literature has made great advances on improving methodological approaches for establishing causal inference. The two most significant developments include establishing the primacy of design over statistical adjustment procedures for making causal inferences, and using potential outcomes to specify the exact causal estimands produced by the research designs. This chapter presents four research designs for assessing program effects-the randomized experiment, the regression-discontinuity, the interrupted time series, and the nonequivalent comparison group designs. For each design, we examine basic features of the approach, use potential outcomes to define causal estimands produced by the design, and highlight common issues to consider when using the design in the field. Whenever possible, we use examples to illustrate how these designs have been used to assess program effects. We conclude by suggesting broader issues in program evaluation that the next generation of evaluators should consider.
- program evaluation;
- interrupted time series;
- propensity score matching