You have free access to this content

# Experimental designs for identifying causal mechanisms

Version of Record online: 1 NOV 2012

DOI: 10.1111/j.1467-985X.2012.01032.x

© 2012 Royal Statistical Society

Issue

## Journal of the Royal Statistical Society: Series A (Statistics in Society)

Volume 176, Issue 1, pages 5–51, January 2013

Additional Information

#### How to Cite

Imai, K., Tingley, D. and Yamamoto, T. (2013), Experimental designs for identifying causal mechanisms. Journal of the Royal Statistical Society: Series A (Statistics in Society), 176: 5–51. doi: 10.1111/j.1467-985X.2012.01032.x

#### Publication History

- Issue online: 20 DEC 2012
- Version of Record online: 1 NOV 2012
- [
*Read before*The Royal Statistical Society*on Wednesday, March 14th, 2012, the President*, Professor V. S. Isham,*in the Chair*]

### References

- 1996) Identification of causal effects using instrumental variables (with discussion). J. Am. Statist. Ass., 91, 444–455. , and (
- 1997) Bounds on treatment effects from studies with imperfect compliance. J. Am. Statist. Ass., 92, 1171–1176. and (
- 1986) The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J. Personlty Socl Psychol., 51, 1173–1182. and (
- 2004) Are Emily and Greg more employable than Lakisha and Jamal?: a field experiment on labor market discrimination. Am. Econ. Rev., 94, 991–1013. and (
- 2008) What triggers public opposition to immigration? anxiety, group cues, and immigration threat. Am. J. Polit. Sci., 52, 959–978. , and (
- 2010) Yes, but what's the mechanism? (don't expect an easy answer). J. Personlty Socl Psychol., 98, 550–558. , and (
- 2005) Neuroeconomics: how neuroscience can inform economics. J. Econ. Lit., 43, 9–64. , and (
- 2002) Randomized experiments in educational policy research: a critical examination of the reasons the educational evaluation community has offered for not doing them. Educ. Evaln Poly Anal., 24, 175–199. (
- 1958) Planning of Experiments. New York: Wiley. (
- 2000) Causal inference without counterfactuals. J. Am. Statist. Ass., 95, 407–448. (
- 2009) Instruments of development: randomization in the tropics, and the search for the elusive keys to economic development. Proc. Br. Acad., 162, 123–160. (
- 2007) Identifying direct and indirect effects in a non-counterfactual framework. J. R. Statist. Soc. B, 69, 199–215. (
- 2010) Attitudes toward highly skilled and low-skilled immigration: evidence from a survey experiment. Am. Polit. Sci. Rev., 104, 61–84. and (
- 1995) Assessing the case for social experiments. J. Econ. Perspect., 9, 85–110. and (
- 2010) Causal mechanisms in the social sciences. A. Rev. Sociol., 36, 49–67. and (
- 1986) Statistics and causal inference (with discussion). J. Am. Statist. Ass., 81, 945–960. (
- 1988) Causal inference, path analysis, and recursive structural equations models. Sociol. Methodol., 18, 449–484. (
- 2010) A general approach to causal mediation analysis. Psychol. Meth., 15, 309–334. , and (
- 2011) Unpacking the black box of causality: learning about causal mechanisms from experimental and observational studies. Am. Polit. Sci. Rev., 105, to be published. , , and (
- 2010) Identification, inference, and sensitivity analysis for causal mediation effects. Statist. Sci., 25, 51–71. , and (
- 2011) Replication data for: Experimental designs for identifying causal mechanisms.
*hdl:1902.1/16416.*Dataverse Network. , and ( - 2012) Identification and sensitivity analysis for multiple causal mechanisms: revisiting evidence from framing experiments. Submitted to Polit. Anal. (Available from http://imai.princeton.edu/research/medsens.html.) and (
- 2008) Causal inference in randomized experiments with mediational processes. Psychol. Meth., 13, 314–336. (
- 2003) Design and Analysis of Cross-over Trials, 2nd edn. London: Chapman and Hall. and (
- 2009) Analytic bounds on causal risk differences in directed acyclic graphs involving three observed binary variables. J. Statist. Planng Inf., 139, 3473–3487. , and (
- 2006) Diminishing reciprocal fairness by disrupting the right prefrontal cortex. Science, 314, 829–832. , , , and (
- 2001) Fear, anger, and risk. J. Personlty Socl Psychol., 81, 146–159. and (
- 1990) Varieties of Social Explanation: an Introduction to the Philosophy of Social Science. Boulder: Westview. (
- 2011) Mechanism experiments and policy evaluations. J. Econ. Perspect., to be published. , and (
- 1965) Causes and conditions. Am. Philos. Q., 2, 245–264. (
- 1995) Identification Problems in the Social Sciences. Cambridge: Harvard University Press. (
- 2005) Making the causal link: frontal cortex activity and repetition priming. Nat. Neursci., 8, 1134–1135. and (
- 2011) Augmented designs to assess principal strata direct effects. J. R. Statist. Soc. B, 73, 729–752. and (
- 1990) On the application of probability theory to agricultural experiments: essay on principles, Section 9. Statist. Sci., 5, 465–480 (Engl. transl.). (
- 2005) Inferring causality in brain images: a perturbation approach. Philos. Trans. B, 360, 1109–1114. (
- 2001) Direct and indirect effects. In Proc. 17th Conf. Uncertainty in Artificial Intelligence, pp. 411–420. San Francisco: Morgan Kaufmann. (
- 2006) Estimation of direct causal effects. Epidemiology, 17, 276–284. , and (
- 2003) Studies in cognition: the problems solved and created by transcranial magnetic stimulation. J. Cogn. Neursci., 15, 948–960. , and (
- 2003) Semantics of causal DAG models and the identification of direct and indirect effects. In Highly Structured Stochastic Systems (eds P. J. Green, N. L. Hjort and S. Richardson), pp. 70–81. Oxford: Oxford University Press. (
- 1992) Identifiability and exchangeability for direct and indirect effects. Epidemiology, 3, 143–155. and (
- 1976) Causes. Am. J. Epidem., 104, 587–592. (
- 2005) Causation and causal inference in epidemiology. Am. J. Publ. Hlth, 95, S1, S144. and (
- 1974) Estimating causal effects of treatments in randomized and non-randomized studies. J. Educ. Psychol., 66, 688–701. (
- 2004) Direct and indirect causal effects via potential outcomes (with discussions). Scand. J. Statist., 31, 161–170. (
- 1984) Scientific Explanation and the Causal Structure of the World. Princeton: Princeton University Press. (
- 2003) The neural basis of economic decision-making in the ultimatum game. Science, 300, 1755–1758. , , , and (
- 2011) A complete graphical criterion for the adjustment formula in mediation analysis. Int. J. Biostatist., 7, article 16. and (
- 2009) Bounds on natural direct effects in the presence of confounded intermediate variables. Statist. Med., 28, 558–571. (
- 2008) Identification of causal parameters in randomized studies with mediating variables. J. Educ. Behav. Statist., 33, 230–251. (
- 2005) Establishing a causal chain: why experiments are often more effective than mediational analyses in examining psychological processes. J. Personlty Socl Psychol., 89, 845–851. , and (
- 2008) Simple relations between principal stratification and direct and indirect effects. Statist. Probab. Lett., 78, 2957–2962. (
- 2009) Mediation and mechanism. Eur. J. Epidem., 24, 217–224. (
- 2007) The identification of synergism in the sufficient-component-cause framework. Epidemiology, 18, 329–339. and (
- 2008) Empirical and counterfactual conditions for sufficient cause interactions. Biometrika, 91, 49–61. and (
- 2009) Minimal sufficient causation and directed acyclic graphs. Ann. Statist., 37, 1437–1465. and (

### References in the discussion

- 2008) Mediation analysis via potential outcomes models. Statist. Med., 27, 1282–1304. (
- 2011) Generalized causal mediation analysis. Biometrics, 67, 1028–1038. and (
- 1986) The moderator-mediator variable distinction in social psychological research: conceptual, strategic and statistical considerations. J. Personlty Socl Psychol., 51, 1173–1182. and (
- 1999) Combining different phases in the development of medical treatments within a single trial. Statist. Med., 18, 1833–1848. and (
- 2008) Bounds on direct effects in the presence of confounded intermed iate variables. Biometrics, 64, 695–701. , , and (
- 2007) Criteria for surrogate end points. J. R. Statist. Soc. B, 69, 919–932. , and (
- 1992) Statistical methods for analyzing collapsibility in regression models. J. Educ. Statist., 17, 51–74. , and (
- 2009) The consistency statement in causal inference: a definition or an assumption?Epidemiology, 20, 3–5. and (
- 1979) Quasi-experimentation. Chicago: Rand-McNally. and (
- 2002) Influence diagrams for causal modelling and inference. Int. Statist. Rev., 70, 161–189. (
- 2003) Causal inference using influence diagrams: the problem of partial compliance. In Highly Structured Stochastic Systems(eds P. J. Green, N. L. Hjort and S. Richardson). New York: Oxford University Press. (
- 2006) Direct and indirect effects of sequential decisions. In Proc. 22nd Conf. Association for Uncertainty in Artificial Intelligence (eds R. Dechter and T. Richardson), pp. 138–146. Corvallis: Association for Uncertainty in Artificial Intelligence Press. , and (
- 2012) Mediation and sensitivity analysis using two or more trials.
*Technical Report*. . and ( - 2003) Ethnicity insurgency, and civil war. Am. Polit. Sci. Rev., 97, 75–90. and (
- 1999) Addressing complications of intention-to-treat analysis in the combined presence of all-or-none treatment-noncompliance and subsequent missing outcomes. Biometrika, 86, 365– 379. and (
- 2002) Principal stratification in causal inference. Biometrics, 58, 21–29. and (
- 2012) Evaluating the effect of training on wages in the presence of noncompliance, nonemployment, and missing outcome data. J. Am. Statist. Ass., 107, 450–466. , , and (
- 2007) Identifying direct and indirect effects in a non-counterfactual framework. J. R. Statist. Soc. B, 69, 199–215. (
- 2011) Causal effects of perceived immutable characteristics. Rev. Econ. Statist., 93, 775–785. and (
- Statistics and causal inference (with discussion). J. Am. Statist. Ass., 81, 945–960. (1986)
- 2010) Ratio of mediator probability weighting for estimating natural direct and indirect effects. Proc. Biometr. Sect. Am. Statist. Ass., 2401–2415. (
- 2011) Parametric and non-parametric weighting methods for estimating mediation effects: an application to the National Evaluation of Welfare-to-Work Strategies. Proc. Socl Statist. Sect. Am. Statist. Ass., 3215–3229. , and (
- 1999) Sample size, reliability, and tests of statistical mediation. In Statistical Strategies for Small Sample Research (ed. R. H. Hoyle), pp. 195–222. Thousand Oaks: Sage. and (
- 2005) Natural resources, conflict, and conflict resolution: uncovering the mechanisms. J. Conflct Resoln, 49, 508–537. (
- A general approach to causal mediation analysis. Psychol. Meth., 15, 309–334. , and (2010)
- 2011) Unpacking the black box of causality: learning about causal mechanisms from experimental and observational studies. Am. Polit. Sci. Rev., 105, 765–789. , , and (
- Identification, inference, and sensitivity analysis for causal mediation effects. Statist. Sci., 25, 51–71. , and (2010)
- Identification and sensitivity analysis for multiple causal mechanisms: revisiting evidence from framing experiments. Submitted to
*Polit. Anal.*(Available from http://imai.princeton.edu/research/medsens.html.) and (2012) - 2008) Principal stratification for causal inference with extended partial compliance. J. Am. Statist. Ass., 103, 101–111. and (
- Analytic bounds on causal risk differences in directed acyclic graphs involving three observed binary variables. J. Statist. Planng Inf., 139, 3473–3487. , and (2009)
- 2007) Influence diagnostics in log-Birnbaum-Saunders regression models with censored data. Comput. Statist. Data Anal., 51, 5694–5707. , , and (
- 2002) A unified theory of two-stage adaptive designs. J. Am. Statist. Ass., 97, 1034–1041. , and (
- 2008) Introduction to Statistical Mediation Analysis. New York: Erlbaum. (
- 2010) The unbearable lightness of
*b*: approaches to improve causal interpretation of the*M*to*Y*relation.*Society for Personality and Social Psychology Conf.,*Las Vegas . and ( - 2007) Identification for Prediction and Decision. Cambridge: Harvard University Press. (
- 1986) Validity typologies and the logic and practice of quasi-experimentation. In Advances in Quasi-experimental Design and Analysis (ed. A. W. M. K. Trochim), pp. 47–66. San Francisco: Jossey-Bass. (
- Augmented designs to assess principal strata direct effects. J. R. Statist. Soc. B, 73, 729–752. and (2011)
- 2003) Assumptions allowing the estimation of direct causal effects. J. Econmetr., 112, 79–87. and (
- 2007) Diagnostics for confounding in PK/DD models for oxcarbazepine. Statist. Med., 26, 290–308. , and (
- 1990) Sur les applications de la théorie des probabilités aux experiences agricoles: essay des principes.. Statist. Sci., 5, 465–472 (Engl. tránsl.). (
- 2001) Direct and indirect effects. In Proc. 17th Conf. Uncertainty in Artificial Intelligence (eds J. S. Breese and D. Koller), pp. 411–420. San Francisco: Morgan Kaufmann. (
- 2007) Causal bounds and instruments. In Proc. 23rd A. Conf. Uncertainty in Artifical Intelligence, pp. 310–317. Corvallis: Association for Uncertainty in Artificial Intelligence Press. (
- 2012) Causal bounds and observable constraints for non-deterministic models. J. Mach. Learn. Res., 13, 829–848. (
- 1986) A new approach to causal inference in mortality studies with sustained exposure periods—applications to control of the healthy worker survivor effect. Math. Modlng, 7, l393–1512. (
- Semantics of causal DAG models and the identification of direct and indirect effects. In Highly Structured Stochastic Systems (eds P. J. Green, N. L. Hjort and S. Richardson), pp. 70–81. Oxford: Oxford University Press. (2003)
- 2010) Alternative graphical causal models and the identification of direct effects. In Causality and Psychopathology: Finding and Determinants of Disorders and Their Cures (eds P. Shrout, K. M. Keyes and K. Ornstein), pp. 103–158. New York: Oxford University Press. and (
- 1997) Estimation of effects of sequential treatments by reparameterizing directed acyclic graphs. In Proc. 13th Conf. Uncertainty in Artificial Intelligence (eds D. Geiger and P. Shenoy), pp. 409–420. San Francisco: Morgan Kaufmann. and (
- 1974) Estimating causal effects of treatments in randomized and nonrandomized studies. J. Educ. Psychol., 66, 688–701. (
- 1975) Bayesian inference for causality: the importance of randomization. Proc. Socl Statist. Sect. Am. Statist. Ass., 233–239. (
- 1977) Assignment to treatment group on the basis of a covariate. J. Educ. Statist., 2, 1–26; correction, 384. (
- 1978) Bayesian inference for causal effects: the role of randomization. Ann. Statist., 6, 34–58. (
- 1980) Discussion of ‘‘Randomization analysis of experimental data in the Fisher randomization test’’ by Basu. J. Am. Statist. Ass., 75, 591–593. (
- 1986) Which ifs have causal answers?J. Am. Statist. Ass., 82, 961–962. (
- 2005) Causal inference using potential outcomes: design, modeling, decisions. J. Am. Statist. Ass., 100, 322–331. (
- 2010) Reflections stimulated by the comments of Shadish (2009) and West & Thoemmes (2009). Psychol. Meth., 15, 38–46. (
- 2008) Use of non-normality in structural equation modeling: application to direction of causation. J. Statist. Planng Inf., 138, 3483–3491. and (
- Bounds on natural direct effects in the presence of confounded intermediate variables. Statist. Med., 28, 558–571. (2009)
- 1982) Beliefs, attributions, and evaluations: nonhierarchical models of mediation in social cognition. J. Personlty Socl Psychol., 43, 248–259. (
- 1987) System of Experimental Design
*:**Engineering Methods to Optimize Quality and Minimize Costs*(Engl. Transl.). New York: Quality Resources. ( - 2011) Semiparametric theory for causal mediation analysis: efficiency bounds, multiple robustness, and sensitivity analysis. Working Paper 130. Harvard University School of Public Health, Cambridge. (Available from http://biostats.bepress.com/harvardbiostat/paper130.) and (
- Simple relations between principal stratification and direct and indirect effects. Statist. Probab. Lett., 78, 2957–2962. (2008)
- 2010) Bias formulas for sensitivity analysis for direct and indirect effects. Epidemiology, 21, 540–551. (
- 2012) Mediation analysis with multiple versions of the mediator. Epidemiology, 23, 454–463. (
- 2009) Conceptual issues concerning mediation, interventions and composition. Statist. Interface—Special Issue on Mental Health and Social Behavioral Science, 2, 457–468. and (
- 1921) Correlation and causation. J. Agric. Res., 20, 557–585. (