Volume 71, Issue 4

Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score

Keisuke Hirano

1 University of Miami, USA khirano@miami.edu, 2University of California at Berkeley, and NBER imbens@econ.berkeley.edu, 3University of Southern California, Los Angeles, USA ridder@usc.edu

Search for more papers by this author
1
Guido W. Imbens

1 University of Miami, USA khirano@miami.edu, 2University of California at Berkeley, and NBER imbens@econ.berkeley.edu, 3University of Southern California, Los Angeles, USA ridder@usc.edu

Search for more papers by this author
2
Geert Ridder

1 University of Miami, USA khirano@miami.edu, 2University of California at Berkeley, and NBER imbens@econ.berkeley.edu, 3University of Southern California, Los Angeles, USA ridder@usc.edu

Search for more papers by this author
3
First published: 24 October 2003
Citations: 914

Abstract

We are interested in estimating the average effect of a binary treatment on a scalar outcome. If assignment to the treatment is exogenous or unconfounded, that is, independent of the potential outcomes given covariates, biases associated with simple treatment‐control average comparisons can be removed by adjusting for differences in the covariates. Rosenbaum and Rubin (1983) show that adjusting solely for differences between treated and control units in the propensity score removes all biases associated with differences in covariates. Although adjusting for differences in the propensity score removes all the bias, this can come at the expense of efficiency, as shown by Hahn (1998), Heckman, Ichimura, and Todd (1998), and Robins, Mark, and Newey (1992). We show that weighting by the inverse of a nonparametric estimate of the propensity score, rather than the true propensity score, leads to an efficient estimate of the average treatment effect. We provide intuition for this result by showing that this estimator can be interpreted as an empirical likelihood estimator that efficiently incorporates the information about the propensity score.

Number of times cited according to CrossRef: 914

  • Economic impact of corporate foundations: An event analysis approach, Journal of Business Research, 10.1016/j.jbusres.2020.08.046, 122, (159-170), (2021).
  • Company–Community Partnership and Climate Change Adaptation Practices: The Case of Smallholders Coffee Farmers in Lampung, Indonesia, Climate Change Research, Policy and Actions in Indonesia, 10.1007/978-3-030-55536-8_5, (79-98), (2021).
  • Does inflation targeting cause financial instability?: An empirical test of paradox of credibility hypothesis, The North American Journal of Economics and Finance, 10.1016/j.najef.2020.101164, 52, (101164), (2020).
  • Cash transfer program and child underweight—Empirical evidence from a causal mediation analysis, Agricultural Economics, 10.1111/agec.12555, 51, 2, (291-303), (2020).
  • Multiple-Group Propensity Score Inverse Weight Trimming and Its Impact on Covariate Balance and Bias in Treatment Effect Estimation, Quantitative Psychology, 10.1007/978-3-030-43469-4_12, (147-159), (2020).
  • Impact of individual and neighborhood social capital on the physical and mental health of pregnant women: the Japan Environment and Children’s Study (JECS), BMC Pregnancy and Childbirth, 10.1186/s12884-020-03131-3, 20, 1, (2020).
  • Bridging the gap – How effective are remedial math courses in Germany?, Studies in Educational Evaluation, 10.1016/j.stueduc.2019.100832, 64, (100832), (2020).
  • Consistency of the Horvitz–Thompson estimator under general sampling and experimental designs, Journal of Statistical Planning and Inference, 10.1016/j.jspi.2019.12.002, (2020).
  • Behavioral impact of disaster education: Evidence from a dance-based program in Indonesia, International Journal of Disaster Risk Reduction, 10.1016/j.ijdrr.2020.101489, (101489), (2020).
  • Bus rapid transit and property values in Buenos Aires: Combined spatial hedonic pricing and propensity score techniques, Research in Transportation Economics, 10.1016/j.retrec.2020.100814, (100814), (2020).
  • Blinatumomab vs historic standard‐of‐care treatment for minimal residual disease in adults with B‐cell precursor acute lymphoblastic leukaemia, European Journal of Haematology, 10.1111/ejh.13375, 104, 4, (299-309), (2020).
  • Efectos de la asistencia temprana a centros de cuidado y educativos en el desarrollo infantil: evidencia para Uruguay, Revista Desarrollo y Sociedad, 10.13043/DYS.84.5, 84, (181-219), (2020).
  • Does self-disclosure matter? A dynamic two-stage perspective for the personalization-privacy paradox, Journal of Business Research, 10.1016/j.jbusres.2020.02.006, (2020).
  • Novel (p)ppGpp0 suppressor mutations reveal an unexpected link between methionine catabolism and GTP synthesis in Bacillus subtilis, Molecular Microbiology, 10.1111/mmi.14484, 113, 6, (1155-1169), (2020).
  • Multifunctional Polymer Memory via Bi‐Interfacial Topography for Pressure Perception Recognition, Advanced Science, 10.1002/advs.201902864, 7, 8, (2020).
  • Solid‐State Lithium–Sulfur Battery Enabled by Thio‐LiSICON/Polymer Composite Electrolyte and Sulfurized Polyacrylonitrile Cathode, Advanced Functional Materials, 10.1002/adfm.201910123, 30, 14, (2020).
  • Evidence of climate change impacts on crop comparative advantage and land use, Agricultural Economics, 10.1111/agec.12551, 51, 2, (221-236), (2020).
  • A Mann–Whitney test of distributional effects in a multivalued treatment, Journal of Statistical Planning and Inference, 10.1016/j.jspi.2020.03.002, (2020).
  • Statistical Analysis and Evaluation of Macroeconomic Policies: A Selective Review, Applied Mathematics-A Journal of Chinese Universities, 10.1007/s11766-020-3775-1, 35, 1, (57-83), (2020).
  • Optimal branching strategy, local financial development, and SMEs’ performance, Economic Modelling, 10.1016/j.econmod.2020.03.027, (2020).
  • Effects of welfare entry and exit on adolescent mental health: Evidence from panel data in China, Social Science & Medicine, 10.1016/j.socscimed.2020.112969, (112969), (2020).
  • Should we trust math preparatory courses? An empirical analysis on the impact of students’ participation and attendance on short- and medium-term effects, Economic Analysis and Policy, 10.1016/j.eap.2020.04.002, (2020).
  • Increasing success in college: Examining the impact of a project‐based introductory engineering course, Journal of Engineering Education, 10.1002/jee.20319, 109, 3, (384-401), (2020).
  • Does the old-age pension scheme improve household welfare? Evidence from India, World Development, 10.1016/j.worlddev.2020.105017, 134, (105017), (2020).
  • Endogeneity and non‐response bias in treatment evaluation – nonparametric identification of causal effects by instruments, Journal of Applied Econometrics, 10.1002/jae.2764, 35, 5, (481-504), (2020).
  • Improving Birth Outcomes And Lowering Costs For Women On Medicaid: Impacts Of ‘Strong Start For Mothers And Newborns’, Health Affairs, 10.1377/hlthaff.2019.01042, 39, 6, (1042-1050), (2020).
  • Does mobile money promote financial inclusion in Eswatini?, International Journal of Social Economics, 10.1108/IJSE-05-2019-0310, ahead-of-print, ahead-of-print, (2020).
  • Some recent developments in modeling quantile treatment effects, Applied Mathematics-A Journal of Chinese Universities, 10.1007/s11766-020-3980-y, 35, 2, (220-243), (2020).
  • A practical generalized propensity-score estimator for quantile continuous treatment effects, The Stata Journal: Promoting communications on statistics and Stata, 10.1177/1536867X20930997, 20, 2, (276-296), (2020).
  • Parental proximity and earnings after job displacements, Labour Economics, 10.1016/j.labeco.2020.101877, 65, (101877), (2020).
  • Did the ACA Medicaid expansion save lives?, Journal of Health Economics, 10.1016/j.jhealeco.2020.102333, 72, (102333), (2020).
  • Efficient GMM Estimation with Incomplete Data, The Review of Economics and Statistics, 10.1162/rest_a_00836, 102, 3, (518-530), (2020).
  • Two Simple Models for Observational Studies, Design of Observational Studies, 10.1007/978-3-030-46405-9_3, (73-109), (2020).
  • Criminal Deterrence when There Are Offsetting Risks: Traffic Cameras, Vehicular Accidents, and Public Safety, American Economic Journal: Economic Policy, 10.1257/pol.20170674, 12, 3, (202-237), (2020).
  • Adjusting for Peer-Influence in Propensity Scoring When Estimating Treatment Effects, SSRN Electronic Journal, 10.2139/ssrn.3522256, (2020).
  • Overlap in observational studies with high-dimensional covariates, Journal of Econometrics, 10.1016/j.jeconom.2019.10.014, (2020).
  • Multiple Sclerosis Adult Day Programs and Health-Related Quality of Life of Persons with Multiple Sclerosis and Informal Caregivers, International Journal of MS Care, 10.7224/1537-2073.2019-020, 22, 4, (187-192), (2020).
  • Learning Causal Effect Using Machine Learning with Application to China’s Typhoon, Acta Mathematicae Applicatae Sinica, English Series, 10.1007/s10255-020-0960-1, 36, 3, (702), (2020).
  • Move to success? Headquarters relocation, political favoritism, and corporate performance, Journal of Corporate Finance, 10.1016/j.jcorpfin.2020.101698, (101698), (2020).
  • Counterfactual Treatment Effects: Estimation and Inference, Journal of Business & Economic Statistics, 10.1080/07350015.2020.1800479, (1), (2020).
  • Distributional Effects of a Continuous Treatment with an Application on Intergenerational Mobility, Oxford Bulletin of Economics and Statistics, 10.1111/obes.12355, 82, 4, (808-842), (2020).
  • Asymptotic analysis of statistical decision rules in econometrics, , 10.1016/bs.hoe.2020.09.001, (2020).
  • Brief discussion on sampling variability in 1:1 propensity score matching without replacement, Pharmacoepidemiology and Drug Safety, 10.1002/pds.5094, 29, 9, (1194-1197), (2020).
  • Mediation Analysis, Handbook of Labor, Human Resources and Population Economics, 10.1007/978-3-319-57365-6, (1-38), (2020).
  • Copula-based regression models with data missing at random, Journal of Multivariate Analysis, 10.1016/j.jmva.2020.104654, (104654), (2020).
  • A Survey of Learning Causality with Data, ACM Computing Surveys, 10.1145/3397269, 53, 4, (1-37), (2020).
  • Identity-based Earning Discrimination among Chinese People, IZA Journal of Development and Migration, 10.2478/izajodm-2020-0005, 11, 1, (2020).
  • Balancing vs modeling approaches to weighting in practice, Statistics in Medicine, 10.1002/sim.8659, 39, 24, (3227-3254), (2020).
  • Instrumental variable methods using dynamic interventions, Journal of the Royal Statistical Society: Series A (Statistics in Society), 10.1111/rssa.12563, 183, 4, (1523-1551), (2020).
  • Poverty alleviation and local environmental degradation: An empirical analysis in Colombia, World Development, 10.1016/j.worlddev.2019.104776, 127, (104776), (2020).
  • Valid inference for treatment effect parameters under irregular identification and many extreme propensity scores, Journal of Econometrics, 10.1016/j.jeconom.2020.03.025, (2020).
  • Business innovation modes and their impact on innovation outputs: Regional variations and the nature of innovation across EU regions, Research Policy, 10.1016/j.respol.2020.104047, 49, 8, (104047), (2020).
  • A beyond multiple robust approach for missing response problem, Computational Statistics & Data Analysis, 10.1016/j.csda.2020.107111, (107111), (2020).
  • On the Sensitivity of Wage Gap Decompositions, Journal of Labor Research, 10.1007/s12122-020-09302-7, (2020).
  • Managing Market Thickness in Online Business-to-Business Markets, Management Science, 10.1287/mnsc.2019.3497, (2020).
  • Entropy-balanced accruals, Review of Accounting Studies, 10.1007/s11142-019-09525-9, (2020).
  • A General Framework for Treatment Effect Estimators Considering Patient Adherence, Statistics in Biopharmaceutical Research, 10.1080/19466315.2019.1700157, (1-18), (2020).
  • Predictors of Treatment Outcome in Group or Individual Cognitive Processing Therapy for Posttraumatic Stress Disorder Among Active Duty Military, Cognitive Therapy and Research, 10.1007/s10608-020-10085-5, (2020).
  • More insecure and less paid? The effect of perceived job insecurity on wage distribution, Applied Economics, 10.1080/00036846.2020.1734526, (1-16), (2020).
  • Impact of Bus Routes on Crash Frequency in Metropolitan Areas, Transportation Research Record: Journal of the Transportation Research Board, 10.1177/0361198120910739, (036119812091073), (2020).
  • Impact of the Saitama Prefecture Target-Setting Emissions Trading Program on the adoption of low-carbon technology, Environmental Economics and Policy Studies, 10.1007/s10018-020-00270-x, (2020).
  • How does the integration of collaborative care elements in a gatekeeping system affect the costs for mental health care in Germany?, The European Journal of Health Economics, 10.1007/s10198-020-01170-3, (2020).
  • Identification and estimation of average causal effects when treatment status is ignorable within unobserved strata, Econometric Reviews, 10.1080/07474938.2020.1735748, (1-28), (2020).
  • A framework for covariate balance using Bregman distances, Scandinavian Journal of Statistics, 10.1111/sjos.12457, 0, 0, (2020).
  • The impacts of transition to middle school on student cognitive, non-cognitive and perceptual developments: evidence from China, Education Economics, 10.1080/09645292.2020.1749234, (1-19), (2020).
  • Improving Effect Estimates by Limiting the Variability in Inverse Propensity Score Weights, The American Statistician, 10.1080/00031305.2020.1737229, (1-12), (2020).
  • Markets and Spillover Effects of Political Institutions in Promoting Women’s Empowerment: Evidence From India, Feminist Economics, 10.1080/13545701.2020.1752394, (1-30), (2020).
  • A new career in a new town. Job search methods and regional mobility of unemployed workers, Portuguese Economic Journal, 10.1007/s10258-020-00175-3, (2020).
  • Quantile structural treatment effects: application to smoking wage penalty and its determinants, Econometric Reviews, 10.1080/07474938.2020.1770994, (1-20), (2020).
  • Impacto do Projeto Hora de Plantar sobre a sustentabilidade da produção de milho híbrido dos agricultores familiares no Cariri cearense, Revista de Economia e Sociologia Rural, 10.1590/1806-9479.2020.197622, 58, 2, (2020).
  • Network additionality and policy mix of regional and national public support for innovation, Economics of Innovation and New Technology, 10.1080/10438599.2020.1789277, (1-25), (2020).
  • SNAP participation, diet quality, and obesity: robust evidence with estimation techniques without external instrumental variables, Empirical Economics, 10.1007/s00181-020-01902-7, (2020).
  • Machine learning estimation of heterogeneous causal effects: Empirical Monte Carlo evidence, The Econometrics Journal, 10.1093/ectj/utaa014, (2020).
  • Shopping Activity at Warehouse Club Stores and Its Competitive and Network Density Implications, Production and Operations Management, 10.1111/poms.13226, 0, 0, (2020).
  • Nonparametric Tests for Treatment Effect Heterogeneity With Duration Outcomes, Journal of Business & Economic Statistics, 10.1080/07350015.2020.1737080, (1-17), (2020).
  • More Efficient Policy Learning via Optimal Retargeting, Journal of the American Statistical Association, 10.1080/01621459.2020.1788948, (1-13), (2020).
  • Evaluating the Health Outcomes of the Healthy Women Healthy Babies Program in Delaware, Maternal and Child Health Journal, 10.1007/s10995-020-02972-w, (2020).
  • Estimation of Conditional Average Treatment Effects with High-Dimensional Data, Journal of Business & Economic Statistics, 10.1080/07350015.2020.1811102, (1-39), (2020).
  • Mobile phones, household welfare, and women’s empowerment: evidence from rural off-grid regions of Bangladesh*, Information Technology for Development, 10.1080/02681102.2020.1818542, (1-17), (2020).
  • Bias and High-Dimensional Adjustment in Observational Studies of Peer Effects, Journal of the American Statistical Association, 10.1080/01621459.2020.1796393, (1-11), (2020).
  • Debiased machine learning of conditional average treatment effects and other causal functions, The Econometrics Journal, 10.1093/ectj/utaa027, (2020).
  • Industry Experiences of Board, CEO, and Acquisition Performance, Review of Pacific Basin Financial Markets and Policies, 10.1142/S0219091520500228, (2050022), (2020).
  • Propensity score specification for optimal estimation of average treatment effect with binary response, Statistical Methods in Medical Research, 10.1177/0962280220934847, (096228022093484), (2020).
  • Propensity score weighting under limited overlap and model misspecification, Statistical Methods in Medical Research, 10.1177/0962280220940334, (096228022094033), (2020).
  • A Semiparametric Approach to Model Effect Modification, Journal of the American Statistical Association, 10.1080/01621459.2020.1811099, (1-33), (2020).
  • Robust estimation of the causal effect of time‐varying neighborhood factors on health outcomes, Statistics in Medicine, 10.1002/sim.8423, 39, 5, (544-561), (2019).
  • Organic farming for local markets in Kenya: Contribution of conversion and certification to environmental benefits, Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, 10.1111/cjag.12209, 68, 1, (83-105), (2019).
  • Optimally balanced Gaussian process propensity scores for estimating treatment effects, Journal of the Royal Statistical Society: Series A (Statistics in Society), 10.1111/rssa.12502, 183, 1, (355-377), (2019).
  • Improved methods for moment restriction models with data combination and an application to two‐sample instrumental variable estimation, Canadian Journal of Statistics, 10.1002/cjs.11530, 48, 2, (259-284), (2019).
  • Blinatumomab compared with standard of care for the treatment of adult patients with relapsed/refractory Philadelphia chromosome–positive B‐precursor acute lymphoblastic leukemia, Cancer, 10.1002/cncr.32558, 126, 2, (304-310), (2019).
  • Relationship between early‐life nutrition and ages at menarche and first pregnancy, and childbirth rates of young adults: Evidence from APCAPS in India, Maternal & Child Nutrition, 10.1111/mcn.12854, 16, 1, (2019).
  • Permanent wage cost subsidies for older workers. An effective tool for employment retention and postponing early retirement?, Labour Economics, 10.1016/j.labeco.2018.01.005, 58, (145-166), (2019).
  • Commuting behavior and congestion satisfaction: Evidence from Beijing, China, Transportation Research Part D: Transport and Environment, 10.1016/j.trd.2018.12.023, 67, (553-564), (2019).
  • Nearest Neighbor Imputation for General Parameter Estimation in Survey Sampling, The Econometrics of Complex Survey Data, 10.1108/S0731-905320190000039012, (209-234), (2019).
  • undefined, Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining - WSDM '19, 10.1145/3289600.3291033, (483-491), (2019).
  • Identification and wavelet estimation of weighted ATE under discontinuous and kink incentive assignment mechanisms, Journal of Econometrics, 10.1016/j.jeconom.2019.05.015, (2019).
  • Grants vs. credits for improving the livelihoods of ultra-poor: Evidence from Ethiopia, World Development, 10.1016/j.worlddev.2018.09.009, 113, (320-329), (2019).
  • A Nonparametric Dynamic Causal Model for Macroeconometrics, SSRN Electronic Journal, 10.2139/ssrn.3345325, (2019).
  • Handling Missing Data in Instrumental Variable Methods for Causal Inference, Annual Review of Statistics and Its Application, 10.1146/annurev-statistics-031017-100353, 6, 1, (125-148), (2019).
  • Impact of the InnoCom program on corporate innovation performance in China: Evidence from Shanghai, Technological Forecasting and Social Change, 10.1016/j.techfore.2019.05.024, 146, (103-118), (2019).
  • See more

The full text of this article hosted at iucr.org is unavailable due to technical difficulties.