Volume 81, Issue 6

Inference on Counterfactual Distributions

Victor Chernozhukov

Dept. of Economics, Massachusetts Institute of Technology, Cambridge, MA 02139, U.S.A.; vchern@mit.edu; http://www.mit.edu/~vchern/

Search for more papers by this author
Iván Fernández‐Val

Dept. of Economics, Boston University, Boston, MA 02215, U.S.A.; ivanf@bu.edu; http://people.bu.edu/ivanf/

Search for more papers by this author
Blaise Melly

Dept. of Economics, Bern University, 3001 Bern, Switzerland; blaise.melly@vwi.unibe.ch; http://staff.vwi.unibe.ch/melly/

This paper replaces the earlier independent projects started in 2005, “Inference on Counterfactual Distributions Using Conditional Quantile Models” by Chernozhukov and Fernández‐Val, and “Estimation of Counterfactual Distributions Using Quantile Regression” by Melly. We would like to thank the co‐editors, five anonymous referees, Isaiah Andrews, Josh Angrist, Manuel Arellano, David Autor, Alexandre Belloni, Moshe Buchinsky, Arun Chandrasekhar, Mingli Chen, Denis Chetverikov, Flavio Cunha, Brigham Frandsen, Jerry Hausman, James Heckman, Michael Jansson, Kengo Kato, Roger Koenker, Joonhwan Lee, Ye Luo, Pierre‐Andre Maugis, Justin McCrary, Miikka Rokkanen, and seminar participants at Banff International Research Station Conference on Semiparametric and Nonparametric Methods in Econometrics, Berkeley, Boston University, CEMFI, Columbia, Harvard/MIT, Michigan, MIT, Ohio State, St. Gallen, and the 2008 Winter Econometric Society Meetings for very useful comments that helped improve the paper. Companion software developed by the authors (counterfactual packages for Stata and R) is available from the authors' web sites. We gratefully acknowledge research support from the National Science Foundation.

Search for more papers by this author
First published: 13 November 2013
Citations: 179

Abstract

Counterfactual distributions are important ingredients for policy analysis and decomposition analysis in empirical economics. In this article, we develop modeling and inference tools for counterfactual distributions based on regression methods. The counterfactual scenarios that we consider consist of ceteris paribus changes in either the distribution of covariates related to the outcome of interest or the conditional distribution of the outcome given covariates. For either of these scenarios, we derive joint functional central limit theorems and bootstrap validity results for regression‐based estimators of the status quo and counterfactual outcome distributions. These results allow us to construct simultaneous confidence sets for function‐valued effects of the counterfactual changes, including the effects on the entire distribution and quantile functions of the outcome as well as on related functionals. These confidence sets can be used to test functional hypotheses such as no‐effect, positive effect, or stochastic dominance. Our theory applies to general counterfactual changes and covers the main regression methods including classical, quantile, duration, and distribution regressions. We illustrate the results with an empirical application to wage decompositions using data for the United States.

As a part of developing the main results, we introduce distribution regression as a comprehensive and flexible tool for modeling and estimating the entire conditional distribution. We show that distribution regression encompasses the Cox duration regression and represents a useful alternative to quantile regression. We establish functional central limit theorems and bootstrap validity results for the empirical distribution regression process and various related functionals.

Number of times cited according to CrossRef: 179

  • Dissecting Between‐Plant and Within‐Plant Wage Dispersion: Evidence from Germany, Industrial Relations: A Journal of Economy and Society, 10.1111/irel.12249, 59, 1, (85-122), (2020).
  • Semiparametric estimation of structural functions in nonseparable triangular models, Quantitative Economics, 10.3982/QE1239, 11, 2, (503-533), (2020).
  • A Mann–Whitney test of distributional effects in a multivalued treatment, Journal of Statistical Planning and Inference, 10.1016/j.jspi.2020.03.002, (2020).
  • The impact of prepartum factor XIII activity on postpartum blood loss, Journal of Thrombosis and Haemostasis, 10.1111/jth.14795, 18, 6, (1310-1319), (2020).
  • The rural–urban income divide among farm households: the role of off-farm work and farm size, Agricultural Finance Review, 10.1108/AFR-12-2018-0106, ahead-of-print, ahead-of-print, (2020).
  • The Impact of Austerity Measures on the Public -Private Sector Wage Gap in Europe, Labour Economics, 10.1016/j.labeco.2020.101796, (101796), (2020).
  • Distributional Effects of Welfare Reform for Young Adults: An Unconditional Quantile Regression Approach, Labour Economics, 10.1016/j.labeco.2020.101818, (101818), (2020).
  • Teacher accountability reforms and the supply and quality of new teachers, Journal of Public Economics, 10.1016/j.jpubeco.2020.104212, 188, (104212), (2020).
  • Counterfactual Treatment Effects: Estimation and Inference, Journal of Business & Economic Statistics, 10.1080/07350015.2020.1800479, (1), (2020).
  • Control variables, discrete instruments, and identification of structural functions, Journal of Econometrics, 10.1016/j.jeconom.2020.07.027, (2020).
  • Bounds on distributional treatment effect parameters using panel data with an application on job displacement, Journal of Econometrics, 10.1016/j.jeconom.2020.02.005, (2020).
  • Distributional Effects of a Continuous Treatment with an Application on Intergenerational Mobility, Oxford Bulletin of Economics and Statistics, 10.1111/obes.12355, 82, 4, (808-842), (2020).
  • Agricultural production and CO2 emissions from two sources in the ECOWAS region: New insights from quantile regression and decomposition analysis, Science of The Total Environment, 10.1016/j.scitotenv.2020.141329, 748, (141329), (2020).
  • Federalizing benefits: The introduction of Supplemental Security Income and the size of the safety net, Journal of Public Economics, 10.1016/j.jpubeco.2020.104174, 185, (104174), (2020).
  • The dynamics and volatility of prices in multiple markets: a quantile approach, Empirical Economics, 10.1007/s00181-020-01821-7, (2020).
  • Treatment effects beyond the mean using distributional regression: Methods and guidance, PLOS ONE, 10.1371/journal.pone.0226514, 15, 2, (e0226514), (2020).
  • Women’s earnings between migration status and glass ceilings: a double penalty?, Applied Economics Letters, 10.1080/13504851.2020.1728222, (1-4), (2020).
  • Gender Wage Gap in Hospitality, Journal of Hospitality & Tourism Research, 10.1177/1096348020909423, (109634802090942), (2020).
  • A specification test for dynamic conditional distribution models with function-valued parameters, Econometric Reviews, 10.1080/07474938.2020.1761151, (1-19), (2020).
  • Fast algorithms for the quantile regression process, Empirical Economics, 10.1007/s00181-020-01898-0, (2020).
  • Box–Cox power transformation unconditional quantile regressions with an application on wage inequality, Journal of Applied Statistics, 10.1080/02664763.2020.1795817, (1-16), (2020).
  • Socioeconomic inequalities in child malnutrition in Egypt, METRON, 10.1007/s40300-020-00176-4, (2020).
  • Earnings and gender wage gap in Lebanon: the role of the human and social capital, Applied Economics, 10.1080/00036846.2020.1745750, (1-16), (2020).
  • Working from home and income inequality: risks of a ‘new normal’ with COVID-19, Journal of Population Economics, 10.1007/s00148-020-00800-7, (2020).
  • Being a woman in an ICT job: an analysis of the gender pay gap and discrimination in Spain, New Technology, Work and Employment, 10.1111/ntwe.12145, 35, 1, (20-39), (2019).
  • Gender Wage Gaps and Skills, Handbook of Labor, Human Resources and Population Economics, 10.1007/978-3-319-57365-6, (1-21), (2019).
  • Convergence of public and private enterprise wages in a transition economy: Evidence from a distributional decomposition in Vietnam, 2002–2014, Economic Systems, 10.1016/j.ecosys.2019.100737, (100737), (2019).
  • O brother how art thou: Propensity to report self-assessed unmet need, Social Science & Medicine, 10.1016/j.socscimed.2019.112632, (112632), (2019).
  • Detecting learning‐by‐exporting effects on firms' productivity distribution by accounting for heterogeneous macrofactors and panel attrition, The World Economy, 10.1111/twec.12807, 42, 9, (2745-2773), (2019).
  • A closed-form estimator for quantile treatment effects with endogeneity, Journal of Econometrics, 10.1016/j.jeconom.2018.11.017, (2019).
  • The wage gap in Spain for temporary workers: the effects of the Great Recession, International Journal of Manpower, 10.1108/IJM-01-2019-0018, ahead-of-print, ahead-of-print, (2019).
  • Forecasting dynamic return distributions based on ordered binary choice, International Journal of Forecasting, 10.1016/j.ijforecast.2019.01.005, 35, 3, (823-835), (2019).
  • Non-separable models with high-dimensional data, Journal of Econometrics, 10.1016/j.jeconom.2019.06.004, (2019).
  • The Narrowing Gender Wage Gap in South Korea, Journal of the Japanese and International Economies, 10.1016/j.jjie.2019.101032, (101032), (2019).
  • The Part-Time Wage Gap Across the Wage Distribution, SSRN Electronic Journal, 10.2139/ssrn.3342046, (2019).
  • Social Policy and Income Mobility: An Interprovincial Perspective, Canadian Public Policy, 10.3138/cpp.2019-012, 45, 2, (105-128), (2019).
  • Saved by retirement: Beyond the mean effect on mental health, Social Science & Medicine, 10.1016/j.socscimed.2019.02.003, (2019).
  • Parental Migration Decisions and Child Health Outcomes: Evidence from China, Health and Labor Markets, 10.1108/S0147-912120190000047010, (281-310), (2019).
  • Inequality, Economics and Ageing, 10.1007/978-3-030-29013-9, (121-174), (2019).
  • Estimating derivatives of function-valued parameters in a class of moment condition models, Journal of Econometrics, 10.1016/j.jeconom.2019.11.004, (2019).
  • Minimum Wages and the Distribution of Family Incomes, American Economic Journal: Applied Economics, 10.1257/app.20170085, 11, 4, (268-304), (2019).
  • Censored quantile instrumental-variable estimation with Stata, The Stata Journal: Promoting communications on statistics and Stata, 10.1177/1536867X19893615, 19, 4, (768-781), (2019).
  • Efficient Estimation of Counterfactual Distributions and Testing Distributional Treatment Effects, SSRN Electronic Journal, 10.2139/ssrn.3382968, (2019).
  • A Mixed Bag: The Hidden Time Costs of Regulating Consumer Behavior, Journal of the Association of Environmental and Resource Economists, 10.1086/707039, (2019).
  • Heterogenous wealth effects of minimum unit price on purchase of alcohol: Evidence using scanner data, PLOS ONE, 10.1371/journal.pone.0225538, 14, 12, (e0225538), (2019).
  • Gender wage gap and the role of skills and tasks: evidence from the Austrian PIAAC data set, Applied Economics, 10.1080/00036846.2019.1630707, (1-22), (2019).
  • Male–Female Wage Gap and Informal Employment in Bangladesh: A Quantile Regression Approach, South Asia Economic Journal, 10.1177/1391561418824477, (139156141882447), (2019).
  • Partial Distributional Policy Effects Under Endogeneity, Sankhya B, 10.1007/s13571-019-00190-1, (2019).
  • Decomposing joint distributions via reweighting functions: an application to intergenerational economic mobility, Econometric Reviews, 10.1080/07474938.2019.1697088, (1-18), (2019).
  • Transformation boosting machines, Statistics and Computing, 10.1007/s11222-019-09870-4, (2019).
  • Growth with reduction in poverty and inequality: did Brazil show the way?, The Journal of Economic Inequality, 10.1007/s10888-019-09418-6, (2019).
  • Unions, Internationalization, Tasks, Firms, and Worker Characteristics: A Detailed Decomposition Analysis of Rising Wage Inequality in Germany, The Journal of Economic Inequality, 10.1007/s10888-019-09422-w, (2019).
  • Multivalued Treatments and Decomposition Analysis: An Application to the WIA Program, Journal of Business & Economic Statistics, 10.1080/07350015.2019.1660664, (1-14), (2019).
  • Generic Inference on Quantile and Quantile Effect Functions for Discrete Outcomes, Journal of the American Statistical Association, 10.1080/01621459.2019.1611581, (1-24), (2019).
  • Quantile Treatment Effects in the Presence of Covariates, The Review of Economics and Statistics, 10.1162/rest_a_00858, (1-12), (2019).
  • Minimum Wages and the Gender GAP in Pay: New Evidence from the United Kingdom and Ireland, Review of Income and Wealth, 10.1111/roiw.12384, 65, 3, (514-539), (2018).
  • Is There a Glass Ceiling over Germany?, German Economic Review, 10.1111/geer.12168, 20, 4, (e329-e359), (2018).
  • Does Regulation Trade Off Quality against Inequality? The Case of German Architects and Construction Engineers, British Journal of Industrial Relations, 10.1111/bjir.12445, 57, 4, (870-893), (2018).
  • Simultaneous confidence bands: Theory, implementation, and an application to SVARs, Journal of Applied Econometrics, 10.1002/jae.2656, 34, 1, (1-17), (2018).
  • Educational inequalities between children of marriage migrants and those of local-born parents – quantile regression results from Taiwan, Applied Economics, 10.1080/00036846.2018.1490001, 51, 5, (465-487), (2018).
  • The increase of the gender wage gap in Italy during the 2008-2012 economic crisis, The Journal of Economic Inequality, 10.1007/s10888-018-9396-8, 17, 2, (171-193), (2018).
  • Letter to the Editor response: Garcia et al., Biostatistics, 10.1093/biostatistics/kxy079, 20, 3, (546-548), (2018).
  • A Mixed Bag: The Hidden Time Costs of Regulating Consumer Behavior, SSRN Electronic Journal, 10.2139/ssrn.3186504, (2018).
  • The Sorted Effects Method: Discovering Heterogeneous Effects Beyond Their Averages, Econometrica, 10.3982/ECTA14415, 86, 6, (1911-1938), (2018).
  • Decomposing Vietnamese gender equality in terms of wage distribution, Pacific Economic Review, 10.1111/1468-0106.12269, 23, 5, (705-731), (2018).
  • Alternative evaluation metrics for risk adjustment methods, Health Economics, 10.1002/hec.3657, 27, 6, (984-1010), (2018).
  • Reconsidering the income‐health relationship using distributional regression, Health Economics, 10.1002/hec.3656, 27, 7, (1074-1088), (2018).
  • Resampling, subsampling, and quantile regression, Quantile Regression, undefined, (81-125), (2018).
  • Quantile treatment effects in difference in differences models under dependence restrictions and with only two time periods, Journal of Econometrics, 10.1016/j.jeconom.2018.06.008, 206, 2, (395-413), (2018).
  • Early gender gaps among university graduates, European Economic Review, 10.1016/j.euroecorev.2018.02.004, 109, (63-82), (2018).
  • Factors associated with private-public school performance: Analysis of TALIS-PISA link data, International Journal of Educational Development, 10.1016/j.ijedudev.2018.01.002, 61, (155-172), (2018).
  • Multiple Testing and the Distributional Effects of Accountability Incentives in Education, SSRN Electronic Journal, 10.2139/ssrn.3266793, (2018).
  • Top-down transformation choice, Statistical Modelling, 10.1177/1471082X17748081, 18, 3-4, (274-298), (2018).
  • Econometric Methods for Program Evaluation, Annual Review of Economics, 10.1146/annurev-economics-080217-053402, 10, 1, (465-503), (2018).
  • Multivalued Treatments and Decomposition Analysis: An Application to the WIA Program, SSRN Electronic Journal, 10.2139/ssrn.3276370, (2018).
  • Lohnentwicklungen im öffentlichen SektorWage Developments in the Public Sector, Österreichische Zeitschrift für Soziologie, 10.1007/s11614-018-0300-3, 43, S1, (117-145), (2018).
  • On the Distributional Effect of Japan’s Equal Employment Opportunity Act on the Gender Wage Gap, Social Science Japan Journal, 10.1093/ssjj/jyy003, 21, 2, (305-328), (2018).
  • Partial Mean Processes with Generated Regressors: Continuous Treatment Effects and Nonseparable Models, SSRN Electronic Journal, 10.2139/ssrn.3250485, (2018).
  • What contributes to the rising house prices in Beijing? A decomposition approach, Journal of Housing Economics, 10.1016/j.jhe.2018.04.003, 41, (72-84), (2018).
  • Homeownership and Wealth in Switzerland and Germany, Social Dynamics in Swiss Society, 10.1007/978-3-319-89557-4_12, (175-185), (2018).
  • Understanding the gender wage-gap differential between the public and private sectors in Italy: A quantile approach, Economic Modelling, 10.1016/j.econmod.2018.09.025, (2018).
  • The Gender Wage Gap Among College Graduates in Italy, Italian Economic Journal, 10.1007/s40797-017-0069-8, 4, 1, (33-90), (2018).
  • Does motherhood explain lower wages for women in Macedonia?, Economic Research-Ekonomska Istraživanja, 10.1080/1331677X.2018.1432395, 31, 1, (352-375), (2018).
  • Testing for Rank Invariance or Similarity in Program Evaluation, The Review of Economics and Statistics, 10.1162/REST_a_00686, 100, 1, (78-85), (2018).
  • Will a shrink make you richer? Gender differences in the effects of psychotherapy on labour efficiency, European Economic Review, 10.1016/j.euroecorev.2017.10.005, 109, (257-274), (2018).
  • Decomposing Differences in Productivity Distributions, SSRN Electronic Journal, 10.2139/ssrn.3217075, (2018).
  • A quantile correlated random coefficients panel data model, Journal of Econometrics, 10.1016/j.jeconom.2018.06.004, 206, 2, (305-335), (2018).
  • Decomposition of changes in the consumption of macronutrients in Vietnam between 2004 and 2014, Economics & Human Biology, 10.1016/j.ehb.2018.09.002, 31, (259-275), (2018).
  • Nonparametric Weighted Average Quantile Derivative, SSRN Electronic Journal, 10.2139/ssrn.3174854, (2018).
  • Decomposing Differences in Portfolio Returns between North America and Europe, SSRN Electronic Journal, 10.2139/ssrn.3216303, (2018).
  • Voting patterns and the gender wage gap, Journal of Economic Behavior & Organization, 10.1016/j.jebo.2017.12.027, 146, (222-247), (2018).
  • Effect of family labour on output of farms in selected EU Member States: a non-parametric quantile regression approach, European Review of Agricultural Economics, 10.1093/erae/jbx036, 45, 3, (367-395), (2018).
  • Dual regression, Biometrika, 10.1093/biomet/asx074, 105, 1, (1-18), (2018).
  • The Long-Term Labor Market Effects of Parental Unemployment, SSRN Electronic Journal, 10.2139/ssrn.3283144, (2018).
  • Polarization and Rising Wage Inequality: Comparing the U.S. and Germany, Econometrics, 10.3390/econometrics6020020, 6, 2, (20), (2018).
  • Happiness Inequality in China, Journal of Happiness Studies, 10.1007/s10902-018-0067-z, (2018).
  • Decomposing Wage Distributions Using Recentered Influence Function Regressions, Econometrics, 10.3390/econometrics6020028, 6, 2, (28), (2018).
  • Multi-valued Double Robust quantile treatment effect, Empirical Economics, 10.1007/s00181-018-1584-7, (2018).
  • The Gender Gap Between Earnings Distributions, Journal of Political Economy, 10.1086/701788, (2018).
  • Changes in the distribution of household consumption in Southeast Asia, Economic Change and Restructuring, 10.1007/s10644-018-9236-7, (2018).
  • See more

The full text of this article hosted at iucr.org is unavailable due to technical difficulties.