Inference on Counterfactual Distributions
Abstract
Counterfactual distributions are important ingredients for policy analysis and decomposition analysis in empirical economics. In this article, we develop modeling and inference tools for counterfactual distributions based on regression methods. The counterfactual scenarios that we consider consist of ceteris paribus changes in either the distribution of covariates related to the outcome of interest or the conditional distribution of the outcome given covariates. For either of these scenarios, we derive joint functional central limit theorems and bootstrap validity results for regression‐based estimators of the status quo and counterfactual outcome distributions. These results allow us to construct simultaneous confidence sets for function‐valued effects of the counterfactual changes, including the effects on the entire distribution and quantile functions of the outcome as well as on related functionals. These confidence sets can be used to test functional hypotheses such as no‐effect, positive effect, or stochastic dominance. Our theory applies to general counterfactual changes and covers the main regression methods including classical, quantile, duration, and distribution regressions. We illustrate the results with an empirical application to wage decompositions using data for the United States.
As a part of developing the main results, we introduce distribution regression as a comprehensive and flexible tool for modeling and estimating the entire conditional distribution. We show that distribution regression encompasses the Cox duration regression and represents a useful alternative to quantile regression. We establish functional central limit theorems and bootstrap validity results for the empirical distribution regression process and various related functionals.
Citing Literature
Number of times cited according to CrossRef: 179
- Daniel Baumgarten, Gabriel Felbermayr, Sybille Lehwald, Dissecting Between‐Plant and Within‐Plant Wage Dispersion: Evidence from Germany, Industrial Relations: A Journal of Economy and Society, 10.1111/irel.12249, 59, 1, (85-122), (2020).
- Victor Chernozhukov, Iván Fernández‐Val, Whitney Newey, Sami Stouli, Francis Vella, Semiparametric estimation of structural functions in nonseparable triangular models, Quantitative Economics, 10.3982/QE1239, 11, 2, (503-533), (2020).
- Chunrong Ai, Lukang Huang, Zheng Zhang, A Mann–Whitney test of distributional effects in a multivalued treatment, Journal of Statistical Planning and Inference, 10.1016/j.jspi.2020.03.002, (2020).
- Christian Haslinger, Wolfgang Korte, Torsten Hothorn, Romana Brun, Charles Greenberg, Roland Zimmermann, The impact of prepartum factor XIII activity on postpartum blood loss, Journal of Thrombosis and Haemostasis, 10.1111/jth.14795, 18, 6, (1310-1319), (2020).
- Hisham S. El-Osta, The rural–urban income divide among farm households: the role of off-farm work and farm size, Agricultural Finance Review, 10.1108/AFR-12-2018-0106, ahead-of-print, ahead-of-print, (2020).
- Maria Michael, Louis N. Christofides, The Impact of Austerity Measures on the Public -Private Sector Wage Gap in Europe, Labour Economics, 10.1016/j.labeco.2020.101796, (101796), (2020).
- Øystein M. Hernæs, Distributional Effects of Welfare Reform for Young Adults: An Unconditional Quantile Regression Approach, Labour Economics, 10.1016/j.labeco.2020.101818, (101818), (2020).
- Matthew A. Kraft, Eric J. Brunner, Shaun M. Dougherty, David J. Schwegman, Teacher accountability reforms and the supply and quality of new teachers, Journal of Public Economics, 10.1016/j.jpubeco.2020.104212, 188, (104212), (2020).
- Yu-Chin Hsu, Tsung-Chih Lai, Robert P. Lieli, Counterfactual Treatment Effects: Estimation and Inference, Journal of Business & Economic Statistics, 10.1080/07350015.2020.1800479, (1), (2020).
- Whitney Newey, Sami Stouli, Control variables, discrete instruments, and identification of structural functions, Journal of Econometrics, 10.1016/j.jeconom.2020.07.027, (2020).
- Brantly Callaway, Bounds on distributional treatment effect parameters using panel data with an application on job displacement, Journal of Econometrics, 10.1016/j.jeconom.2020.02.005, (2020).
- Brantly Callaway, Weige Huang, Distributional Effects of a Continuous Treatment with an Application on Intergenerational Mobility, Oxford Bulletin of Economics and Statistics, 10.1111/obes.12355, 82, 4, (808-842), (2020).
- Ikechukwu D. Nwaka, Michael U. Nwogu, Kalu E. Uma, George N. Ike, Agricultural production and CO2 emissions from two sources in the ECOWAS region: New insights from quantile regression and decomposition analysis, Science of The Total Environment, 10.1016/j.scitotenv.2020.141329, 748, (141329), (2020).
- Andrew Goodman-Bacon, Lucie Schmidt, Federalizing benefits: The introduction of Supplemental Security Income and the size of the safety net, Journal of Public Economics, 10.1016/j.jpubeco.2020.104174, 185, (104174), (2020).
- Jean-Paul Chavas, The dynamics and volatility of prices in multiple markets: a quantile approach, Empirical Economics, 10.1007/s00181-020-01821-7, (2020).
- Maike Hohberg, Peter Pütz, Thomas Kneib, Treatment effects beyond the mean using distributional regression: Methods and guidance, PLOS ONE, 10.1371/journal.pone.0226514, 15, 2, (e0226514), (2020).
- Usamah F. Alfarhan, Samir Al-Busaidi, Women’s earnings between migration status and glass ceilings: a double penalty?, Applied Economics Letters, 10.1080/13504851.2020.1728222, (1-4), (2020).
- Xisco Oliver, Maria Sard, Gender Wage Gap in Hospitality, Journal of Hospitality & Tourism Research, 10.1177/1096348020909423, (109634802090942), (2020).
- Victor Troster, Dominik Wied, A specification test for dynamic conditional distribution models with function-valued parameters, Econometric Reviews, 10.1080/07474938.2020.1761151, (1-19), (2020).
- Victor Chernozhukov, Iván Fernández-Val, Blaise Melly, Fast algorithms for the quantile regression process, Empirical Economics, 10.1007/s00181-020-01898-0, (2020).
- Pallab Kumar Ghosh, Box–Cox power transformation unconditional quantile regressions with an application on wage inequality, Journal of Applied Statistics, 10.1080/02664763.2020.1795817, (1-16), (2020).
- Khalid Abu-Ismail, Verena Gantner, Paul Makdissi, Myra Yazbeck, Socioeconomic inequalities in child malnutrition in Egypt, METRON, 10.1007/s40300-020-00176-4, (2020).
- Nasri Harb, Tony Rouhana, Earnings and gender wage gap in Lebanon: the role of the human and social capital, Applied Economics, 10.1080/00036846.2020.1745750, (1-16), (2020).
- Luca Bonacini, Giovanni Gallo, Sergio Scicchitano, Working from home and income inequality: risks of a ‘new normal’ with COVID-19, Journal of Population Economics, 10.1007/s00148-020-00800-7, (2020).
- Mónica Segovia‐Pérez, Rosa Belén Castro Núñez, Rosa Santero Sánchez, Pilar Laguna Sánchez, Being a woman in an ICT job: an analysis of the gender pay gap and discrimination in Spain, New Technology, Work and Employment, 10.1111/ntwe.12145, 35, 1, (20-39), (2019).
- Michael Christl, Monika Köppl-Turyna, Gender Wage Gaps and Skills, Handbook of Labor, Human Resources and Population Economics, 10.1007/978-3-319-57365-6, (1-21), (2019).
- Tien Manh Vu, Hiroyuki Yamada, Convergence of public and private enterprise wages in a transition economy: Evidence from a distributional decomposition in Vietnam, 2002–2014, Economic Systems, 10.1016/j.ecosys.2019.100737, (100737), (2019).
- Grant Gibson, Luc Clair, O brother how art thou: Propensity to report self-assessed unmet need, Social Science & Medicine, 10.1016/j.socscimed.2019.112632, (112632), (2019).
- Maria R. Ferrante, Marzia Freo, Detecting learning‐by‐exporting effects on firms' productivity distribution by accounting for heterogeneous macrofactors and panel attrition, The World Economy, 10.1111/twec.12807, 42, 9, (2745-2773), (2019).
- Kaspar Wüthrich, A closed-form estimator for quantile treatment effects with endogeneity, Journal of Econometrics, 10.1016/j.jeconom.2018.11.017, (2019).
- Xisco Oliver, Maria Sard, The wage gap in Spain for temporary workers: the effects of the Great Recession, International Journal of Manpower, 10.1108/IJM-01-2019-0018, ahead-of-print, ahead-of-print, (2019).
- Stanislav Anatolyev, Jozef Baruník, Forecasting dynamic return distributions based on ordered binary choice, International Journal of Forecasting, 10.1016/j.ijforecast.2019.01.005, 35, 3, (823-835), (2019).
- Liangjun Su, Takuya Ura, Yichong Zhang, Non-separable models with high-dimensional data, Journal of Econometrics, 10.1016/j.jeconom.2019.06.004, (2019).
- Nikolas Tromp, The Narrowing Gender Wage Gap in South Korea, Journal of the Japanese and International Economies, 10.1016/j.jjie.2019.101032, (101032), (2019).
- Patricia Gallego-Granados, The Part-Time Wage Gap Across the Wage Distribution, SSRN Electronic Journal, 10.2139/ssrn.3342046, (2019).
- Guy Lacroix, Social Policy and Income Mobility: An Interprovincial Perspective, Canadian Public Policy, 10.3138/cpp.2019-012, 45, 2, (105-128), (2019).
- Ingo W.K. Kolodziej, Pilar García-Gómez, Saved by retirement: Beyond the mean effect on mental health, Social Science & Medicine, 10.1016/j.socscimed.2019.02.003, (2019).
- Carl Lin, Yana van der Meulen Rodgers, Parental Migration Decisions and Child Health Outcomes: Evidence from China, Health and Labor Markets, 10.1108/S0147-912120190000047010, (281-310), (2019).
- José Luis Iparraguirre, José Luis Iparraguirre, Inequality, Economics and Ageing, 10.1007/978-3-030-29013-9, (121-174), (2019).
- Christoph Rothe, Dominik Wied, Estimating derivatives of function-valued parameters in a class of moment condition models, Journal of Econometrics, 10.1016/j.jeconom.2019.11.004, (2019).
- Arindrajit Dube, Minimum Wages and the Distribution of Family Incomes, American Economic Journal: Applied Economics, 10.1257/app.20170085, 11, 4, (268-304), (2019).
- Victor Chernozhukov, Ivan Fernández-Val, Sukjin Han, Amanda Kowalski, Censored quantile instrumental-variable estimation with Stata, The Stata Journal: Promoting communications on statistics and Stata, 10.1177/1536867X19893615, 19, 4, (768-781), (2019).
- Chunrong Ai, Lukang Huang, Zheng Zhang, Efficient Estimation of Counterfactual Distributions and Testing Distributional Treatment Effects, SSRN Electronic Journal, 10.2139/ssrn.3382968, (2019).
- Rebecca Taylor, A Mixed Bag: The Hidden Time Costs of Regulating Consumer Behavior, Journal of the Association of Environmental and Resource Economists, 10.1086/707039, (2019).
- Anurag Sharma, Brian Vandenberg, Heterogenous wealth effects of minimum unit price on purchase of alcohol: Evidence using scanner data, PLOS ONE, 10.1371/journal.pone.0225538, 14, 12, (e0225538), (2019).
- M. Christl, Monika Köppl–Turyna, Gender wage gap and the role of skills and tasks: evidence from the Austrian PIAAC data set, Applied Economics, 10.1080/00036846.2019.1630707, (1-22), (2019).
- Mustafizur Rahman, Md. Al-Hasan, Male–Female Wage Gap and Informal Employment in Bangladesh: A Quantile Regression Approach, South Asia Economic Journal, 10.1177/1391561418824477, (139156141882447), (2019).
- Badi H. Baltagi, Pallab K. Ghosh, Partial Distributional Policy Effects Under Endogeneity, Sankhya B, 10.1007/s13571-019-00190-1, (2019).
- Jeremiah Richey, Alicia Rosburg, Decomposing joint distributions via reweighting functions: an application to intergenerational economic mobility, Econometric Reviews, 10.1080/07474938.2019.1697088, (1-18), (2019).
- Torsten Hothorn, Transformation boosting machines, Statistics and Computing, 10.1007/s11222-019-09870-4, (2019).
- Orlando Sotomayor, Growth with reduction in poverty and inequality: did Brazil show the way?, The Journal of Economic Inequality, 10.1007/s10888-019-09418-6, (2019).
- Martin Biewen, Matthias Seckler, Unions, Internationalization, Tasks, Firms, and Worker Characteristics: A Detailed Decomposition Analysis of Rising Wage Inequality in Germany, The Journal of Economic Inequality, 10.1007/s10888-019-09422-w, (2019).
- Wallice Ao, Sebastian Calonico, Ying-Ying Lee, Multivalued Treatments and Decomposition Analysis: An Application to the WIA Program, Journal of Business & Economic Statistics, 10.1080/07350015.2019.1660664, (1-14), (2019).
- Victor Chernozhukov, Iván Fernández-Val, Blaise Melly, Kaspar Wüthrich, Generic Inference on Quantile and Quantile Effect Functions for Discrete Outcomes, Journal of the American Statistical Association, 10.1080/01621459.2019.1611581, (1-24), (2019).
- David Powell, Quantile Treatment Effects in the Presence of Covariates, The Review of Economics and Statistics, 10.1162/rest_a_00858, (1-12), (2019).
- Olivier Bargain, Karina Doorley, Philippe Van Kerm, Minimum Wages and the Gender GAP in Pay: New Evidence from the United Kingdom and Ireland, Review of Income and Wealth, 10.1111/roiw.12384, 65, 3, (514-539), (2018).
- Matthias Collischon, Is There a Glass Ceiling over Germany?, German Economic Review, 10.1111/geer.12168, 20, 4, (e329-e359), (2018).
- Davud Rostam‐Afschar, Kristina Strohmaier, Does Regulation Trade Off Quality against Inequality? The Case of German Architects and Construction Engineers, British Journal of Industrial Relations, 10.1111/bjir.12445, 57, 4, (870-893), (2018).
- José Luis Montiel Olea, Mikkel Plagborg‐Møller, Simultaneous confidence bands: Theory, implementation, and an application to SVARs, Journal of Applied Econometrics, 10.1002/jae.2656, 34, 1, (1-17), (2018).
- Tobias Haepp, Mei Hsu, Educational inequalities between children of marriage migrants and those of local-born parents – quantile regression results from Taiwan, Applied Economics, 10.1080/00036846.2018.1490001, 51, 5, (465-487), (2018).
- Daniela Piazzalunga, Maria Laura Di Tommaso, The increase of the gender wage gap in Italy during the 2008-2012 economic crisis, The Journal of Economic Inequality, 10.1007/s10888-018-9396-8, 17, 2, (171-193), (2018).
- Torsten Hothorn, Letter to the Editor response: Garcia et al., Biostatistics, 10.1093/biostatistics/kxy079, 20, 3, (546-548), (2018).
- Rebecca Taylor, A Mixed Bag: The Hidden Time Costs of Regulating Consumer Behavior, SSRN Electronic Journal, 10.2139/ssrn.3186504, (2018).
- Victor Chernozhukov, Iván Fernández‐Val, Ye Luo, The Sorted Effects Method: Discovering Heterogeneous Effects Beyond Their Averages, Econometrica, 10.3982/ECTA14415, 86, 6, (1911-1938), (2018).
- Tien M. Vu, Hiroyuki Yamada, Decomposing Vietnamese gender equality in terms of wage distribution, Pacific Economic Review, 10.1111/1468-0106.12269, 23, 5, (705-731), (2018).
- Sungchul Park, Anirban Basu, Alternative evaluation metrics for risk adjustment methods, Health Economics, 10.1002/hec.3657, 27, 6, (984-1010), (2018).
- Alexander Silbersdorff, Julia Lynch, Stephan Klasen, Thomas Kneib, Reconsidering the income‐health relationship using distributional regression, Health Economics, 10.1002/hec.3656, 27, 7, (1074-1088), (2018).
- Resampling, subsampling, and quantile regression, Quantile Regression, undefined, (81-125), (2018).
- Brantly Callaway, Tong Li, Tatsushi Oka, Quantile treatment effects in difference in differences models under dependence restrictions and with only two time periods, Journal of Econometrics, 10.1016/j.jeconom.2018.06.008, 206, 2, (395-413), (2018).
- Marco Francesconi, Matthias Parey, Early gender gaps among university graduates, European Economic Review, 10.1016/j.euroecorev.2018.02.004, 109, (63-82), (2018).
- Marcos Delprato, Amita Chudgar, Factors associated with private-public school performance: Analysis of TALIS-PISA link data, International Journal of Educational Development, 10.1016/j.ijedudev.2018.01.002, 61, (155-172), (2018).
- Steven F. Lehrer, R. Vincent Pohl, Kyungchul Song, Multiple Testing and the Distributional Effects of Accountability Incentives in Education, SSRN Electronic Journal, 10.2139/ssrn.3266793, (2018).
- Torsten Hothorn, Top-down transformation choice, Statistical Modelling, 10.1177/1471082X17748081, 18, 3-4, (274-298), (2018).
- Alberto Abadie, Matias D. Cattaneo, Econometric Methods for Program Evaluation, Annual Review of Economics, 10.1146/annurev-economics-080217-053402, 10, 1, (465-503), (2018).
- Wallice Ao, Sebastian Calonico, Ying-Ying Lee, Multivalued Treatments and Decomposition Analysis: An Application to the WIA Program, SSRN Electronic Journal, 10.2139/ssrn.3276370, (2018).
- Sven Broschinski, Jenny Preunkert, Martin Heidenreich, Lohnentwicklungen im öffentlichen SektorWage Developments in the Public Sector, Österreichische Zeitschrift für Soziologie, 10.1007/s11614-018-0300-3, 43, S1, (117-145), (2018).
- Juan Nelson MARTÍNEZ DAHBURA, On the Distributional Effect of Japan’s Equal Employment Opportunity Act on the Gender Wage Gap, Social Science Japan Journal, 10.1093/ssjj/jyy003, 21, 2, (305-328), (2018).
- Ying-Ying Lee, Partial Mean Processes with Generated Regressors: Continuous Treatment Effects and Nonseparable Models, SSRN Electronic Journal, 10.2139/ssrn.3250485, (2018).
- Lei Zhang, Yimin Yi, What contributes to the rising house prices in Beijing? A decomposition approach, Journal of Housing Economics, 10.1016/j.jhe.2018.04.003, 41, (72-84), (2018).
- Ursina Kuhn, Markus Grabka, Homeownership and Wealth in Switzerland and Germany, Social Dynamics in Swiss Society, 10.1007/978-3-319-89557-4_12, (175-185), (2018).
- Carolina Castagnetti, Maria Letizia Giorgetti, Understanding the gender wage-gap differential between the public and private sectors in Italy: A quantile approach, Economic Modelling, 10.1016/j.econmod.2018.09.025, (2018).
- Daniela Piazzalunga, The Gender Wage Gap Among College Graduates in Italy, Italian Economic Journal, 10.1007/s40797-017-0069-8, 4, 1, (33-90), (2018).
- Blagica Petreski, Marjan Petreski, Does motherhood explain lower wages for women in Macedonia?, Economic Research-Ekonomska Istraživanja, 10.1080/1331677X.2018.1432395, 31, 1, (352-375), (2018).
- Yingying Dong, Shu Shen, Testing for Rank Invariance or Similarity in Program Evaluation, The Review of Economics and Statistics, 10.1162/REST_a_00686, 100, 1, (78-85), (2018).
- Guido Cozzi, Silvia Galli, Noemi Mantovan, Will a shrink make you richer? Gender differences in the effects of psychotherapy on labour efficiency, European Economic Review, 10.1016/j.euroecorev.2017.10.005, 109, (257-274), (2018).
- Patrick Schneider, Decomposing Differences in Productivity Distributions, SSRN Electronic Journal, 10.2139/ssrn.3217075, (2018).
- Bryan S. Graham, Jinyong Hahn, Alexandre Poirier, James L. Powell, A quantile correlated random coefficients panel data model, Journal of Econometrics, 10.1016/j.jeconom.2018.06.004, 206, 2, (305-335), (2018).
- Huong Trinh Thi, Michel Simioni, Christine Thomas-Agnan, Decomposition of changes in the consumption of macronutrients in Vietnam between 2004 and 2014, Economics & Human Biology, 10.1016/j.ehb.2018.09.002, 31, (259-275), (2018).
- Ying-Ying Lee, Nonparametric Weighted Average Quantile Derivative, SSRN Electronic Journal, 10.2139/ssrn.3174854, (2018).
- Weige Huang, Decomposing Differences in Portfolio Returns between North America and Europe, SSRN Electronic Journal, 10.2139/ssrn.3216303, (2018).
- Wifag Adnan, Sami H. Miaari, Voting patterns and the gender wage gap, Journal of Economic Behavior & Organization, 10.1016/j.jebo.2017.12.027, 146, (222-247), (2018).
- Philip Kostov, Sophia Davidova, Alistair Bailey, Effect of family labour on output of farms in selected EU Member States: a non-parametric quantile regression approach, European Review of Agricultural Economics, 10.1093/erae/jbx036, 45, 3, (367-395), (2018).
- R H Spady, S Stouli, Dual regression, Biometrika, 10.1093/biomet/asx074, 105, 1, (1-18), (2018).
- Bernhard Schmidpeter, The Long-Term Labor Market Effects of Parental Unemployment, SSRN Electronic Journal, 10.2139/ssrn.3283144, (2018).
- Dirk Antonczyk, Thomas DeLeire, Bernd Fitzenberger, Polarization and Rising Wage Inequality: Comparing the U.S. and Germany, Econometrics, 10.3390/econometrics6020020, 6, 2, (20), (2018).
- Jidong Yang, Kai Liu, Yiran Zhang, Happiness Inequality in China, Journal of Happiness Studies, 10.1007/s10902-018-0067-z, (2018).
- Sergio Firpo, Nicole Fortin, Thomas Lemieux, Decomposing Wage Distributions Using Recentered Influence Function Regressions, Econometrics, 10.3390/econometrics6020028, 6, 2, (28), (2018).
- Marilena Furno, Francesco Caracciolo, Multi-valued Double Robust quantile treatment effect, Empirical Economics, 10.1007/s00181-018-1584-7, (2018).
- Esfandiar Maasoumi, Le Wang, The Gender Gap Between Earnings Distributions, Journal of Political Economy, 10.1086/701788, (2018).
- Giang Nguyen, Changes in the distribution of household consumption in Southeast Asia, Economic Change and Restructuring, 10.1007/s10644-018-9236-7, (2018).
- See more




