IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2407.14074.html
   My bibliography  Save this paper

Regression Adjustment for Estimating Distributional Treatment Effects in Randomized Controlled Trials

Author

Listed:
  • Tatsushi Oka
  • Shota Yasui
  • Yuta Hayakawa
  • Undral Byambadalai

Abstract

In this paper, we address the issue of estimating and inferring the distributional treatment effects in randomized experiments. The distributional treatment effect provides a more comprehensive understanding of treatment effects by characterizing heterogeneous effects across individual units, as opposed to relying solely on the average treatment effect. To enhance the precision of distributional treatment effect estimation, we propose a regression adjustment method that utilizes the distributional regression and pre-treatment information. Our method is designed to be free from restrictive distributional assumptions. We establish theoretical efficiency gains and develop a practical, statistically sound inferential framework. Through extensive simulation studies and empirical applications, we illustrate the substantial advantages of our method, equipping researchers with a powerful tool for capturing the full spectrum of treatment effects in experimental research.

Suggested Citation

  • Tatsushi Oka & Shota Yasui & Yuta Hayakawa & Undral Byambadalai, 2024. "Regression Adjustment for Estimating Distributional Treatment Effects in Randomized Controlled Trials," Papers 2407.14074, arXiv.org.
    • Handle: RePEc:arx:papers:2407.14074
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2407.14074
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    2. Victor Chernozhukov & Iván Fernández-Val & Blaise Melly & Kaspar Wüthrich, 2020. "Generic Inference on Quantile and Quantile Effect Functions for Discrete Outcomes," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(529), pages 123-137, January.
    3. Hall, Peter & Wolff, Rodney C. L. & Yao, Qiwei, 1999. "Methods for estimating a conditional distribution function," LSE Research Online Documents on Economics 6631, London School of Economics and Political Science, LSE Library.
    4. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    5. V. Chernozhukov & I. Fernández-Val & A. Galichon, 2009. "Improving point and interval estimators of monotone functions by rearrangement," Biometrika, Biometrika Trust, vol. 96(3), pages 559-575.
    6. Alberto Abadie & Joshua Angrist & Guido Imbens, 2002. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Econometrica, Econometric Society, vol. 70(1), pages 91-117, January.
    7. Jiang, Liang & Phillips, Peter C.B. & Tao, Yubo & Zhang, Yichong, 2023. "Regression-adjusted estimation of quantile treatment effects under covariate-adaptive randomizations," Journal of Econometrics, Elsevier, vol. 234(2), pages 758-776.
    8. Chernozhukov, Victor & Fernández-Val, Iván & Weidner, Martin, 2024. "Network and panel quantile effects via distribution regression," Journal of Econometrics, Elsevier, vol. 240(2).
    9. Wang, Yunyun & Oka, Tatsushi & Zhu, Dan, 2023. "Bivariate distribution regression with application to insurance data," Insurance: Mathematics and Economics, Elsevier, vol. 113(C), pages 215-232.
    10. Newey, Whitney K, 1994. "The Asymptotic Variance of Semiparametric Estimators," Econometrica, Econometric Society, vol. 62(6), pages 1349-1382, November.
    11. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 487-535.
    12. Kato, Kengo, 2009. "Asymptotics for argmin processes: Convexity arguments," Journal of Multivariate Analysis, Elsevier, vol. 100(8), pages 1816-1829, September.
    13. Kosuke Imai, 2005. "Do get-out-the-vote calls reduce turnout? The importance of statistical methods for field experiments," Natural Field Experiments 00272, The Field Experiments Website.
    14. Victor Chernozhukov & Christian Hansen, 2005. "An IV Model of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 73(1), pages 245-261, January.
    15. Susan Athey & Guido W. Imbens, 2006. "Identification and Inference in Nonlinear Difference-in-Differences Models," Econometrica, Econometric Society, vol. 74(2), pages 431-497, March.
    16. Amy Finkelstein & Sarah Taubman & Bill Wright & Mira Bernstein & Jonathan Gruber & Joseph P. Newhouse & Heidi Allen & Katherine Baicker, 2012. "The Oregon Health Insurance Experiment: Evidence from the First Year," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(3), pages 1057-1106.
    17. Akanksha Negi & Jeffrey M. Wooldridge, 2021. "Revisiting regression adjustment in experiments with heterogeneous treatment effects," Econometric Reviews, Taylor & Francis Journals, vol. 40(5), pages 504-534, April.
    18. Donald, Stephen G. & Hsu, Yu-Chin, 2014. "Estimation and inference for distribution functions and quantile functions in treatment effect models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 383-397.
    19. Yusaku Horiuchi & Kosuke Imai & Naoko Taniguchi, 2007. "Designing and Analyzing Randomized Experiments: Application to a Japanese Election Survey Experiment," American Journal of Political Science, John Wiley & Sons, vol. 51(3), pages 669-687, July.
    20. Xinkun Nie & Stefan Wager, 2017. "Quasi-Oracle Estimation of Heterogeneous Treatment Effects," Papers 1712.04912, arXiv.org, revised Aug 2020.
    21. Djebbari, Habiba & Smith, Jeffrey, 2008. "Heterogeneous impacts in PROGRESA," Journal of Econometrics, Elsevier, vol. 145(1-2), pages 64-80, July.
    22. Imai, Kosuke, 2005. "Do Get-Out-the-Vote Calls Reduce Turnout? The Importance of Statistical Methods for Field Experiments," American Political Science Review, Cambridge University Press, vol. 99(2), pages 283-300, May.
    23. Brantly Callaway & Tong Li, 2019. "Quantile treatment effects in difference in differences models with panel data," Quantitative Economics, Econometric Society, vol. 10(4), pages 1579-1618, November.
    24. Abadie A., 2002. "Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 284-292, March.
    25. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, October.
    26. Callaway, Brantly & Li, Tong & Oka, Tatsushi, 2018. "Quantile treatment effects in difference in differences models under dependence restrictions and with only two time periods," Journal of Econometrics, Elsevier, vol. 206(2), pages 395-413.
    27. Randall A. Lewis & Justin M. Rao, 2015. "The Unfavorable Economics of Measuring the Returns to Advertising," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(4), pages 1941-1973.
    28. Pollard, David, 1991. "Asymptotics for Least Absolute Deviation Regression Estimators," Econometric Theory, Cambridge University Press, vol. 7(2), pages 186-199, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Undral Byambadalai & Tatsushi Oka & Shota Yasui, 2024. "Estimating Distributional Treatment Effects in Randomized Experiments: Machine Learning for Variance Reduction," Papers 2407.16037, arXiv.org.
    2. Victor Chernozhukov & Iván Fernández‐Val & Blaise Melly, 2013. "Inference on Counterfactual Distributions," Econometrica, Econometric Society, vol. 81(6), pages 2205-2268, November.
    3. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    4. Yunyun Wang & Tatsushi Oka & Dan Zhu, 2023. "Distributional Vector Autoregression: Eliciting Macro and Financial Dependence," Papers 2303.04994, arXiv.org.
    5. Pedro H. C. Sant'Anna, 2016. "Program Evaluation with Right-Censored Data," Papers 1604.02642, arXiv.org.
    6. Callaway, Brantly & Li, Tong & Oka, Tatsushi, 2018. "Quantile treatment effects in difference in differences models under dependence restrictions and with only two time periods," Journal of Econometrics, Elsevier, vol. 206(2), pages 395-413.
    7. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    8. Masayuki Sawada, 2019. "Noncompliance in randomized control trials without exclusion restrictions," Papers 1910.03204, arXiv.org, revised Jun 2021.
    9. Shengfang Tang & Zongwu Cai & Ying Fang & Ming Lin, 2020. "A New Quantile Treatment Effect Model for Studying Smoking Effect on Birth Weight During Mother's Pregnancy," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202003, University of Kansas, Department of Economics, revised Feb 2020.
    10. Wang, Yunyun & Oka, Tatsushi & Zhu, Dan, 2023. "Bivariate distribution regression with application to insurance data," Insurance: Mathematics and Economics, Elsevier, vol. 113(C), pages 215-232.
    11. Brantly Callaway & Weige Huang, 2020. "Distributional Effects of a Continuous Treatment with an Application on Intergenerational Mobility," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 82(4), pages 808-842, August.
    12. Rahul Singh & Liyang Sun, 2024. "Double robustness for complier parameters and a semi-parametric test for complier characteristics," The Econometrics Journal, Royal Economic Society, vol. 27(1), pages 1-20.
    13. Blaise Melly und Kaspar W thrich, 2016. "Local quantile treatment effects," Diskussionsschriften dp1605, Universitaet Bern, Departement Volkswirtschaft.
    14. Christopher Adjaho & Timothy Christensen, 2022. "Externally Valid Policy Choice," Papers 2205.05561, arXiv.org, revised Jul 2023.
    15. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.
    16. Frandsen, Brigham R. & Frölich, Markus & Melly, Blaise, 2012. "Quantile treatment effects in the regression discontinuity design," Journal of Econometrics, Elsevier, vol. 168(2), pages 382-395.
    17. Sergio Firpo, 2007. "Efficient Semiparametric Estimation of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 75(1), pages 259-276, January.
    18. Pereda-Fernández, Santiago, 2023. "Identification and estimation of triangular models with a binary treatment," Journal of Econometrics, Elsevier, vol. 234(2), pages 585-623.
    19. Susan Athey & Guido W. Imbens, 2006. "Identification and Inference in Nonlinear Difference-in-Differences Models," Econometrica, Econometric Society, vol. 74(2), pages 431-497, March.
    20. Afrouz Azadikhah Jahromi & Brantly Callaway, 2022. "Heterogeneous Effects of Job Displacement on Earnings," Empirical Economics, Springer, vol. 62(1), pages 213-245, January.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2407.14074. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.