IDEAS home Printed from https://ideas.repec.org/a/cup/etheor/v39y2023i3p582-622_4.html
   My bibliography  Save this article

Testing For Unobserved Heterogeneous Treatment Effects With Observational Data

Author

Listed:
  • Hsu, Yu-Chin
  • Huang, Ta-Cheng
  • Xu, Haiqing

Abstract

Unobserved heterogeneous treatment effects have been emphasized in the recent policy evaluation literature (see, e.g., Heckman and Vytlacil (2005, Econometrica 73, 669–738)). This paper proposes a nonparametric test for unobserved heterogeneous treatment effects in a treatment effect model with a binary treatment assignment, allowing for individuals’ self-selection to the treatment. Under the standard local average treatment effects assumptions, i.e., the no defiers condition, we derive testable model restrictions for the hypothesis of unobserved heterogeneous treatment effects. Furthermore, we show that if the treatment outcomes satisfy a monotonicity assumption, these model restrictions are also sufficient. Then, we propose a modified Kolmogorov–Smirnov-type test which is consistent and simple to implement. Monte Carlo simulations show that our test performs well in finite samples. For illustration, we apply our test to study heterogeneous treatment effects of the Job Training Partnership Act on earnings and the impacts of fertility on family income, where the null hypothesis of homogeneous treatment effects gets rejected in the second case but fails to be rejected in the first application.

Suggested Citation

  • Hsu, Yu-Chin & Huang, Ta-Cheng & Xu, Haiqing, 2023. "Testing For Unobserved Heterogeneous Treatment Effects With Observational Data," Econometric Theory, Cambridge University Press, vol. 39(3), pages 582-622, June.
  • Handle: RePEc:cup:etheor:v:39:y:2023:i:3:p:582-622_4
    as

    Download full text from publisher

    File URL: https://www.cambridge.org/core/product/identifier/S0266466622000147/type/journal_article
    File Function: link to article abstract page
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Andrew Chesher, 2003. "Identification in Nonseparable Models," Econometrica, Econometric Society, vol. 71(5), pages 1405-1441, September.
    2. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    3. J. P. Florens & J. J. Heckman & C. Meghir & E. Vytlacil, 2008. "Identification of Treatment Effects Using Control Functions in Models With Continuous, Endogenous Treatment and Heterogeneous Effects," Econometrica, Econometric Society, vol. 76(5), pages 1191-1206, September.
    4. Bronars, Stephen G & Grogger, Jeff, 1994. "The Economic Consequences of Unwed Motherhood: Using Twin Births as a Natural Experiment," American Economic Review, American Economic Association, vol. 84(5), pages 1141-1156, December.
    5. Heckman, James J. & Schmierer, Daniel & Urzua, Sergio, 2010. "Testing the correlated random coefficient model," Journal of Econometrics, Elsevier, vol. 158(2), pages 177-203, October.
    6. Su, Liangjun & White, Halbert, 2007. "A consistent characteristic function-based test for conditional independence," Journal of Econometrics, Elsevier, vol. 141(2), pages 807-834, December.
    7. Guido W. Imbens & Whitney K. Newey, 2009. "Identification and Estimation of Triangular Simultaneous Equations Models Without Additivity," Econometrica, Econometric Society, vol. 77(5), pages 1481-1512, September.
    8. Alberto Abadie & Joshua Angrist & Guido Imbens, 2002. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Econometrica, Econometric Society, vol. 70(1), pages 91-117, January.
    9. Huang, Meng & Sun, Yixiao & White, Halbert, 2016. "A Flexible Nonparametric Test For Conditional Independence," Econometric Theory, Cambridge University Press, vol. 32(6), pages 1434-1482, December.
    10. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    11. Angrist, Joshua D & Evans, William N, 1998. "Children and Their Parents' Labor Supply: Evidence from Exogenous Variation in Family Size," American Economic Review, American Economic Association, vol. 88(3), pages 450-477, June.
    12. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    13. Pagan,Adrian & Ullah,Aman, 1999. "Nonparametric Econometrics," Cambridge Books, Cambridge University Press, number 9780521355643, September.
    14. Joyce P. Jacobsen & James Wishart Pearce III & Joshua L. Rosenbloom, 1999. "The Effects of Childbearing on Married Women's Labor Supply and Earnings: Using Twin Births as a Natural Experiment," Journal of Human Resources, University of Wisconsin Press, vol. 34(3), pages 449-474.
    15. Markus Frölich & Blaise Melly, 2013. "Unconditional Quantile Treatment Effects Under Endogeneity," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(3), pages 346-357, July.
    16. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
    17. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 487-535.
    18. Wilbert Van Der Klaauw, 2008. "Regression–Discontinuity Analysis: A Survey of Recent Developments in Economics," LABOUR, CEIS, vol. 22(2), pages 219-245, June.
    19. Powell, James L & Stock, James H & Stoker, Thomas M, 1989. "Semiparametric Estimation of Index Coefficients," Econometrica, Econometric Society, vol. 57(6), pages 1403-1430, November.
    20. Victor Chernozhukov & Christian Hansen, 2005. "An IV Model of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 73(1), pages 245-261, January.
    21. Hoderlein, Stefan & White, Halbert, 2012. "Nonparametric identification in nonseparable panel data models with generalized fixed effects," Journal of Econometrics, Elsevier, vol. 168(2), pages 300-314.
    22. Howard S. Bloom & Larry L. Orr & Stephen H. Bell & George Cave & Fred Doolittle & Winston Lin & Johannes M. Bos, 1997. "The Benefits and Costs of JTPA Title II-A Programs: Key Findings from the National Job Training Partnership Act Study," Journal of Human Resources, University of Wisconsin Press, vol. 32(3), pages 549-576.
    23. Oliver Linton & Pedro Gozalo, 2014. "Testing Conditional Independence Restrictions," Econometric Reviews, Taylor & Francis Journals, vol. 33(5-6), pages 523-552, August.
    24. Edward Vytlacil & James J. Heckman, 2001. "Policy-Relevant Treatment Effects," American Economic Review, American Economic Association, vol. 91(2), pages 107-111, May.
    25. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    26. Abadie, Alberto, 2003. "Semiparametric instrumental variable estimation of treatment response models," Journal of Econometrics, Elsevier, vol. 113(2), pages 231-263, April.
    27. Rosenzweig, Mark R & Wolpin, Kenneth I, 1980. "Testing the Quantity-Quality Fertility Model: The Use of Twins as a Natural Experiment," Econometrica, Econometric Society, vol. 48(1), pages 227-240, January.
    28. Stinchcombe, Maxwell B. & White, Halbert, 1998. "Consistent Specification Testing With Nuisance Parameters Present Only Under The Alternative," Econometric Theory, Cambridge University Press, vol. 14(3), pages 295-325, June.
    29. Liangjun Su & Yundong Tu & Aman Ullah, 2015. "Testing Additive Separability of Error Term in Nonparametric Structural Models," Econometric Reviews, Taylor & Francis Journals, vol. 34(6-10), pages 1057-1088, December.
    30. Guido W. Imbens & Donald B. Rubin, 1997. "Estimating Outcome Distributions for Compliers in Instrumental Variables Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 555-574.
    31. Lu, Xun & White, Halbert, 2014. "Testing for separability in structural equations," Journal of Econometrics, Elsevier, vol. 182(1), pages 14-26.
    32. Edward Vytlacil, 2002. "Independence, Monotonicity, and Latent Index Models: An Equivalence Result," Econometrica, Econometric Society, vol. 70(1), pages 331-341, January.
    33. Alexander Torgovitsky, 2015. "Identification of Nonseparable Models Using Instruments With Small Support," Econometrica, Econometric Society, vol. 83(3), pages 1185-1197, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Ma, Jun & Marmer, Vadim & Yu, Zhengfei, 2023. "Inference on individual treatment effects in nonseparable triangular models," Journal of Econometrics, Elsevier, vol. 235(2), pages 2096-2124.
    3. Pereda-Fernández, Santiago, 2023. "Identification and estimation of triangular models with a binary treatment," Journal of Econometrics, Elsevier, vol. 234(2), pages 585-623.
    4. Magne Mogstad & Andres Santos & Alexander Torgovitsky, 2018. "Using Instrumental Variables for Inference About Policy Relevant Treatment Parameters," Econometrica, Econometric Society, vol. 86(5), pages 1589-1619, September.
    5. Lee, Jinhyun, 2013. "Sharp Bounds on Heterogeneous Individual Treatment Responses," SIRE Discussion Papers 2013-89, Scottish Institute for Research in Economics (SIRE).
    6. Black, Dan A. & Joo, Joonhwi & LaLonde, Robert & Smith, Jeffrey A. & Taylor, Evan J., 2022. "Simple Tests for Selection: Learning More from Instrumental Variables," Labour Economics, Elsevier, vol. 79(C).
    7. Blaise Melly und Kaspar W thrich, 2016. "Local quantile treatment effects," Diskussionsschriften dp1605, Universitaet Bern, Departement Volkswirtschaft.
    8. Abrevaya, Jason & Xu, Haiqing, 2023. "Estimation of treatment effects under endogenous heteroskedasticity," Journal of Econometrics, Elsevier, vol. 234(2), pages 451-478.
    9. Halbert White & Karim Chalak, 2013. "Identification and Identification Failure for Treatment Effects Using Structural Systems," Econometric Reviews, Taylor & Francis Journals, vol. 32(3), pages 273-317, November.
    10. Sokbae Lee & Bernard Salanié, 2018. "Identifying Effects of Multivalued Treatments," Econometrica, Econometric Society, vol. 86(6), pages 1939-1963, November.
    11. Victor Chernozhukov & Christian Hansen & Kaspar Wuthrich, 2020. "Instrumental Variable Quantile Regression," Papers 2009.00436, arXiv.org.
    12. Jinhyun Lee, 2013. "Sharp Bounds on Heterogeneous Individual Treatment Responses," Discussion Paper Series, School of Economics and Finance 201310, School of Economics and Finance, University of St Andrews.
    13. Carneiro, Pedro & Lee, Sokbae, 2009. "Estimating distributions of potential outcomes using local instrumental variables with an application to changes in college enrollment and wage inequality," Journal of Econometrics, Elsevier, vol. 149(2), pages 191-208, April.
    14. Kaspar Wüthrich, 2020. "A Comparison of Two Quantile Models With Endogeneity," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(2), pages 443-456, April.
    15. Nguezet, Paul Martin Dontsop & Diagne, Aliou & Okoruwa, Victor Olusegun & Ojehomon, Vivian, 2011. "Impact of Improved Rice Technology (NERICA varieties) on Income and Poverty among Rice Farming Households in Nigeria: A Local Average Treatment Effect (LATE) Approach," Quarterly Journal of International Agriculture, Humboldt-Universitaat zu Berlin, vol. 50(3), pages 1-25.
    16. Schmieder, Julia, 2021. "Fertility as a driver of maternal employment," Labour Economics, Elsevier, vol. 72(C).
    17. Huber, Martin & Wüthrich, Kaspar, 2017. "Evaluating local average and quantile treatment effects under endogeneity based on instruments: a review," FSES Working Papers 479, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    18. Wüthrich, Kaspar, 2019. "A closed-form estimator for quantile treatment effects with endogeneity," Journal of Econometrics, Elsevier, vol. 210(2), pages 219-235.
    19. Halbert White & Karim Chalak, 2008. "Identifying Structural Effects in Nonseparable Systems Using Covariates," Boston College Working Papers in Economics 734, Boston College Department of Economics.
    20. Julia Schmieder, 2020. "Fertility as a Driver of Maternal Employment," Discussion Papers of DIW Berlin 1882, DIW Berlin, German Institute for Economic Research.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cup:etheor:v:39:y:2023:i:3:p:582-622_4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kirk Stebbing (email available below). General contact details of provider: https://www.cambridge.org/ect .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.