IDEAS home Printed from https://ideas.repec.org/p/mea/meawpa/201805.html
   My bibliography  Save this paper

Instrument Validity Tests with Causal Trees: With an Application to the Same-sex Instrument

Author

Listed:
  • Guber, Raphael

    (Munich Center for the Economics of Aging (MEA))

Abstract

The use of instrumental variables (IVs) to identify causal effects is widespread in empirical economics, but it is fundamentally impossible to proof their validity. However, assumptions sufficient for the identification of local average treatment effects (LATEs) jointly generate necessary conditions in the observed data that allow to refute an IV's validity. Suitable tests exist, but they may not be able to detect even severe violations of IV validity in practice. In this paper, we employ recently developed machine learning tools as data-driven improvements for these tests. Specifically, we use the causal tree (CT) algorithm from Athey and Imbens (2016) to directly search the covariate space for violations of the LATE assumptions. The new approach is applied to the sibling sex composition instrument in census data from China and the United States. We expect that, because of son preferences, the siblings sex instrument is invalid in the Chinese context. However, existing IV validity tests are unable to detect violations, while our CT based procedure does.

Suggested Citation

  • Guber, Raphael, 2018. "Instrument Validity Tests with Causal Trees: With an Application to the Same-sex Instrument," MEA discussion paper series 201805, Munich Center for the Economics of Aging (MEA) at the Max Planck Institute for Social Law and Social Policy.
    • Handle: RePEc:mea:meawpa:201805
    as

    Download full text from publisher

    File URL: http://mea.mpisoc.mpg.de/uploads/user_mea_discussionpapers/1872_MEA_DP_neu_26102018.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    2. Rajeev Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2021. "From Local to Global: External Validity in a Fertility Natural Experiment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 217-243, January.
    3. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    4. Kenneth I. Wolpin & Mark R. Rosenzweig, 2000. "Natural "Natural Experiments" in Economics," Journal of Economic Literature, American Economic Association, vol. 38(4), pages 827-874, December.
    5. Gordon B. Dahl & Enrico Moretti, 2008. "The Demand for Sons," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(4), pages 1085-1120.
    6. Victor Chernozhukov & Sokbae Lee & Adam M. Rosen, 2013. "Intersection Bounds: Estimation and Inference," Econometrica, Econometric Society, vol. 81(2), pages 667-737, March.
    7. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    8. Susan Athey & Julie Tibshirani & Stefan Wager, 2016. "Generalized Random Forests," Papers 1610.01271, arXiv.org, revised Apr 2018.
    9. Victor Chernozhukov & Christian Hansen & Martin Spindler, 2015. "Post-Selection and Post-Regularization Inference in Linear Models with Many Controls and Instruments," American Economic Review, American Economic Association, vol. 105(5), pages 486-490, May.
    10. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2013. "Testing Many Moment Inequalities," CeMMAP working papers 65/13, Institute for Fiscal Studies.
    11. Christian N. Brinch & Magne Mogstad & Matthew Wiswall, 2017. "Beyond LATE with a Discrete Instrument," Journal of Political Economy, University of Chicago Press, vol. 125(4), pages 985-1039.
    12. Machado, Cecilia & Shaikh, Azeem M. & Vytlacil, Edward J., 2019. "Instrumental variables and the sign of the average treatment effect," Journal of Econometrics, Elsevier, vol. 212(2), pages 522-555.
    13. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    14. Toru Kitagawa, 2015. "A Test for Instrument Validity," Econometrica, Econometric Society, vol. 83(5), pages 2043-2063, September.
    15. Jungmin Lee, 2008. "Sibling size and investment in children’s education: an asian instrument," Journal of Population Economics, Springer;European Society for Population Economics, vol. 21(4), pages 855-875, October.
    16. Emla Fitzsimons & Bansi Malde, 2014. "Empirically probing the quantity–quality model," Journal of Population Economics, Springer;European Society for Population Economics, vol. 27(1), pages 33-68, January.
    17. Ismael Mourifié & Yuanyuan Wan, 2017. "Testing Local Average Treatment Effect Assumptions," The Review of Economics and Statistics, MIT Press, vol. 99(2), pages 305-313, May.
    18. Frank Windmeijer & Helmut Farbmacher & Neil Davies & George Davey Smith, 2019. "On the Use of the Lasso for Instrumental Variables Estimation with Some Invalid Instruments," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(527), pages 1339-1350, July.
    19. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    20. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    21. Martin Huber, 2015. "Testing the Validity of the Sibling Sex Ratio Instrument," LABOUR, CEIS, vol. 29(1), pages 1-14, March.
    22. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    23. Michael C. Knaus & Michael Lechner & Anthony Strittmatter, 2022. "Heterogeneous Employment Effects of Job Search Programs: A Machine Learning Approach," Journal of Human Resources, University of Wisconsin Press, vol. 57(2), pages 597-636.
    24. Christopher J. Bennett, 2009. "Consistent and Asymptotically Unbiased MinP Tests of Multiple Inequality Moment Restrictions," Vanderbilt University Department of Economics Working Papers 0908, Vanderbilt University Department of Economics.
    25. Jonathan M.V. Davis & Sara B. Heller, 2017. "Using Causal Forests to Predict Treatment Heterogeneity: An Application to Summer Jobs," American Economic Review, American Economic Association, vol. 107(5), pages 546-550, May.
    26. Daniel Aaronson & Rajeev Dehejia & Andrew Jordan & Cristian Pop-Eleches & Cyrus Samii & Karl Schulze, 2021. "The Effect of Fertility on Mothers’ Labor Supply over the Last Two Centuries [Semiparametric instrumental variables estimation of treatment response models]," The Economic Journal, Royal Economic Society, vol. 131(633), pages 1-32.
    27. Sara Cools & Rannveig Kaldager Hart, 2017. "The Effect of Childhood Family Size on Fertility in Adulthood: New Evidence From IV Estimation," Demography, Springer;Population Association of America (PAA), vol. 54(1), pages 23-44, February.
    28. Angrist, Joshua D & Evans, William N, 1998. "Children and Their Parents' Labor Supply: Evidence from Exogenous Variation in Family Size," American Economic Review, American Economic Association, vol. 88(3), pages 450-477, June.
    29. Martin Huber & Giovanni Mellace, 2015. "Testing Instrument Validity for LATE Identification Based on Inequality Moment Constraints," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 398-411, May.
    30. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey, 2017. "Double/Debiased/Neyman Machine Learning of Treatment Effects," American Economic Review, American Economic Association, vol. 107(5), pages 261-265, May.
    31. Sam Asher & Denis Nekipelov & Paul Novosad & Stephen P. Ryan, 2016. "Classification Trees for Heterogeneous Moment-Based Models," NBER Working Papers 22976, National Bureau of Economic Research, Inc.
    32. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2016. "Double/Debiased Machine Learning for Treatment and Causal Parameters," Papers 1608.00060, arXiv.org, revised Nov 2024.
    33. Hyunseung Kang & Anru Zhang & T. Tony Cai & Dylan S. Small, 2016. "Instrumental Variables Estimation With Some Invalid Instruments and its Application to Mendelian Randomization," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 132-144, March.
    34. Lukas Laffers & Giovanni Mellace, 2017. "A note on testing instrument validity for the identification of LATE," Empirical Economics, Springer, vol. 53(3), pages 1281-1286, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Eibich, Peter & Siedler, Thomas, 2020. "Retirement, intergenerational time transfers, and fertility," European Economic Review, Elsevier, vol. 124(C).
    2. Martin Huber, 2019. "An introduction to flexible methods for policy evaluation," Papers 1910.00641, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Schmieder, Julia, 2021. "Fertility as a driver of maternal employment," Labour Economics, Elsevier, vol. 72(C).
    2. Julia Schmieder, 2020. "Fertility as a Driver of Maternal Employment," Discussion Papers of DIW Berlin 1882, DIW Berlin, German Institute for Economic Research.
    3. Jan Priebe, 2020. "Quasi-experimental evidence for the causal link between fertility and subjective well-being," Journal of Population Economics, Springer;European Society for Population Economics, vol. 33(3), pages 839-882, July.
    4. Thomas Carr & Toru Kitagawa, 2021. "Testing Instrument Validity with Covariates," Papers 2112.08092, arXiv.org, revised Sep 2023.
    5. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    6. Martin Huber & Jannis Kueck, 2022. "Testing the identification of causal effects in observational data," Papers 2203.15890, arXiv.org, revised Jun 2023.
    7. Joshua D. Angrist, 2022. "Empirical Strategies in Economics: Illuminating the Path From Cause to Effect," Econometrica, Econometric Society, vol. 90(6), pages 2509-2539, November.
    8. Huber, Martin & Wüthrich, Kaspar, 2017. "Evaluating local average and quantile treatment effects under endogeneity based on instruments: a review," FSES Working Papers 479, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    9. Su, Liangjun & Ura, Takuya & Zhang, Yichong, 2019. "Non-separable models with high-dimensional data," Journal of Econometrics, Elsevier, vol. 212(2), pages 646-677.
    10. Yinchu Zhu, 2021. "Phase transition of the monotonicity assumption in learning local average treatment effects," Papers 2103.13369, arXiv.org.
    11. Michael C Knaus & Michael Lechner & Anthony Strittmatter, 2021. "Machine learning estimation of heterogeneous causal effects: Empirical Monte Carlo evidence," The Econometrics Journal, Royal Economic Society, vol. 24(1), pages 134-161.
    12. Sander Gerritsen & Mark Kattenberg & Sonny Kuijpers, 2019. "The impact of age at arrival on education and mental health," CPB Discussion Paper 389.rdf, CPB Netherlands Bureau for Economic Policy Analysis.
    13. Sander Gerritsen & Mark Kattenberg & Sonny Kuijpers, 2019. "The impact of age at arrival on education and mental health," CPB Discussion Paper 389, CPB Netherlands Bureau for Economic Policy Analysis.
    14. Santiago Acerenza & Otávio Bartalotti & Désiré Kédagni, 2023. "Testing identifying assumptions in bivariate probit models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(3), pages 407-422, April.
    15. Kédagni, Désiré, 2023. "Identifying treatment effects in the presence of confounded types," Journal of Econometrics, Elsevier, vol. 234(2), pages 479-511.
    16. Kitagawa, Toru, 2021. "The identification region of the potential outcome distributions under instrument independence," Journal of Econometrics, Elsevier, vol. 225(2), pages 231-253.
    17. Valente, Marica, 2023. "Policy evaluation of waste pricing programs using heterogeneous causal effect estimation," Journal of Environmental Economics and Management, Elsevier, vol. 117(C).
    18. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    19. Damian Clarke, 2018. "Children And Their Parents: A Review Of Fertility And Causality," Journal of Economic Surveys, Wiley Blackwell, vol. 32(2), pages 518-540, April.
    20. Abadie, Alberto & Gu, Jiaying & Shen, Shu, 2024. "Instrumental variable estimation with first-stage heterogeneity," Journal of Econometrics, Elsevier, vol. 240(2).

    More about this item

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mea:meawpa:201805. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Henning Frankenberger (email available below). General contact details of provider: http://www.mea.mpisoc.mpg.de/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.