IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v237y2023i2s0304407623002397.html
   My bibliography  Save this article

Instrument validity for heterogeneous causal effects

Author

Listed:
  • Sun, Zhenting

Abstract

This paper provides a general framework for testing instrument validity in heterogeneous causal effect models. The generalization includes the cases where the treatment can be multivalued ordered or unordered. Based on a series of testable implications, we propose a nonparametric test which is proved to be asymptotically size controlled and consistent. Compared to the tests in the literature, our test can be applied in more general settings and may achieve power improvement. Refutation of instrument validity by the test helps detect invalid instruments that may yield implausible results on causal effects. Evidence that the test performs well on finite samples is provided via simulations. We revisit the empirical study on return to schooling to demonstrate application of the proposed test in practice. An extended continuous mapping theorem and an extended delta method, which may be of independent interest, are provided to establish the asymptotic distribution of the test statistic under null.

Suggested Citation

  • Sun, Zhenting, 2023. "Instrument validity for heterogeneous causal effects," Journal of Econometrics, Elsevier, vol. 237(2).
  • Handle: RePEc:eee:econom:v:237:y:2023:i:2:s0304407623002397
    DOI: 10.1016/j.jeconom.2023.105523
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407623002397
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2023.105523?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Beare, Brendan K. & Shi, Xiaoxia, 2019. "An improved bootstrap test of density ratio ordering," Econometrics and Statistics, Elsevier, vol. 10(C), pages 9-26.
    2. Linton, Oliver & Song, Kyungchul & Whang, Yoon-Jae, 2010. "An improved bootstrap test of stochastic dominance," Journal of Econometrics, Elsevier, vol. 154(2), pages 186-202, February.
    3. James J. Heckman & Vytlacil, Edward J., 2007. "Econometric Evaluation of Social Programs, Part II: Using the Marginal Treatment Effect to Organize Alternative Econometric Estimators to Evaluate Social Programs, and to Forecast their Effects in New," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 71, Elsevier.
    4. Donald W. K. Andrews & Xiaoxia Shi, 2013. "Inference Based on Conditional Moment Inequalities," Econometrica, Econometric Society, vol. 81(2), pages 609-666, March.
    5. Victor Chernozhukov & Sokbae Lee & Adam M. Rosen, 2013. "Intersection Bounds: Estimation and Inference," Econometrica, Econometric Society, vol. 81(2), pages 667-737, March.
    6. Sokbae Lee & Bernard Salanié, 2018. "Identifying Effects of Multivalued Treatments," Econometrica, Econometric Society, vol. 86(6), pages 1939-1963, November.
    7. Victor Chernozhukov & Wooyoung Kim & Sokbae Lee & Adam M. Rosen, 2015. "Implementing intersection bounds in Stata," Stata Journal, StataCorp LP, vol. 15(1), pages 21-44, March.
    8. Elizabeth O. Ananat & Guy Michaels, 2008. "The Effect of Marital Breakup on the Income Distribution of Women with Children," Journal of Human Resources, University of Wisconsin Press, vol. 43(3), pages 611-629.
    9. Alberto Abadie & Joshua Angrist & Guido Imbens, 2002. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Econometrica, Econometric Society, vol. 70(1), pages 91-117, January.
    10. Donald W. K. Andrews, 2000. "Inconsistency of the Bootstrap when a Parameter Is on the Boundary of the Parameter Space," Econometrica, Econometric Society, vol. 68(2), pages 399-406, March.
    11. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    12. Kasey S. Buckles & Daniel M. Hungerman, 2013. "Season of Birth and Later Outcomes: Old Questions, New Answers," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 711-724, July.
    13. Armstrong, Timothy B. & Chan, Hock Peng, 2016. "Multiscale adaptive inference on conditional moment inequalities," Journal of Econometrics, Elsevier, vol. 194(1), pages 24-43.
    14. Edward Vytlacil, 2006. "Ordered Discrete-Choice Selection Models and Local Average Treatment Effect Assumptions: Equivalence, Nonequivalence, and Representation Results," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 578-581, August.
    15. Armstrong, Timothy B., 2014. "Weighted KS statistics for inference on conditional moment inequalities," Journal of Econometrics, Elsevier, vol. 181(2), pages 92-116.
    16. Markus Frölich & Blaise Melly, 2013. "Unconditional Quantile Treatment Effects Under Endogeneity," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(3), pages 346-357, July.
    17. Giacomini, Raffaella & Politis, Dimitris N. & White, Halbert, 2013. "A Warp-Speed Method For Conducting Monte Carlo Experiments Involving Bootstrap Estimators," Econometric Theory, Cambridge University Press, vol. 29(3), pages 567-589, June.
    18. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    19. Reed, William J., 2001. "The Pareto, Zipf and other power laws," Economics Letters, Elsevier, vol. 74(1), pages 15-19, December.
    20. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
    21. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," American Economic Review, American Economic Association, vol. 80(3), pages 313-336, June.
    22. Toru Kitagawa, 2015. "A Test for Instrument Validity," Econometrica, Econometric Society, vol. 83(5), pages 2043-2063, September.
    23. Ozkan Eren & Serkan Ozbeklik, 2014. "Who Benefits From Job Corps? A Distributional Analysis Of An Active Labor Market Program," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(4), pages 586-611, June.
    24. Garry F. Barrett & Stephen G. Donald & Debopam Bhattacharya, 2014. "Consistent Nonparametric Tests for Lorenz Dominance," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(1), pages 1-13, January.
    25. Ismael Mourifié & Yuanyuan Wan, 2017. "Testing Local Average Treatment Effect Assumptions," The Review of Economics and Statistics, MIT Press, vol. 99(2), pages 305-313, May.
    26. Angrist, Joshua D & Krueger, Alan B, 1995. "Split-Sample Instrumental Variables Estimates of the Return to Schooling," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(2), pages 225-235, April.
    27. Lee, Sokbae & Song, Kyungchul & Whang, Yoon-Jae, 2018. "Testing For A General Class Of Functional Inequalities," Econometric Theory, Cambridge University Press, vol. 34(5), pages 1018-1064, October.
    28. David Card, 1993. "Using Geographic Variation in College Proximity to Estimate the Return to Schooling," Working Papers 696, Princeton University, Department of Economics, Industrial Relations Section..
    29. Andrews, Donald W.K. & Shi, Xiaoxia, 2014. "Nonparametric inference based on conditional moment inequalities," Journal of Econometrics, Elsevier, vol. 179(1), pages 31-45.
    30. Imbens, Guido W., 2014. "Instrumental Variables: An Econometrician's Perspective," IZA Discussion Papers 8048, Institute of Labor Economics (IZA).
    31. Reed, William J., 2003. "The Pareto law of incomes—an explanation and an extension," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 319(C), pages 469-486.
    32. Hsu, Yu-Chin & Liu, Chu-An & Shi, Xiaoxia, 2019. "Testing Generalized Regression Monotonicity," Econometric Theory, Cambridge University Press, vol. 35(6), pages 1146-1200, December.
    33. James J. Heckman & Rodrigo Pinto, 2018. "Unordered Monotonicity," Econometrica, Econometric Society, vol. 86(1), pages 1-35, January.
    34. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    35. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    36. Keisuke Hirano & Jack R. Porter, 2012. "Impossibility Results for Nondifferentiable Functionals," Econometrica, Econometric Society, vol. 80(4), pages 1769-1790, July.
    37. Joshua D. Angrist & Jörn-Steffen Pischke, 2014. "Mastering ’Metrics: The Path from Cause to Effect," Economics Books, Princeton University Press, edition 1, number 10363.
    38. repec:cwl:cwldpp:1840rr is not listed on IDEAS
    39. Zheng Fang & Andres Santos, 2019. "Inference on Directionally Differentiable Functions," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(1), pages 377-412.
    40. Beare, Brendan K. & Moon, Jong-Myun, 2015. "Nonparametric Tests Of Density Ratio Ordering," Econometric Theory, Cambridge University Press, vol. 31(3), pages 471-492, June.
    41. Donald W. K. Andrews & Gustavo Soares, 2010. "Inference for Parameters Defined by Moment Inequalities Using Generalized Moment Selection," Econometrica, Econometric Society, vol. 78(1), pages 119-157, January.
    42. David Card, 1993. "Using Geographic Variation in College Proximity to Estimate the Return to Schooling," Working Papers 696, Princeton University, Department of Economics, Industrial Relations Section..
    43. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2008. "Instrumental Variables in Models with Multiple Outcomes: The General Unordered Case," Annals of Economics and Statistics, GENES, issue 91-92, pages 151-174.
    44. Horvath, Lajos & Kokoszka, Piotr & Zitikis, Ricardas, 2006. "Testing for stochastic dominance using the weighted McFadden-type statistic," Journal of Econometrics, Elsevier, vol. 133(1), pages 191-205, July.
    45. Seo, Juwon, 2018. "Tests of stochastic monotonicity with improved power," Journal of Econometrics, Elsevier, vol. 207(1), pages 53-70.
    46. Magne Mogstad & Alexander Torgovitsky & Christopher R. Walters, 2021. "The Causal Interpretation of Two-Stage Least Squares with Multiple Instrumental Variables," American Economic Review, American Economic Association, vol. 111(11), pages 3663-3698, November.
    47. Martin Huber & Giovanni Mellace, 2015. "Testing Instrument Validity for LATE Identification Based on Inequality Moment Constraints," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 398-411, May.
    48. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records: Errata," American Economic Review, American Economic Association, vol. 80(5), pages 1284-1286, December.
    49. Chetverikov, Denis, 2018. "Adaptive Tests Of Conditional Moment Inequalities," Econometric Theory, Cambridge University Press, vol. 34(1), pages 186-227, February.
    50. Toda, Alexis Akira, 2012. "The double power law in income distribution: Explanations and evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 84(1), pages 364-381.
    51. Stephen G. Donald & Yu-Chin Hsu, 2016. "Improving the Power of Tests of Stochastic Dominance," Econometric Reviews, Taylor & Francis Journals, vol. 35(4), pages 553-585, April.
    52. Joshua D. Angrist & Alan B. Keueger, 1991. "Does Compulsory School Attendance Affect Schooling and Earnings?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 979-1014.
    53. Cawley, John & Meyerhoefer, Chad, 2012. "The medical care costs of obesity: An instrumental variables approach," Journal of Health Economics, Elsevier, vol. 31(1), pages 219-230.
    54. Bruce E. Hansen, 2017. "Regression Kink With an Unknown Threshold," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(2), pages 228-240, April.
    55. Hong, Han & Li, Jessie, 2018. "The numerical delta method," Journal of Econometrics, Elsevier, vol. 206(2), pages 379-394.
    56. Shenglong Liu & Ismael Mourifié & Yuanyuan Wan, 2020. "Two-way exclusion restrictions in models with heterogeneous treatment effects," The Econometrics Journal, Royal Economic Society, vol. 23(3), pages 345-362.
    57. Guido W. Imbens & Donald B. Rubin, 1997. "Estimating Outcome Distributions for Compliers in Instrumental Variables Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 555-574.
    58. Abadie A., 2002. "Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 284-292, March.
    59. repec:adr:anecst:y:2008:i:91-92:p:08 is not listed on IDEAS
    60. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, November.
    61. Edward Vytlacil, 2002. "Independence, Monotonicity, and Latent Index Models: An Equivalence Result," Econometrica, Econometric Society, vol. 70(1), pages 331-341, January.
    62. Zhenting Sun & Brendan K. Beare, 2021. "Improved Nonparametric Bootstrap Tests of Lorenz Dominance," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 189-199, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhenting Sun & Kaspar Wuthrich, 2022. "Pairwise Valid Instruments," Papers 2203.08050, arXiv.org, revised Jan 2024.
    2. Hongyi Jiang & Zhenting Sun & Shiyun Hu, 2023. "A Nonparametric Test of $m$th-degree Inverse Stochastic Dominance," Papers 2306.12271, arXiv.org, revised Jul 2023.
    3. Huber, Martin & Wüthrich, Kaspar, 2017. "Evaluating local average and quantile treatment effects under endogeneity based on instruments: a review," FSES Working Papers 479, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    4. Blaise Melly und Kaspar W thrich, 2016. "Local quantile treatment effects," Diskussionsschriften dp1605, Universitaet Bern, Departement Volkswirtschaft.
    5. Yoichi Arai & Yu‐Chin Hsu & Toru Kitagawa & Ismael Mourifié & Yuanyuan Wan, 2022. "Testing identifying assumptions in fuzzy regression discontinuity designs," Quantitative Economics, Econometric Society, vol. 13(1), pages 1-28, January.
    6. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    7. Toru Kitagawa, 2013. "A bootstrap test for instrument validity in heterogeneous treatment effect models," CeMMAP working papers CWP53/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    8. Kédagni, Désiré, 2023. "Identifying treatment effects in the presence of confounded types," Journal of Econometrics, Elsevier, vol. 234(2), pages 479-511.
    9. Toru Kitagawa, 2013. "A bootstrap test for instrument validity in heterogeneous treatment effect models," CeMMAP working papers 53/13, Institute for Fiscal Studies.
    10. Andrews, Donald W.K. & Shi, Xiaoxia, 2017. "Inference based on many conditional moment inequalities," Journal of Econometrics, Elsevier, vol. 196(2), pages 275-287.
    11. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    12. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    13. Kaspar Wüthrich, 2020. "A Comparison of Two Quantile Models With Endogeneity," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(2), pages 443-456, April.
    14. Xintong Wang & Alfonso Flores-Lagunes, 2022. "Conscription and Military Service: Do They Result in Future Violent and Nonviolent Incarcerations and Recidivism?," Journal of Human Resources, University of Wisconsin Press, vol. 57(5), pages 1715-1757.
    15. Brendan K. Beare & Jackson D. Clarke, 2022. "Modified Wilcoxon-Mann-Whitney tests of stochastic dominance," Papers 2210.08892, arXiv.org.
    16. Chen, Le-Yu & Lee, Sokbae, 2019. "Breaking the curse of dimensionality in conditional moment inequalities for discrete choice models," Journal of Econometrics, Elsevier, vol. 210(2), pages 482-497.
    17. Evan K. Rose & Yotam Shem-Tov, 2021. "On Recoding Ordered Treatments as Binary Indicators," Papers 2111.12258, arXiv.org, revised Mar 2024.
    18. Thomas Carr & Toru Kitagawa, 2021. "Testing Instrument Validity with Covariates," Papers 2112.08092, arXiv.org, revised Sep 2023.
    19. Santiago Acerenza & Otávio Bartalotti & Désiré Kédagni, 2023. "Testing identifying assumptions in bivariate probit models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(3), pages 407-422, April.
    20. Beare, Brendan K. & Shi, Xiaoxia, 2019. "An improved bootstrap test of density ratio ordering," Econometrics and Statistics, Elsevier, vol. 10(C), pages 9-26.

    More about this item

    Keywords

    Instrument validity; Heterogeneous causal effects; Power improvement; Extended continuous mapping theorem; Extended delta method;
    All these keywords.

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:237:y:2023:i:2:s0304407623002397. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.