IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1812.11598.html
   My bibliography  Save this paper

Salvaging Falsified Instrumental Variable Models

Author

Listed:
  • Matthew A. Masten
  • Alexandre Poirier

Abstract

What should researchers do when their baseline model is refuted? We provide four constructive answers. First, researchers can measure the extent of falsification. To do this, we consider continuous relaxations of the baseline assumptions of concern. We then define the falsification frontier: The smallest relaxations of the baseline model which are not refuted. This frontier provides a quantitative measure of the extent of falsification. Second, researchers can present the identified set for the parameter of interest under the assumption that the true model lies somewhere on this frontier. We call this the falsification adaptive set. This set generalizes the standard baseline estimand to account for possible falsification. Third, researchers can present the identified set for a specific point on this frontier. Finally, as a sensitivity analysis, researchers can present identified sets for points beyond the frontier. To illustrate these four ways of salvaging falsified models, we study overidentifying restrictions in two instrumental variable models: a homogeneous effects linear model, and heterogeneous effect models with either binary or continuous outcomes. In the linear model, we consider the classical overidentifying restrictions implied when multiple instruments are observed. We generalize these conditions by considering continuous relaxations of the classical exclusion restrictions. By sufficiently weakening the assumptions, a falsified baseline model becomes non-falsified. We obtain analogous results in the heterogeneous effect models, where we derive identified sets for marginal distributions of potential outcomes, falsification frontiers, and falsification adaptive sets under continuous relaxations of the instrument exogeneity assumptions. We illustrate our results in four different empirical applications.

Suggested Citation

  • Matthew A. Masten & Alexandre Poirier, 2018. "Salvaging Falsified Instrumental Variable Models," Papers 1812.11598, arXiv.org, revised Jan 2020.
  • Handle: RePEc:arx:papers:1812.11598
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1812.11598
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Manski, Charles F, 1990. "Nonparametric Bounds on Treatment Effects," American Economic Review, American Economic Association, vol. 80(2), pages 319-323, May.
    2. Magne Mogstad & Andres Santos & Alexander Torgovitsky, 2017. "Using Instrumental Variables for Inference about Policy Relevant Treatment Effects," NBER Working Papers 23568, National Bureau of Economic Research, Inc.
    3. Beresteanu, Arie & Molchanov, Ilya & Molinari, Francesca, 2012. "Partial identification using random set theory," Journal of Econometrics, Elsevier, vol. 166(1), pages 17-32.
    4. Donald W.K. Andrews & Soonwoo Kwon, 2019. "Inference in Moment Inequality Models That Is Robust to Spurious Precision under Model Misspecification," Cowles Foundation Discussion Papers 2184, Cowles Foundation for Research in Economics, Yale University, revised Oct 2019.
    5. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    6. Ivan A. Canay & Andres Santos & Azeem M. Shaikh, 2013. "On the Testability of Identification in Some Nonparametric Models With Endogeneity," Econometrica, Econometric Society, vol. 81(6), pages 2535-2559, November.
    7. Victor Chernozhukov & Sokbae Lee & Adam M. Rosen, 2013. "Intersection Bounds: Estimation and Inference," Econometrica, Econometric Society, vol. 81(2), pages 667-737, March.
    8. St'ephane Bonhomme & Martin Weidner, 2018. "Minimizing Sensitivity to Model Misspecification," Papers 1807.02161, arXiv.org, revised Oct 2021.
    9. Heckman, James J. & Urzúa, Sergio, 2010. "Comparing IV with structural models: What simple IV can and cannot identify," Journal of Econometrics, Elsevier, vol. 156(1), pages 27-37, May.
    10. Hansen, Lars Peter & Jagannathan, Ravi, 1991. "Implications of Security Market Data for Models of Dynamic Economies," Journal of Political Economy, University of Chicago Press, vol. 99(2), pages 225-262, April.
    11. Andrew Chesher & Adam M. Rosen, 2017. "Generalized Instrumental Variable Models," Econometrica, Econometric Society, vol. 85, pages 959-989, May.
    12. Charles F. Manski & Elie Tamer, 2002. "Inference on Regressions with Interval Data on a Regressor or Outcome," Econometrica, Econometric Society, vol. 70(2), pages 519-546, March.
    13. Angrist, Joshua & Krueger, Alan B, 1994. "Why Do World War II Veterans Earn More Than Nonveterans?," Journal of Labor Economics, University of Chicago Press, vol. 12(1), pages 74-97, January.
    14. Guildo W. Imbens, 2003. "Sensitivity to Exogeneity Assumptions in Program Evaluation," American Economic Review, American Economic Association, vol. 93(2), pages 126-132, May.
    15. Xavier D'Haultfoeuille & Christophe Gaillac & Arnaud Maurel, 2018. "Rationalizing Rational Expectations? Tests and Deviations," NBER Working Papers 25274, National Bureau of Economic Research, Inc.
    16. Christian Bontemps & Thierry Magnac & Eric Maurin, 2012. "Set Identified Linear Models," Econometrica, Econometric Society, vol. 80(3), pages 1129-1155, May.
    17. Matthew A. Masten & Alexander Torgovitsky, 2016. "Identification of Instrumental Variable Correlated Random Coefficients Models," The Review of Economics and Statistics, MIT Press, vol. 98(5), pages 1001-1005, December.
    18. Sonja A. Swanson & Miguel A. Hernán & Matthew Miller & James M. Robins & Thomas S. Richardson, 2018. "Partial Identification of the Average Treatment Effect Using Instrumental Variables: Review of Methods for Binary Instruments, Treatments, and Outcomes," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 933-947, April.
    19. Aart Kraay, 2012. "Instrumental variables regressions with uncertain exclusion restrictions: a Bayesian approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(1), pages 108-128, January.
    20. Guggenberger, Patrik, 2012. "A note on the (in)consistency of the test of overidentifying restrictions and the concepts of true and pseudo-true parameters," Economics Letters, Elsevier, vol. 117(3), pages 901-904.
    21. Huber, Martin, 2014. "Sensitivity checks for the local average treatment effect," Economics Letters, Elsevier, vol. 123(2), pages 220-223.
    22. Richard Blundell & Amanda Gosling & Hidehiko Ichimura & Costas Meghir, 2007. "Changes in the Distribution of Male and Female Wages Accounting for Employment Composition Using Bounds," Econometrica, Econometric Society, vol. 75(2), pages 323-363, March.
    23. Richard Ashley & Christopher Parmeter, 2015. "Sensitivity analysis for inference in 2SLS/GMM estimation with possibly flawed instruments," Empirical Economics, Springer, vol. 49(4), pages 1153-1171, December.
    24. Gilles Duranton & Peter M. Morrow & Matthew A. Turner, 2014. "Roads and Trade: Evidence from the US," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 681-724.
    25. Aviv Nevo & Adam M. Rosen, 2012. "Identification With Imperfect Instruments," The Review of Economics and Statistics, MIT Press, vol. 94(3), pages 659-671, August.
    26. Kreider, Brent & Pepper, John V., 2007. "Disability and Employment: Reevaluating the Evidence in Light of Reporting Errors," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 432-441, June.
    27. Sundaram,Rangarajan K., 1996. "A First Course in Optimization Theory," Cambridge Books, Cambridge University Press, number 9780521497190, September.
    28. Kadane, Joseph B & Anderson, T W, 1977. "A Comment on the Test of Overidentifying Restrictions," Econometrica, Econometric Society, vol. 45(4), pages 1027-1031, May.
    29. Joseph G. Altonji & Todd E. Elder & Christopher R. Taber, 2005. "An Evaluation of Instrumental Variable Strategies for Estimating the Effects of Catholic Schooling," Journal of Human Resources, University of Wisconsin Press, vol. 40(4), pages 791-821.
    30. Gundersen, Craig & Kreider, Brent & Pepper, John, 2012. "The impact of the National School Lunch Program on child health: A nonparametric bounds analysis," Journal of Econometrics, Elsevier, vol. 166(1), pages 79-91.
    31. Carlos A. Flores & Xuan Chen, 2018. "Average Treatment Effect Bounds with an Instrumental Variable: Theory and Practice," Springer Books, Springer, number 978-981-13-2017-0, December.
    32. Machado, Cecilia & Shaikh, Azeem M. & Vytlacil, Edward J., 2019. "Instrumental variables and the sign of the average treatment effect," Journal of Econometrics, Elsevier, vol. 212(2), pages 522-555.
    33. Brent Kreider & John V. Pepper & Craig Gundersen & Dean Jolliffe, 2012. "Identifying the Effects of SNAP (Food Stamps) on Child Health Outcomes When Participation Is Endogenous and Misreported," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(499), pages 958-975, September.
    34. Nathan Nunn & Leonard Wantchekon, 2011. "The Slave Trade and the Origins of Mistrust in Africa," American Economic Review, American Economic Association, vol. 101(7), pages 3221-3252, December.
    35. Bugni, Federico A. & Canay, Ivan A. & Shi, Xiaoxia, 2015. "Specification tests for partially identified models defined by moment inequalities," Journal of Econometrics, Elsevier, vol. 185(1), pages 259-282.
    36. Parente, Paulo M.D.C. & Santos Silva, J.M.C., 2012. "A cautionary note on tests of overidentifying restrictions," Economics Letters, Elsevier, vol. 115(2), pages 314-317.
    37. Matzkin, Rosa L., 2007. "Nonparametric identification," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 73, Elsevier.
    38. Matthew A. Masten & Alexandre Poirier, 2020. "Inference on breakdown frontiers," Quantitative Economics, Econometric Society, vol. 11(1), pages 41-111, January.
    39. Ludvigson, Sydney C., 2013. "Advances in Consumption-Based Asset Pricing: Empirical Tests," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 799-906, Elsevier.
    40. Charles F. Manski & John V. Pepper, 2000. "Monotone Instrumental Variables, with an Application to the Returns to Schooling," Econometrica, Econometric Society, vol. 68(4), pages 997-1012, July.
    41. Richard Ashley, 2009. "Assessing the credibility of instrumental variables inference with imperfect instruments via sensitivity analysis," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(2), pages 325-337, March.
    42. V. Joseph Hotz & Charles H. Mullin & Seth G. Sanders, 1997. "Bounding Causal Effects Using Data from a Contaminated Natural Experiment: Analysing the Effects of Teenage Childbearing," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 575-603.
    43. Magne Mogstad & Andres Santos & Alexander Torgovitsky, 2018. "Using Instrumental Variables for Inference About Policy Relevant Treatment Parameters," Econometrica, Econometric Society, vol. 86(5), pages 1589-1619, September.
    44. K. Newey, Whitney, 1985. "Generalized method of moments specification testing," Journal of Econometrics, Elsevier, vol. 29(3), pages 229-256, September.
    45. Charles F. Manski & John V. Pepper, 2018. "How Do Right-to-Carry Laws Affect Crime Rates? Coping with Ambiguity Using Bounded-Variation Assumptions," The Review of Economics and Statistics, MIT Press, vol. 100(2), pages 232-244, May.
    46. Matthew A. Masten & Alexandre Poirier, 2021. "Salvaging Falsified Instrumental Variable Models," Econometrica, Econometric Society, vol. 89(3), pages 1449-1469, May.
    47. Victor Chernozhukov & Han Hong & Elie Tamer, 2007. "Estimation and Confidence Regions for Parameter Sets in Econometric Models," Econometrica, Econometric Society, vol. 75(5), pages 1243-1284, September.
    48. Anonymous, 1955. "International Monetary Fund," International Organization, Cambridge University Press, vol. 9(1), pages 172-174, February.
    49. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2017. "Measuring the Sensitivity of Parameter Estimates to Estimation Moments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1553-1592.
    50. repec:wly:soecon:v:82:4:y:2016:p:1106-1122 is not listed on IDEAS
    51. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    52. Small, Dylan S., 2007. "Sensitivity Analysis for Instrumental Variables Regression With Overidentifying Restrictions," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1049-1058, September.
    53. Hansen, Lars Peter & Heaton, John & Luttmer, Erzo G J, 1995. "Econometric Evaluation of Asset Pricing Models," The Review of Financial Studies, Society for Financial Studies, vol. 8(2), pages 237-274.
    54. Sundaram,Rangarajan K., 1996. "A First Course in Optimization Theory," Cambridge Books, Cambridge University Press, number 9780521497701, September.
    55. Alexander Torgovitsky, 2019. "Partial identification by extending subdistributions," Quantitative Economics, Econometric Society, vol. 10(1), pages 105-144, January.
    56. Anonymous, 1955. "International Monetary Fund," International Organization, Cambridge University Press, vol. 9(3), pages 431-432, August.
    57. Trevor S. Breusch, 1986. "Hypothesis Testing in Unidentified Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(4), pages 635-651.
    58. Ta-Chung Liu, 1955. "A Simple Forecasting Model for the U.S. Economy," IMF Staff Papers, Palgrave Macmillan, vol. 4(3), pages 434-466, August.
    59. Charalambos D. Aliprantis & Kim C. Border, 2006. "Infinite Dimensional Analysis," Springer Books, Springer, edition 0, number 978-3-540-29587-7, December.
    60. Zheng Fang & Andres Santos, 2019. "Inference on Directionally Differentiable Functions," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(1), pages 377-412.
    61. Toru Kitagawa, 2009. "Identification region of the potential outcome distributions under instrument independence," CeMMAP working papers CWP30/09, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    62. Anonymous, 1955. "International Monetary Fund," International Organization, Cambridge University Press, vol. 9(2), pages 277-278, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lixiong Li & Désiré Kédagni & Ismaël Mourifié, 2024. "Discordant relaxations of misspecified models," Quantitative Economics, Econometric Society, vol. 15(2), pages 331-379, May.
    2. Moyu Liao, 2020. "Estimating Economic Models with Testable Assumptions: Theory and Applications," Papers 2002.10415, arXiv.org, revised Mar 2022.
    3. Marcoux, Mathieu & Russell, Thomas M. & Wan, Yuanyuan, 2024. "A simple specification test for models with many conditional moment inequalities," Journal of Econometrics, Elsevier, vol. 242(1).
    4. Jakob Madsen & Holger Strulik, 2023. "Testing unified growth theory: Technological progress and the child quantity‐quality tradeoff," Quantitative Economics, Econometric Society, vol. 14(1), pages 235-275, January.
    5. Xavier D'Haultfoeuille & Christophe Gaillac & Arnaud Maurel, 2021. "Rationalizing rational expectations: Characterizations and tests," Quantitative Economics, Econometric Society, vol. 12(3), pages 817-842, July.
    6. Nicolas Apfel & Julia Hatamyar & Martin Huber & Jannis Kueck, 2024. "Learning control variables and instruments for causal analysis in observational data," Papers 2407.04448, arXiv.org.
    7. Francesca Molinari, 2020. "Microeconometrics with Partial Identi?cation," CeMMAP working papers CWP15/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    8. Nicolas Apfel & Frank Windmeijer, 2022. "The Falsification Adaptive Set in Linear Models with Instrumental Variables that Violate the Exclusion or Conditional Exogeneity Restriction," Papers 2212.04814, arXiv.org, revised Apr 2024.
    9. Kyunghoon Ban & Désiré Kédagni, 2022. "Nonparametric bounds on treatment effects with imperfect instruments [Instrument-based estimation with binarized treatments: Issues and tests for the exclusion restriction]," The Econometrics Journal, Royal Economic Society, vol. 25(2), pages 477-493.
    10. Roy Allen & John Rehbeck, 2020. "Counterfactual and Welfare Analysis with an Approximate Model," Papers 2009.03379, arXiv.org.
    11. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    12. Francesca Molinari, 2019. "Econometrics with Partial Identification," CeMMAP working papers CWP25/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    13. Matthew A. Masten & Alexandre Poirier, 2021. "Salvaging Falsified Instrumental Variable Models," Econometrica, Econometric Society, vol. 89(3), pages 1449-1469, May.
    14. Stéphane Bonhomme & Martin Weidner, 2022. "Minimizing sensitivity to model misspecification," Quantitative Economics, Econometric Society, vol. 13(3), pages 907-954, July.
    15. Tushar Bharati & Adnan M. S. Fakir, 2022. "Health Costs of a “Healthy Democracy”: The Impact of Peaceful Political Protests on Healthcare Utilization," Economics Discussion / Working Papers 22-15, The University of Western Australia, Department of Economics.
    16. Han, Sukjin & Yang, Shenshen, 2024. "A computational approach to identification of treatment effects for policy evaluation," Journal of Econometrics, Elsevier, vol. 240(1).
    17. Charles F. Manski, 2021. "Econometrics for Decision Making: Building Foundations Sketched by Haavelmo and Wald," Econometrica, Econometric Society, vol. 89(6), pages 2827-2853, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francesca Molinari, 2020. "Microeconometrics with Partial Identi?cation," CeMMAP working papers CWP15/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    2. Francesca Molinari, 2019. "Econometrics with Partial Identification," CeMMAP working papers CWP25/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    3. Lina Zhang & David T. Frazier & D. S. Poskitt & Xueyan Zhao, 2020. "Decomposing Identification Gains and Evaluating Instrument Identification Power for Partially Identified Average Treatment Effects," Papers 2009.02642, arXiv.org, revised Sep 2022.
    4. Ivan A. Canay & Azeem M. Shaikh, 2016. "Practical and theoretical advances in inference for partially identified models," CeMMAP working papers CWP05/16, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    5. Tsunao Okumura & Emiko Usui, 2014. "Concave‐monotone treatment response and monotone treatment selection: With an application to the returns to schooling," Quantitative Economics, Econometric Society, vol. 5, pages 175-194, March.
    6. Wooyoung Kim & Koohyun Kwon & Soonwoo Kwon & Sokbae Lee, 2018. "The identification power of smoothness assumptions in models with counterfactual outcomes," Quantitative Economics, Econometric Society, vol. 9(2), pages 617-642, July.
    7. Magnac, Thierry, 2013. "Identification partielle : méthodes et conséquences pour les applications empiriques," L'Actualité Economique, Société Canadienne de Science Economique, vol. 89(4), pages 233-258, Décembre.
    8. Claudia Noack, 2021. "Sensitivity of LATE Estimates to Violations of the Monotonicity Assumption," Papers 2106.06421, arXiv.org.
    9. Gu, Jiaying & Russell, Thomas M., 2023. "Partial identification in nonseparable binary response models with endogenous regressors," Journal of Econometrics, Elsevier, vol. 235(2), pages 528-562.
    10. Huber, Martin & Wüthrich, Kaspar, 2017. "Evaluating local average and quantile treatment effects under endogeneity based on instruments: a review," FSES Working Papers 479, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    11. Han, Sukjin & Yang, Shenshen, 2024. "A computational approach to identification of treatment effects for policy evaluation," Journal of Econometrics, Elsevier, vol. 240(1).
    12. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    13. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    14. Semenova, Vira, 2023. "Debiased machine learning of set-identified linear models," Journal of Econometrics, Elsevier, vol. 235(2), pages 1725-1746.
    15. Chen, Xuan & Flores, Carlos A. & Flores-Lagunes, Alfonso, 2015. "Going Beyond LATE: Bounding Average Treatment Effects of Job Corps Training," IZA Discussion Papers 9511, Institute of Labor Economics (IZA).
    16. Arthur Lewbel, 2019. "The Identification Zoo: Meanings of Identification in Econometrics," Journal of Economic Literature, American Economic Association, vol. 57(4), pages 835-903, December.
    17. Kate Ho & Adam M. Rosen, 2015. "Partial Identification in Applied Research: Benefits and Challenges," NBER Working Papers 21641, National Bureau of Economic Research, Inc.
    18. Kyunghoon Ban & Désiré Kédagni, 2022. "Nonparametric bounds on treatment effects with imperfect instruments [Instrument-based estimation with binarized treatments: Issues and tests for the exclusion restriction]," The Econometrics Journal, Royal Economic Society, vol. 25(2), pages 477-493.
    19. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    20. Kiviet, Jan F., 2020. "Testing the impossible: Identifying exclusion restrictions," Journal of Econometrics, Elsevier, vol. 218(2), pages 294-316.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1812.11598. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.