IDEAS home Printed from https://ideas.repec.org/a/eee/labeco/v42y2016icp76-86.html
   My bibliography  Save this article

A simple diagnostic to investigate instrument validity and heterogeneous effects when using a single instrument

Author

Listed:
  • Dieterle, Steven G.
  • Snell, Andy

Abstract

Many studies that use instrumental variables are based on a first stage linear in the instrument. Using only linear first stages may miss important information about effect heterogeneity and instrument validity. Analyzing fifteen studies using linear first stages, we find ten with significant nonlinearities. Six of these ten have statistically different second stage estimates. Additional analysis is necessary when results are sensitive to first stage choice. We provide a framework to reconcile these differences by determining those patterns of heterogeneity that are consistent with instrument validity. If these patterns violate economic reasoning, then the validity of the instrument is questioned.

Suggested Citation

  • Dieterle, Steven G. & Snell, Andy, 2016. "A simple diagnostic to investigate instrument validity and heterogeneous effects when using a single instrument," Labour Economics, Elsevier, vol. 42(C), pages 76-86.
    • Handle: RePEc:eee:labeco:v:42:y:2016:i:c:p:76-86
    DOI: 10.1016/j.labeco.2016.08.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0927537116300847
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.labeco.2016.08.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Shin-Yi Chou & Jin-Tan Liu & Michael Grossman & Ted Joyce, 2010. "Parental Education and Child Health: Evidence from a Natural Experiment in Taiwan," American Economic Journal: Applied Economics, American Economic Association, vol. 2(1), pages 33-61, January.
    2. Alberto Alesina & Ekaterina Zhuravskaya, 2011. "Segregation and the Quality of Government in a Cross Section of Countries," American Economic Review, American Economic Association, vol. 101(5), pages 1872-1911, August.
    3. Sascha O. Becker & Erik Hornung & Ludger Woessmann, 2011. "Education and Catch-Up in the Industrial Revolution," American Economic Journal: Macroeconomics, American Economic Association, vol. 3(3), pages 92-126, July.
    4. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    5. Sascha O. Becker & Ludger Woessmann, 2009. "Was Weber Wrong? A Human Capital Theory of Protestant Economic History," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(2), pages 531-596.
    6. Elizabeth Oltmans Ananat, 2011. "The Wrong Side(s) of the Tracks: The Causal Effects of Racial Segregation on Urban Poverty and Inequality," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 34-66, April.
    7. Daron Acemoglu & Simon Johnson & James A. Robinson, 2012. "The Colonial Origins of Comparative Development: An Empirical Investigation: Reply," American Economic Review, American Economic Association, vol. 102(6), pages 3077-3110, October.
    8. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    9. Molly Lipscomb & A. Mushfiq Mobarak & Tania Barham, 2013. "Development Effects of Electrification: Evidence from the Topographic Placement of Hydropower Plants in Brazil," American Economic Journal: Applied Economics, American Economic Association, vol. 5(2), pages 200-231, April.
    10. James H. Stock & Motohiro Yogo, 2002. "Testing for Weak Instruments in Linear IV Regression," NBER Technical Working Papers 0284, National Bureau of Economic Research, Inc.
    11. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    12. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    13. Whitney K. Newey, 2013. "Nonparametric Instrumental Variables Estimation," American Economic Review, American Economic Association, vol. 103(3), pages 550-556, May.
    14. Taryn Dinkelman, 2011. "The Effects of Rural Electrification on Employment: New Evidence from South Africa," American Economic Review, American Economic Association, vol. 101(7), pages 3078-3108, December.
    15. Eric Werker & Faisal Z. Ahmed & Charles Cohen, 2009. "How Is Foreign Aid Spent? Evidence from a Natural Experiment," American Economic Journal: Macroeconomics, American Economic Association, vol. 1(2), pages 225-244, July.
    16. David Y. Albouy, 2012. "The Colonial Origins of Comparative Development: An Empirical Investigation: Comment," American Economic Review, American Economic Association, vol. 102(6), pages 3059-3076, October.
    17. Katrine V. Løken & Magne Mogstad & Matthew Wiswall, 2012. "What Linear Estimators Miss: The Effects of Family Income on Child Outcomes," American Economic Journal: Applied Economics, American Economic Association, vol. 4(2), pages 1-35, April.
    18. Stock, James H & Wright, Jonathan H & Yogo, Motohiro, 2002. "A Survey of Weak Instruments and Weak Identification in Generalized Method of Moments," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(4), pages 518-529, October.
    19. Daron Acemoglu & Simon Johnson & James A. Robinson, 2001. "The Colonial Origins of Comparative Development: An Empirical Investigation," American Economic Review, American Economic Association, vol. 91(5), pages 1369-1401, December.
    20. Joshua D. Angrist & Kathryn Graddy & Guido W. Imbens, 2000. "The Interpretation of Instrumental Variables Estimators in Simultaneous Equations Models with an Application to the Demand for Fish," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 67(3), pages 499-527.
    21. Lance Lochner & Enrico Moretti, 2011. "Estimating and Testing Non-Linear Models Using Instrumental Variables," University of Western Ontario, Centre for Human Capital and Productivity (CHCP) Working Papers 20112, University of Western Ontario, Centre for Human Capital and Productivity (CHCP).
    22. Kristine M. Brown & Ron A. Laschever, 2012. "When They're Sixty-Four: Peer Effects and the Timing of Retirement," American Economic Journal: Applied Economics, American Economic Association, vol. 4(3), pages 90-115, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Antoine, Bertille & Lavergne, Pascal, 2023. "Identification-robust nonparametric inference in a linear IV model," Journal of Econometrics, Elsevier, vol. 235(1), pages 1-24.
    2. Apoorva Lal & Mac Lockhart & Yiqing Xu & Ziwen Zu, 2023. "How Much Should We Trust Instrumental Variable Estimates in Political Science? Practical Advice Based on Over 60 Replicated Studies," Papers 2303.11399, arXiv.org, revised Nov 2023.
    3. Leopoldo Fergusson & Juan Felipe Riaño & B.K. Song, 2020. "Media, Secret Ballot and Democratization in the US," Documentos de Trabajo 18252, The Latin American and Caribbean Economic Association (LACEA).
    4. Juan Felipe Riaño & Felipe Valencia Caicedo, 2024. "Collateral Damage: The Legacy of the Secret War in Laos," The Economic Journal, Royal Economic Society, vol. 134(661), pages 2101-2140.
    5. Gunes Asik & Ulas Karakoc & Mohamed Ali Marouani & Michelle Marshalian, 2019. "Productivity, structural change and skills dynamics: Evidence from a half century analysis in Tunisia and Turkey," Working Papers 20190001, UMR Développement et Sociétés, Université Paris 1 Panthéon-Sorbonne, Institut de Recherche pour le Développement.
    6. Juan A. Correa & Francisco Parro & Rafael Sánchez, 2023. "The Distributional Effect of Trade on the CEO Market," Economica, London School of Economics and Political Science, vol. 90(357), pages 111-139, January.
    7. Xiaolin Sun, 2022. "Estimation of Heterogeneous Treatment Effects Using a Conditional Moment Based Approach," Papers 2210.15829, arXiv.org, revised Oct 2024.
    8. Taylor Delaney, 2024. "2-Year or Not 2-Year? The Impact of Starting at Community College on Bachelor’s Degree Attainment," Research in Higher Education, Springer;Association for Institutional Research, vol. 65(8), pages 1717-1746, December.
    9. Seth Gershenson & Cassandra M. D. Hart & Joshua Hyman & Constance A. Lindsay & Nicholas W. Papageorge, 2022. "The Long-Run Impacts of Same-Race Teachers," American Economic Journal: Economic Policy, American Economic Association, vol. 14(4), pages 300-342, November.
    10. Xu, Ruonan, 2021. "On the instrument functional form with a binary endogenous explanatory variable," Economics Letters, Elsevier, vol. 206(C).
    11. Gunes Asik & Michelle Marshalian & Ulas Karakoc & Mohamed Ali Marouani, 2018. "Productivity, Structural Change and Skills Dynamics in Tunisia and Turkey," Working Papers hal-04000250, HAL.
    12. Jackie M. L. Chan & Chih‐Sheng Hsieh, 2022. "Cross‐border networks and knowledge spillovers for foreign entry," Economic Inquiry, Western Economic Association International, vol. 60(4), pages 1730-1756, October.
    13. Bertille Antoine & Xiaolin Sun, 2022. "Partially linear models with endogeneity: a conditional moment-based approach [Efficient estimation of models with conditional moment restrictions containing unknown functions]," The Econometrics Journal, Royal Economic Society, vol. 25(1), pages 256-275.
    14. Emmanuel Selorm Tsyawo, 2023. "Feasible IV regression without excluded instruments," The Econometrics Journal, Royal Economic Society, vol. 26(2), pages 235-256.
    15. Zhu, Maria, 2024. "New Findings on Racial Bias in Teachers' Evaluations of Student Achievement," IZA Discussion Papers 16815, Institute of Labor Economics (IZA).
    16. Bertille Antoine & Pascal Lavergne, 2020. "Identification-Robust Nonparametric Interference in a Linear IV Model," Discussion Papers dp20-03, Department of Economics, Simon Fraser University.
    17. Chih, Yao-Yu & Demir, Firat & Hu, Chenghao & Liu, Junyi & Shen, Hewei, 2023. "A spatial analysis of local corruption on foreign direct investment: Evidence from Chinese cities," European Journal of Political Economy, Elsevier, vol. 79(C).
    18. Zhao, Qiyi C., 2023. "Rethinking “Distance From”: Lessons from Wittenberg and Mainz," MPRA Paper 118414, University Library of Munich, Germany.
    19. Jiafeng Chen & Daniel L. Chen & Greg Lewis, 2020. "Mostly Harmless Machine Learning: Learning Optimal Instruments in Linear IV Models," Papers 2011.06158, arXiv.org, revised Jun 2021.
    20. Mika Haapanen & Petri Böckerman, 2017. "More educated, more mobile? Evidence from post-secondary education reform," Spatial Economic Analysis, Taylor & Francis Journals, vol. 12(1), pages 8-26, January.
    21. Pravin Nath & Neeraj Bharadwaj, 2020. "Chief marketing officer presence and firm performance: assessing conditions under which the presence of other C-level functional executives matters," Journal of the Academy of Marketing Science, Springer, vol. 48(4), pages 670-694, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sloczynski, Tymon, 2018. "A General Weighted Average Representation of the Ordinary and Two-Stage Least Squares Estimands," IZA Discussion Papers 11866, Institute of Labor Economics (IZA).
    2. Tymon S{l}oczy'nski, 2018. "Interpreting OLS Estimands When Treatment Effects Are Heterogeneous: Smaller Groups Get Larger Weights," Papers 1810.01576, arXiv.org, revised May 2020.
    3. Słoczyński, Tymon, 2012. "New Evidence on Linear Regression and Treatment Effect Heterogeneity," MPRA Paper 39524, University Library of Munich, Germany.
    4. Arthur Lewbel, 2019. "The Identification Zoo: Meanings of Identification in Econometrics," Journal of Economic Literature, American Economic Association, vol. 57(4), pages 835-903, December.
    5. Vladimir Atanasov & Bernard Black, 2021. "The Trouble with Instruments: The Need for Pretreatment Balance in Shock-Based Instrumental Variable Designs," Management Science, INFORMS, vol. 67(2), pages 1270-1302, February.
    6. Brendan Kline, 2016. "Identification of the Direction of a Causal Effect by Instrumental Variables," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(2), pages 176-184, April.
    7. Michael P. Murray, 2006. "Avoiding Invalid Instruments and Coping with Weak Instruments," Journal of Economic Perspectives, American Economic Association, vol. 20(4), pages 111-132, Fall.
    8. Martin Emil Jakobsen & Jonas Peters, 2022. "Distributional robustness of K-class estimators and the PULSE [The colonial origins of comparative development: An empirical investigation]," The Econometrics Journal, Royal Economic Society, vol. 25(2), pages 404-432.
    9. Manuel Denzer, 2019. "Estimating Causal Effects in Binary Response Models with Binary Endogenous Explanatory Variables - A Comparison of Possible Estimators," Working Papers 1916, Gutenberg School of Management and Economics, Johannes Gutenberg-Universität Mainz.
    10. Di Liberto, Adriana & Sideri, Marco, 2015. "Past dominations, current institutions and the Italian regional economic performance," European Journal of Political Economy, Elsevier, vol. 38(C), pages 12-41.
    11. Casey, Gregory & Klemp, Marc, 2016. "Instrumental Variables in the Long Run," MPRA Paper 68696, University Library of Munich, Germany.
    12. P. Dorian Owen, 2017. "Evaluating Ingenious Instruments for Fundamental Determinants of Long-Run Economic Growth and Development," Econometrics, MDPI, vol. 5(3), pages 1-33, September.
    13. Mario Fiorini & Katrien Stevens, 2021. "Scrutinizing the Monotonicity Assumption in IV and fuzzy RD designs," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(6), pages 1475-1526, December.
    14. Enrico Spolaore & Romain Wacziarg, 2013. "How Deep Are the Roots of Economic Development?," Journal of Economic Literature, American Economic Association, vol. 51(2), pages 325-369, June.
    15. Hyunseung Kang & Laura Peck & Luke Keele, 2018. "Inference for instrumental variables: a randomization inference approach," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(4), pages 1231-1254, October.
    16. Patrick Kline & Christopher R. Walters, 2019. "On Heckits, LATE, and Numerical Equivalence," Econometrica, Econometric Society, vol. 87(2), pages 677-696, March.
    17. Parente, Paulo M.D.C. & Santos Silva, J.M.C., 2012. "A cautionary note on tests of overidentifying restrictions," Economics Letters, Elsevier, vol. 115(2), pages 314-317.
    18. Baum-Snow, Nathaniel & Ferreira, Fernando, 2015. "Causal Inference in Urban and Regional Economics," Handbook of Regional and Urban Economics, in: Gilles Duranton & J. V. Henderson & William C. Strange (ed.), Handbook of Regional and Urban Economics, edition 1, volume 5, chapter 0, pages 3-68, Elsevier.
    19. DJEMAI, Elodie, 2018. "Roads and the spread of HIV in Africa," Journal of Health Economics, Elsevier, vol. 60(C), pages 118-141.
    20. Jinfeng Luo & Yi Wen, 2015. "Institutions Do Not Rule: Reassessing the Driving Forces of Economic Development," Working Papers 2015-1, Federal Reserve Bank of St. Louis.

    More about this item

    Keywords

    Instrumental variables; Heterogeneous treatment effects; Robustness check;
    All these keywords.

    JEL classification:

    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:labeco:v:42:y:2016:i:c:p:76-86. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/labeco .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.