IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp9428.html
   My bibliography  Save this paper

Endogeneity and Non-Response Bias in Treatment Evaluation: Nonparametric Identification of Causal Effects by Instruments

Author

Listed:
  • Fricke, Hans

    (Amazon)

  • Frölich, Markus

    (University of Mannheim)

  • Huber, Martin

    (University of Fribourg)

  • Lechner, Michael

    (University of St. Gallen)

Abstract

This paper proposes a nonparametric method for evaluating treatment effects in the presence of both treatment endogeneity and attrition/non-response bias, using two instrumental variables. Making use of a discrete instrument for the treatment and a continuous instrument for non-response/attrition, we identify the average treatment effect on compliers as well as the total population and suggest non- and semiparametric estimators. We apply the latter to a randomized experiment at a Swiss University in order to estimate the effect of gym training on students' self-assessed health. The treatment (gym training) and attrition are instrumented by randomized cash incentives paid out conditional on gym visits and by a cash lottery for participating in the follow-up survey, respectively.

Suggested Citation

  • Fricke, Hans & Frölich, Markus & Huber, Martin & Lechner, Michael, 2015. "Endogeneity and Non-Response Bias in Treatment Evaluation: Nonparametric Identification of Causal Effects by Instruments," IZA Discussion Papers 9428, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp9428
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp9428.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. James J. Heckman, 1976. "The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 4, pages 475-492, National Bureau of Economic Research, Inc.
    2. Sokbae Lee & Bernard Salanié, 2018. "Identifying Effects of Multivalued Treatments," Econometrica, Econometric Society, vol. 86(6), pages 1939-1963, November.
    3. John Fitzgerald & Peter Gottschalk & Robert Moffitt, 1998. "An Analysis of Sample Attrition in Panel Data: The Michigan Panel Study of Income Dynamics," Journal of Human Resources, University of Wisconsin Press, vol. 33(2), pages 251-299.
    4. Luc Behaghel & Bruno Crépon & Marc Gurgand & Thomas Le Barbanchon, 2015. "Please Call Again: Correcting Nonresponse Bias in Treatment Effect Models," The Review of Economics and Statistics, MIT Press, vol. 97(5), pages 1070-1080, December.
    5. Ismael Mourifié & Yuanyuan Wan, 2017. "Testing Local Average Treatment Effect Assumptions," The Review of Economics and Statistics, MIT Press, vol. 99(2), pages 305-313, May.
    6. Abadie, Alberto, 2003. "Semiparametric instrumental variable estimation of treatment response models," Journal of Econometrics, Elsevier, vol. 113(2), pages 231-263, April.
    7. Semykina, Anastasia & Wooldridge, Jeffrey M., 2010. "Estimating panel data models in the presence of endogeneity and selection," Journal of Econometrics, Elsevier, vol. 157(2), pages 375-380, August.
    8. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    9. Tan, Zhiqiang, 2006. "Regression and Weighting Methods for Causal Inference Using Instrumental Variables," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1607-1618, December.
    10. Martin Huber, 2012. "Identification of Average Treatment Effects in Social Experiments Under Alternative Forms of Attrition," Journal of Educational and Behavioral Statistics, , vol. 37(3), pages 443-474, June.
    11. Schwiebert, Jörg, 2012. "Semiparametric Estimation of a Sample Selection Model in the Presence of Endogeneity," Hannover Economic Papers (HEP) dp-504, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    12. Brian Jacob & Brian McCall & Kevin Stange, 2018. "College as Country Club: Do Colleges Cater to Students’ Preferences for Consumption?," Journal of Labor Economics, University of Chicago Press, vol. 36(2), pages 309-348.
    13. Sant’Anna, Pedro H.C. & Song, Xiaojun, 2019. "Specification tests for the propensity score," Journal of Econometrics, Elsevier, vol. 210(2), pages 379-404.
    14. Martin Huber & Giovanni Mellace, 2015. "Testing Instrument Validity for LATE Identification Based on Inequality Moment Constraints," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 398-411, May.
    15. Fricke, Hans & Lechner, Michael & Steinmayr, Andreas, 2018. "The effects of incentives to exercise on student performance in college," Economics of Education Review, Elsevier, vol. 66(C), pages 14-39.
    16. Lisa Farrell & Michael A. Shields, 2002. "Investigating the economic and demographic determinants of sporting participation in England," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 165(2), pages 335-348, June.
    17. repec:mpr:mprres:2664 is not listed on IDEAS
    18. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    19. Martin Huber, 2014. "Treatment Evaluation in the Presence of Sample Selection," Econometric Reviews, Taylor & Francis Journals, vol. 33(8), pages 869-905, November.
    20. Paolo Frumento & Fabrizia Mealli & Barbara Pacini & Donald B. Rubin, 2012. "Evaluating the Effect of Training on Wages in the Presence of Noncompliance, Nonemployment, and Missing Outcome Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 450-466, June.
    21. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    22. JAMES G. MacKINNON, 2006. "Bootstrap Methods in Econometrics," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages 2-18, September.
    23. Yingying DONG & Ying-Ying LEE & Michael GOU, 2019. "Regression Discontinuity Designs with a Continuous Treatment," Discussion papers 19058, Research Institute of Economy, Trade and Industry (RIETI).
    24. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    25. Whitney K. Newey, 2004. "Efficient Semiparametric Estimation via Moment Restrictions," Econometrica, Econometric Society, vol. 72(6), pages 1877-1897, November.
    26. Gary Charness & Uri Gneezy, 2009. "Incentives to Exercise," Econometrica, Econometric Society, vol. 77(3), pages 909-931, May.
    27. Schwiebert, Jörg, 2012. "Semiparametric Estimation of a Binary Choice Model with Sample Selection," Hannover Economic Papers (HEP) dp-505, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    28. Abowd J.M. & Crepon B. & Kramarz F., 2001. "Moment Estimation With Attrition: An Application to Economic Models," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1223-1231, December.
    29. Frolich, Markus, 2007. "Nonparametric IV estimation of local average treatment effects with covariates," Journal of Econometrics, Elsevier, vol. 139(1), pages 35-75, July.
    30. Joshua Angrist & Ivan Fernandez-Val, 2010. "ExtrapoLATE-ing: External Validity and Overidentification in the LATE Framework," NBER Working Papers 16566, National Bureau of Economic Research, Inc.
    31. Zhang, Junni L. & Rubin, Donald B. & Mealli, Fabrizia, 2009. "Likelihood-Based Analysis of Causal Effects of Job-Training Programs Using Principal Stratification," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 166-176.
    32. Markus Frölich & Martin Huber, 2014. "Treatment Evaluation With Multiple Outcome Periods Under Endogeneity and Attrition," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1697-1711, December.
    33. Aronow, Peter M. & Carnegie, Allison, 2013. "Beyond LATE: Estimation of the Average Treatment Effect with an Instrumental Variable," Political Analysis, Cambridge University Press, vol. 21(4), pages 492-506.
    34. Pforr, Klaus & Blohm, Michael & Blom, Annelies G. & Erdel, Barbara & Felderer, Barbara & Fräßdorf, Mathis & Hajek, Kristin & Helmschrott, Susanne & Kleinert, Corinna & Koch, Achim & Krieger, Ulrich & , 2015. "Are Incentive Effects on Response Rates and Nonresponse Bias in Large-scale, Face-to-face Surveys Generalizable to Germany? Evidence from Ten Experiments," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 79(3), pages 740-768.
    35. Yingying Dong, 2019. "Regression Discontinuity Designs With Sample Selection," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(1), pages 171-186, January.
    36. Machado, Cecilia & Shaikh, Azeem M. & Vytlacil, Edward J., 2019. "Instrumental variables and the sign of the average treatment effect," Journal of Econometrics, Elsevier, vol. 212(2), pages 522-555.
    37. Toru Kitagawa, 2015. "A Test for Instrument Validity," Econometrica, Econometric Society, vol. 83(5), pages 2043-2063, September.
    38. Hayfield, Tristen & Racine, Jeffrey S., 2008. "Nonparametric Econometrics: The np Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i05).
    39. repec:hal:pseose:halshs-01245539 is not listed on IDEAS
    40. Hausman, Jerry A & Wise, David A, 1979. "Attrition Bias in Experimental and Panel Data: The Gary Income Maintenance Experiment," Econometrica, Econometric Society, vol. 47(2), pages 455-473, March.
    41. Xuan Chen & Carlos A. Flores, 2015. "Bounds on Treatment Effects in the Presence of Sample Selection and Noncompliance: The Wage Effects of Job Corps," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(4), pages 523-540, October.
    42. Imai, Kosuke, 2008. "Sharp bounds on the causal effects in randomized experiments with "truncation-by-death"," Statistics & Probability Letters, Elsevier, vol. 78(2), pages 144-149, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lechner, Michael & Fricke, Hans & Steinmayr, Andreas, 2017. "The Effect of Physical Activity on Student Performance in College: An Experimental Evaluation," CEPR Discussion Papers 12052, C.E.P.R. Discussion Papers.
    2. Vitor Possebom, 2019. "Sharp Bounds for the Marginal Treatment Effect with Sample Selection," Papers 1904.08522, arXiv.org.
    3. Martin Huber & Anna Solovyeva, 2020. "Direct and Indirect Effects under Sample Selection and Outcome Attrition," Econometrics, MDPI, vol. 8(4), pages 1-25, December.
    4. Sokbae Lee & Bernard Salanié, 2018. "Identifying Effects of Multivalued Treatments," Econometrica, Econometric Society, vol. 86(6), pages 1939-1963, November.
    5. Lukáš Lafférs & Bernhard Schmidpeter, 2021. "Early child development and parents' labor supply," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(2), pages 190-208, March.
    6. Martin Huber, 2021. "On the Plausibility of the Latent Ignorability Assumption," Econometrics, MDPI, vol. 9(4), pages 1-6, December.
    7. Heng Chen & Geoffrey Dunbar & Q. Rallye Shen, 2020. "The Mode is the Message: Using Predata as Exclusion Restrictions to Evaluate Survey Design," Advances in Econometrics, in: Essays in Honor of Cheng Hsiao, volume 41, pages 341-357, Emerald Group Publishing Limited.
    8. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    9. Le-Yu Chen & Yu-Min Yen, 2021. "Estimations of the Local Conditional Tail Average Treatment Effect," Papers 2109.08793, arXiv.org, revised May 2024.
    10. Huber, Martin & Wüthrich, Kaspar, 2017. "Evaluating local average and quantile treatment effects under endogeneity based on instruments: a review," FSES Working Papers 479, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    11. Fricke, Hans & Lechner, Michael & Steinmayr, Andreas, 2018. "The effects of incentives to exercise on student performance in college," Economics of Education Review, Elsevier, vol. 66(C), pages 14-39.
    12. Kédagni, Désiré, 2023. "Identifying treatment effects in the presence of confounded types," Journal of Econometrics, Elsevier, vol. 234(2), pages 479-511.
    13. Possebom, Vitor, 2018. "Sharp bounds on the MTE with sample selection," MPRA Paper 89785, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Markus Frölich & Martin Huber, 2014. "Treatment Evaluation With Multiple Outcome Periods Under Endogeneity and Attrition," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1697-1711, December.
    2. Huber, Martin & Wüthrich, Kaspar, 2017. "Evaluating local average and quantile treatment effects under endogeneity based on instruments: a review," FSES Working Papers 479, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    3. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    4. Martin Huber & Anna Solovyeva, 2020. "Direct and Indirect Effects under Sample Selection and Outcome Attrition," Econometrics, MDPI, vol. 8(4), pages 1-25, December.
    5. Markus Frölich & Martin Huber, 2017. "Direct and indirect treatment effects–causal chains and mediation analysis with instrumental variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1645-1666, November.
    6. Possebom, Vitor, 2018. "Sharp bounds on the MTE with sample selection," MPRA Paper 89785, University Library of Munich, Germany.
    7. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    8. Simon Calmar Andersen & Louise Beuchert & Phillip Heiler & Helena Skyt Nielsen, 2023. "A Guide to Impact Evaluation under Sample Selection and Missing Data: Teacher's Aides and Adolescent Mental Health," Papers 2308.04963, arXiv.org.
    9. Tymon Sloczynski & S. Derya Uysal & Jeffrey M. Wooldridge & Derya Uysal, 2022. "Abadie's Kappa and Weighting Estimators of the Local Average Treatment Effect," CESifo Working Paper Series 9715, CESifo.
    10. Gayani Rathnayake & Akanksha Negi & Otavio Bartalotti & Xueyan Zhao, 2024. "Difference-in-Differences with Sample Selection," Papers 2411.09221, arXiv.org, revised Dec 2024.
    11. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    12. Huber, Martin & Meier, Jonas & Wallimann, Hannes, 2022. "Business analytics meets artificial intelligence: Assessing the demand effects of discounts on Swiss train tickets," Transportation Research Part B: Methodological, Elsevier, vol. 163(C), pages 22-39.
    13. Heng Chen & Geoffrey Dunbar & Q. Rallye Shen, 2020. "The Mode is the Message: Using Predata as Exclusion Restrictions to Evaluate Survey Design," Advances in Econometrics, in: Essays in Honor of Cheng Hsiao, volume 41, pages 341-357, Emerald Group Publishing Limited.
    14. Kédagni, Désiré, 2023. "Identifying treatment effects in the presence of confounded types," Journal of Econometrics, Elsevier, vol. 234(2), pages 479-511.
    15. Michela Bia & German Blanco & Marie Valentova, 2021. "The Causal Impact of Taking Parental Leave on Wages: Evidence from 2005 to 2015," LISER Working Paper Series 2021-08, Luxembourg Institute of Socio-Economic Research (LISER).
    16. Martin Huber, 2014. "Treatment Evaluation in the Presence of Sample Selection," Econometric Reviews, Taylor & Francis Journals, vol. 33(8), pages 869-905, November.
    17. Chen, Xuan & Flores, Carlos A. & Flores-Lagunes, Alfonso, 2015. "Going Beyond LATE: Bounding Average Treatment Effects of Job Corps Training," IZA Discussion Papers 9511, Institute of Labor Economics (IZA).
    18. Ghanem, Dalia & Hirshleifer, Sarojini & Kédagni, Désiré & Ortiz-Becerra, Karen, 2024. "Correcting attrition bias using changes-in-changes," Journal of Econometrics, Elsevier, vol. 241(2).
    19. Zhichao Jiang & Shu Yang & Peng Ding, 2022. "Multiply robust estimation of causal effects under principal ignorability," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(4), pages 1423-1445, September.
    20. repec:hhs:ifauwp:2025_012 is not listed on IDEAS
    21. Guber, Raphael, 2018. "Instrument Validity Tests with Causal Trees: With an Application to the Same-sex Instrument," MEA discussion paper series 201805, Munich Center for the Economics of Aging (MEA) at the Max Planck Institute for Social Law and Social Policy.

    More about this item

    Keywords

    instrument; weighting; local average treatment effect; attrition; endogeneity; experiment;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C24 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Truncated and Censored Models; Switching Regression Models; Threshold Regression Models
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp9428. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.