IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/67-19.html
   My bibliography  Save this paper

Honest inference for discrete outcomes

Author

Listed:
  • Walter Beckert

    (Institute for Fiscal Studies and Birkbeck, University of London)

  • Daniel Kaliski

    (Institute for Fiscal Studies and Birkbeck)

Abstract

We investigate the consequences of discreteness in the assignment variable in regression-discontinuity designs for cases where the outcome variable is itself discrete. We find that constructing confidence intervals that have the correct level of coverage in these cases is sensitive to the assumed distribution of unobserved heterogeneity. Since local linear estimators are improperly centered, a smaller variance for unobserved heterogeneity in discrete outcomes actually requires larger confidence intervals, since standard confidence intervals become narrower around a biased estimator, leading to a higher-than-nominal false positive rate. We provide a method for mapping structural assumptions regarding the distribution and variance of unobserved heterogeneity to the construction of "honest" confidence intervals that have the correct level of coverage. An application to retirement behavior reveals that the spike in retirement at age 62 in the United States can be reconciled with a wider range of values for the variance of unobserved heterogeneity (due to reservation wages or offers) than the spike at age 65.

Suggested Citation

  • Walter Beckert & Daniel Kaliski, 2019. "Honest inference for discrete outcomes," CeMMAP working papers CWP67/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    • Handle: RePEc:ifs:cemmap:67/19
    as

    Download full text from publisher

    File URL: https://www.ifs.org.uk/uploads/CW6719-Honest-inference-for-discrete-outcomes.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Keane, Michael P., 2010. "Structural vs. atheoretic approaches to econometrics," Journal of Econometrics, Elsevier, vol. 156(1), pages 3-20, May.
    2. Timothy B. Armstrong & Michal Kolesár, 2018. "Optimal Inference in a Class of Regression Models," Econometrica, Econometric Society, vol. 86(2), pages 655-683, March.
    3. Kenneth I. Wolpin & Mark R. Rosenzweig, 2000. "Natural "Natural Experiments" in Economics," Journal of Economic Literature, American Economic Association, vol. 38(4), pages 827-874, December.
    4. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    5. Douglas Almond & Joseph J. Doyle & Amanda E. Kowalski & Heidi Williams, 2010. "Estimating Marginal Returns to Medical Care: Evidence from At-risk Newborns," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(2), pages 591-634.
    6. David Card & Carlos Dobkin & Nicole Maestas, 2009. "Does Medicare Save Lives?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(2), pages 597-636.
    7. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "On the Informativeness of Descriptive Statistics for Structural Estimates," Econometrica, Econometric Society, vol. 88(6), pages 2231-2258, November.
    8. Hitoshi Shigeoka, 2014. "The Effect of Patient Cost Sharing on Utilization, Health, and Risk Protection," American Economic Review, American Economic Association, vol. 104(7), pages 2152-2184, July.
    9. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, April.
    10. Xu, Ke-Li, 2017. "Regression discontinuity with categorical outcomes," Journal of Econometrics, Elsevier, vol. 201(1), pages 1-18.
    11. Heckman, James J & Honore, Bo E, 1990. "The Empirical Content of the Roy Model," Econometrica, Econometric Society, vol. 58(5), pages 1121-1149, September.
    12. Gustman, Alan L. & Steinmeier, Thomas L., 2005. "The social security early entitlement age in a structural model of retirement and wealth," Journal of Public Economics, Elsevier, vol. 89(2-3), pages 441-463, February.
    13. Wolpin, Kenneth I., 2013. "The Limits of Inference without Theory," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262019086, April.
    14. David Card & Carlos Dobkin & Nicole Maestas, 2008. "The Impact of Nearly Universal Insurance Coverage on Health Care Utilization: Evidence from Medicare," American Economic Review, American Economic Association, vol. 98(5), pages 2242-2258, December.
    15. Christian Bontemps & Thierry Magnac, 2017. "Set Identification, Moment Restrictions, and Inference," Post-Print hal-02137347, HAL.
    16. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2017. "Measuring the Sensitivity of Parameter Estimates to Estimation Moments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1553-1592.
    17. Michael P. Keane, 2010. "A Structural Perspective on the Experimentalist School," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 47-58, Spring.
    18. Dhaval Dave & Robert Kaestner, 2009. "Health insurance and ex ante moral hazard: evidence from Medicare," International Journal of Health Economics and Management, Springer, vol. 9(4), pages 367-390, December.
    19. Christian Bontemps & Thierry Magnac, 2017. "Set Identification, Moment Restrictions, and Inference," Annual Review of Economics, Annual Reviews, vol. 9(1), pages 103-129, September.
    20. Orazio Attanasio, 2012. "Comment on "Does Indivisible Labor Explain the Difference between Micro and Macro Elasticities? A Meta-Analysis of Extensive Margin Elasticities"," NBER Chapters, in: NBER Macroeconomics Annual 2012, Volume 27, pages 57-77, National Bureau of Economic Research, Inc.
    21. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    22. Michal Kolesár & Christoph Rothe, 2018. "Inference in Regression Discontinuity Designs with a Discrete Running Variable," American Economic Review, American Economic Association, vol. 108(8), pages 2277-2304, August.
    23. Lee, David S. & Card, David, 2008. "Regression discontinuity inference with specification error," Journal of Econometrics, Elsevier, vol. 142(2), pages 655-674, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    2. Feng, Jin & Song, Hong & Wang, Zhen, 2020. "The elderly's response to a patient cost-sharing policy in health insurance: Evidence from China," Journal of Economic Behavior & Organization, Elsevier, vol. 169(C), pages 189-207.
    3. Giesecke, Matthias & Jäger, Philipp, 2021. "Pension incentives and labor supply: Evidence from the introduction of universal old-age assistance in the UK," Journal of Public Economics, Elsevier, vol. 203(C).
    4. Hsing-Wen Han & Hsien-Ming Lien & Tzu-Ting Yang, 2020. "Patient Cost-Sharing and Healthcare Utilization in Early Childhood: Evidence from a Regression Discontinuity Design," American Economic Journal: Economic Policy, American Economic Association, vol. 12(3), pages 238-278, August.
    5. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    6. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    7. Tzu-Ting Yang & Hsing-Wen Han & Hsien-Ming Lien, 2014. "Patient Cost-Sharing and Healthcare Utilization in Early Childhood: Evidence from a Regression Discontinuity Design," Working Papers 14C003, Canadian Centre for Health Economics.
    8. Gaggero, Alessio & Gil, Joan & Jiménez-Rubio, Dolores & Zucchelli, Eugenio, 2022. "Does health information affect lifestyle behaviours? The impact of a diabetes diagnosis," Social Science & Medicine, Elsevier, vol. 314(C).
    9. Rebecca M. Myerson & Reginald D. Tucker‐Seeley & Dana P. Goldman & Darius N. Lakdawalla, 2020. "Does Medicare Coverage Improve Cancer Detection and Mortality Outcomes?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(3), pages 577-604, June.
    10. Kemper, Johanna & Renold, Ursula, 2024. "Evaluating the impact of general versus vocational education on labor market outcomes in Egypt by means of a regression discontinuity design," Journal of Development Economics, Elsevier, vol. 166(C).
    11. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    12. Witman, Allison, 2015. "Public health insurance and disparate eligibility of spouses: The Medicare eligibility gap," Journal of Health Economics, Elsevier, vol. 40(C), pages 10-25.
    13. Xu, Ke-Li, 2017. "Regression discontinuity with categorical outcomes," Journal of Econometrics, Elsevier, vol. 201(1), pages 1-18.
    14. Qin Zhou & Karen Eggleston & Gordon G. Liu, 2021. "Healthcare utilization at retirement in China," Health Economics, John Wiley & Sons, Ltd., vol. 30(11), pages 2618-2636, November.
    15. Ivan A Canay & Vishal Kamat, 2018. "Approximate Permutation Tests and Induced Order Statistics in the Regression Discontinuity Design," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(3), pages 1577-1608.
    16. Brilli, Ylenia & Lucifora, Claudio & Russo, Antonio & Tonello, Marco, 2020. "Vaccination take-up and health: Evidence from a flu vaccination program for the elderly," Journal of Economic Behavior & Organization, Elsevier, vol. 179(C), pages 323-341.
    17. Gaggero, A. & Gil, J. & Jiménez-Rubio, D. & Zucchelli, E., 2021. "Health information and lifestyle behaviours: the impact of a diabetes diagnosis," Health, Econometrics and Data Group (HEDG) Working Papers 21/02, HEDG, c/o Department of Economics, University of York.
    18. Christelis, Dimitris & Georgarakos, Dimitris & Sanz-de-Galdeano, Anna, 2020. "The impact of health insurance on stockholding: A regression discontinuity approach," Journal of Health Economics, Elsevier, vol. 69(C).
    19. Canaan, Serena, 2022. "Parental leave, household specialization and children’s well-being," Labour Economics, Elsevier, vol. 75(C).
    20. Bradley R. Curs & Casandra E. Harper & Charles Frey & Brandon Wolak, 2023. "The Effect of College Football Bowl Game Participation on Student-Athlete Academic Outcomes and Team Athletic Success," Research in Higher Education, Springer;Association for Institutional Research, vol. 64(4), pages 497-519, June.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:67/19. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.