IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2408.05847.html
   My bibliography  Save this paper

Correcting invalid regression discontinuity designs with multiple time period data

Author

Listed:
  • Dor Leventer
  • Daniel Nevo

Abstract

A common approach to Regression Discontinuity (RD) designs relies on a continuity assumption of the mean potential outcomes at the cutoff defining the RD design. In practice, this assumption is often implausible when changes other than the intervention of interest occur at the cutoff (e.g., other policies are implemented at the same cutoff). When the continuity assumption is implausible, researchers often retreat to ad-hoc analyses that are not supported by any theory and yield results with unclear causal interpretation. These analyses seek to exploit additional data where either all units are treated or all units are untreated (regardless of their running variable value). For example, when data from multiple time periods are available. We first derive the bias of RD designs when the continuity assumption does not hold. We then present a theoretical foundation for analyses using multiple time periods by the means of a general identification framework incorporating data from additional time periods to overcome the bias. We discuss this framework under various RD designs, and also extend our work to carry-over effects and time-varying running variables. We develop local linear regression estimators, bias correction procedures, and standard errors that are robust to bias-correction for the multiple period setup. The approach is illustrated using an application that studied the effect of new fiscal laws on debt of Italian municipalities.

Suggested Citation

  • Dor Leventer & Daniel Nevo, 2024. "Correcting invalid regression discontinuity designs with multiple time period data," Papers 2408.05847, arXiv.org.
  • Handle: RePEc:arx:papers:2408.05847
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2408.05847
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Natalia Danzer & Victor Lavy, 2018. "Paid Parental Leave and Children's Schooling Outcomes," Economic Journal, Royal Economic Society, vol. 128(608), pages 81-117, February.
    2. Rafael Lalive & Analía Schlosser & Andreas Steinhauer & Josef Zweimüller, 2014. "Parental Leave and Mothers' Careers: The Relative Importance of Job Protection and Cash Benefits," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(1), pages 219-265.
    3. Marianne Bertrand & Magne Mogstad & Jack Mountjoy, 2021. "Improving Educational Pathways to Social Mobility: Evidence from Norway’s Reform 94," Journal of Labor Economics, University of Chicago Press, vol. 39(4), pages 965-1010.
    4. Morten Bennedsen & Elena Simintzi & Margarita Tsoutsoura & Daniel Wolfenzon, 2022. "Do Firms Respond to Gender Pay Gap Transparency?," Journal of Finance, American Finance Association, vol. 77(4), pages 2051-2091, August.
    5. Clément de Chaisemartin & Xavier D’Haultfœuille, 2023. "Two-way fixed effects and differences-in-differences with heterogeneous treatment effects: a survey," The Econometrics Journal, Royal Economic Society, vol. 26(3), pages 1-30.
    6. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    7. Dmitry Arkhangelsky & Susan Athey & David A. Hirshberg & Guido W. Imbens & Stefan Wager, 2021. "Synthetic Difference-in-Differences," American Economic Review, American Economic Association, vol. 111(12), pages 4088-4118, December.
    8. Fabrizia Mealli & Carla Rampichini, 2012. "Evaluating the effects of university grants by using regression discontinuity designs," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(3), pages 775-798, July.
    9. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    10. Gordon B. Dahl & Katrine V. Løken & Magne Mogstad & Kari Vea Salvanes, 2016. "What Is the Case for Paid Maternity Leave?," The Review of Economics and Statistics, MIT Press, vol. 98(4), pages 655-670, October.
    11. Andrew Gelman & Guido Imbens, 2019. "Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 447-456, July.
    12. Susan Athey & Mohsen Bayati & Nikolay Doudchenko & Guido Imbens & Khashayar Khosravi, 2021. "Matrix Completion Methods for Causal Panel Data Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1716-1730, October.
    13. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs," Econometrica, Econometric Society, vol. 82, pages 2295-2326, November.
    14. Uta Schönberg & Johannes Ludsteck, 2014. "Expansions in Maternity Leave Coverage and Mothers' Labor Market Outcomes after Childbirth," Journal of Labor Economics, University of Chicago Press, vol. 32(3), pages 469-505.
    15. Sebastian Calonico & Matias D Cattaneo & Max H Farrell, 2020. "Optimal bandwidth choice for robust bias-corrected inference in regression discontinuity designs," The Econometrics Journal, Royal Economic Society, vol. 23(2), pages 192-210.
    16. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    17. Ashesh Rambachan & Jonathan Roth, 2023. "A More Credible Approach to Parallel Trends," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(5), pages 2555-2591.
    18. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    19. Matias D. Cattaneo & Luke Keele & Rocio Titiunik, 2021. "Covariate Adjustment in Regression Discontinuity Designs," Papers 2110.08410, arXiv.org, revised Aug 2022.
    20. Hartman, Erin, 2021. "Equivalence Testing for Regression Discontinuity Designs," Political Analysis, Cambridge University Press, vol. 29(4), pages 505-521, October.
    21. Patrick Bajari & Han Hong & Minjung Park & Robert Town, 2011. "Regression Discontinuity Designs with an Endogenous Forcing Variable and an Application to Contracting in Health Care," NBER Working Papers 17643, National Bureau of Economic Research, Inc.
    22. Andrew C. Eggers & Ronny Freier & Veronica Grembi & Tommaso Nannicini, 2018. "Regression Discontinuity Designs Based on Population Thresholds: Pitfalls and Solutions," American Journal of Political Science, John Wiley & Sons, vol. 62(1), pages 210-229, January.
    23. Joshua D. Angrist & Miikka Rokkanen, 2015. "Wanna Get Away? Regression Discontinuity Estimation of Exam School Effects Away From the Cutoff," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1331-1344, December.
    24. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    25. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    26. Jonathan Roth & Pedro H. C. Sant'Anna, 2023. "When Is Parallel Trends Sensitive to Functional Form?," Econometrica, Econometric Society, vol. 91(2), pages 737-747, March.
    27. Rebecca A. Maynard & Kenneth A. Couch & Coady Wing & Thomas D. Cook, 2013. "Strengthening The Regression Discontinuity Design Using Additional Design Elements: A Within‐Study Comparison," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(4), pages 853-877, September.
    28. Matias D. Cattaneo & Luke Keele & Rocío Titiunik & Gonzalo Vazquez-Bare, 2021. "Extrapolating Treatment Effects in Multi-Cutoff Regression Discontinuity Designs," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1941-1952, October.
    29. Erin Hartman & F. Daniel Hidalgo, 2018. "An Equivalence Approach to Balance and Placebo Tests," American Journal of Political Science, John Wiley & Sons, vol. 62(4), pages 1000-1013, October.
    30. Veronica Grembi & Tommaso Nannicini & Ugo Troiano, 2016. "Do Fiscal Rules Matter?," American Economic Journal: Applied Economics, American Economic Association, vol. 8(3), pages 1-30, July.
    31. Cladia Noack & Chistoph Rothe, 2023. "Donut Regression Discontinuity Designs," Papers 2308.14464, arXiv.org.
    32. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    33. Lee, David S., 2008. "Randomized experiments from non-random selection in U.S. House elections," Journal of Econometrics, Elsevier, vol. 142(2), pages 675-697, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    2. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    3. Babii, Andrii & Kumar, Rohit, 2023. "Isotonic regression discontinuity designs," Journal of Econometrics, Elsevier, vol. 234(2), pages 371-393.
    4. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    5. Joshua D Gottlieb & Richard R Townsend & Ting Xu, 2022. "Does Career Risk Deter Potential Entrepreneurs?," The Review of Financial Studies, Society for Financial Studies, vol. 35(9), pages 3973-4015.
    6. Christina Korting & Carl Lieberman & Jordan Matsudaira & Zhuan Pei & Yi Shen, 2023. "Visual Inference and Graphical Representation in Regression Discontinuity Designs," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(3), pages 1977-2019.
    7. Canaan, Serena, 2022. "Parental leave, household specialization and children’s well-being," Labour Economics, Elsevier, vol. 75(C).
    8. David Wuepper & Robert Finger, 2023. "Regression discontinuity designs in agricultural and environmental economics," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 50(1), pages 1-28.
    9. Burgherr, David, 2022. "Behavioral Responses to a Pension Savings Mandate : Quasi-experimental Evidence from Swiss Tax Data," CAGE Online Working Paper Series 645, Competitive Advantage in the Global Economy (CAGE).
    10. Köppl–Turyna, Monika & Pitlik, Hans, 2018. "Do equalization payments affect subnational borrowing? Evidence from regression discontinuity," European Journal of Political Economy, Elsevier, vol. 53(C), pages 84-108.
    11. Prakash, Nishith & Rockmore, Marc & Uppal, Yogesh, 2019. "Do criminally accused politicians affect economic outcomes? Evidence from India," Journal of Development Economics, Elsevier, vol. 141(C).
    12. Ari Hyytinen & Jaakko Meriläinen & Tuukka Saarimaa & Otto Toivanen & Janne Tukiainen, 2018. "When does regression discontinuity design work? Evidence from random election outcomes," Quantitative Economics, Econometric Society, vol. 9(2), pages 1019-1051, July.
    13. Crespo Cristian, 2020. "Beyond Manipulation: Administrative Sorting in Regression Discontinuity Designs," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 164-181, January.
    14. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    15. Kettlewell, Nathan & Siminski, Peter, 2020. "Optimal Model Selection in RDD and Related Settings Using Placebo Zones," IZA Discussion Papers 13639, Institute of Labor Economics (IZA).
    16. Yoichi Arai & Yu‐Chin Hsu & Toru Kitagawa & Ismael Mourifié & Yuanyuan Wan, 2022. "Testing identifying assumptions in fuzzy regression discontinuity designs," Quantitative Economics, Econometric Society, vol. 13(1), pages 1-28, January.
    17. Yang He & Otávio Bartalotti, 2020. "Wild bootstrap for fuzzy regression discontinuity designs: obtaining robust bias-corrected confidence intervals," The Econometrics Journal, Royal Economic Society, vol. 23(2), pages 211-231.
    18. Sonia Bhalotra & Irma Clots-Figueras & Lakshmi Iyer, "undated". "Pathbreakers? Women’s Electoral Success and Future Political Participation," Boston University - Department of Economics - The Institute for Economic Development Working Papers Series dp-277, Boston University - Department of Economics.
    19. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    20. Chuard, Caroline, 2023. "Negative effects of long parental leave on maternal health: Evidence from a substantial policy change in Austria," Journal of Health Economics, Elsevier, vol. 88(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2408.05847. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.