IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/27424.html
   My bibliography  Save this paper

Local Polynomial Order in Regression Discontinuity Designs

Author

Listed:
  • Zhuan Pei
  • David S. Lee
  • David Card
  • Andrea Weber

Abstract

Treatment effect estimates in regression discontinuity (RD) designs are often sensitive to the choice of bandwidth and polynomial order, the two important ingredients of widely used local regression methods. While Imbens and Kalyanaraman (2012) and Calonico, Cattaneo and Titiunik (2014) provide guidance on bandwidth, the sensitivity to polynomial order still poses a conundrum to RD practitioners. It is understood in the econometric literature that applying the argument of bias reduction does not help resolve this conundrum, since it would always lead to preferring higher orders. We therefore extend the frameworks of Imbens and Kalyanaraman (2012) and Calonico, Cattaneo and Titiunik (2014) and use the asymptotic mean squared error of the local regression RD estimator as the criterion to guide polynomial order selection. We show in Monte Carlo simulations that the proposed order selection procedure performs well, particularly in large sample sizes typically found in empirical RD applications. This procedure extends easily to fuzzy regression discontinuity and regression kink designs.

Suggested Citation

  • Zhuan Pei & David S. Lee & David Card & Andrea Weber, 2020. "Local Polynomial Order in Regression Discontinuity Designs," NBER Working Papers 27424, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:27424
    Note: ED LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w27424.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Andrew Gelman & Guido Imbens, 2019. "Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 447-456, July.
    2. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    3. David Card & David S. Lee & Zhuan Pei & Andrea Weber, 2015. "Inference on Causal Effects in a Generalized Regression Kink Design," Econometrica, Econometric Society, vol. 83, pages 2453-2483, November.
    4. Helena Skyt Nielsen & Torben Sørensen & Christopher Taber, 2010. "Estimating the Effect of Student Aid on College Enrollment: Evidence from a Government Grant Policy Reform," NBER Chapters, in: Income Taxation, Trans-Atlantic Public Economics Seminar (TAPES), pages 185-215, National Bureau of Economic Research, Inc.
    5. Zhuan Pei & David Card & David S. Lee & Andrea Weber, 2012. "Nonlinear Policy Rules and the Identification and Estimation of Causal Effects in a Generalized Regression Kink Design," Working Papers 60, Brandeis University, Department of Economics and International Business School.
    6. Guido Imbens & Karthik Kalyanaraman, 2012. "Optimal Bandwidth Choice for the Regression Discontinuity Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 933-959.
    7. Lee, David S., 2008. "Randomized experiments from non-random selection in U.S. House elections," Journal of Econometrics, Elsevier, vol. 142(2), pages 675-697, February.
    8. Jens Ludwig & Douglas L. Miller, 2007. "Does Head Start Improve Children's Life Chances? Evidence from a Regression Discontinuity Design," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(1), pages 159-208.
    9. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    10. Hall, Peter G. & Racine, Jeffrey S., 2015. "Infinite order cross-validated local polynomial regression," Journal of Econometrics, Elsevier, vol. 185(2), pages 510-525.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tomi Kyyrä & Hanna Pesola, 2020. "The Effects of UI Benefits on Unemployment and Subsequent Outcomes: Evidence from a Kinked Benefit Rule," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 82(5), pages 1135-1160, October.
    2. Kettlewell, Nathan & Siminski, Peter, 2020. "Optimal Model Selection in RDD and Related Settings Using Placebo Zones," IZA Discussion Papers 13639, Institute of Labor Economics (IZA).
    3. Liepmann, Hannah & Pignatti, Clemente, 2024. "Welfare effects of unemployment benefits when informality is high," Journal of Public Economics, Elsevier, vol. 229(C).
    4. 'Agoston Reguly, 2021. "Heterogeneous Treatment Effects in Regression Discontinuity Designs," Papers 2106.11640, arXiv.org, revised Oct 2021.
    5. David Card & David S. Lee & Zhuan Pei & Andrea Weber, 2015. "Inference on Causal Effects in a Generalized Regression Kink Design," Econometrica, Econometric Society, vol. 83, pages 2453-2483, November.
    6. Wright, Nicholas A. & Dorilas, Ernest, 2022. "Do Cellphone Bans Save Lives? Evidence From Handheld Laws on Traffic Fatalities," Journal of Health Economics, Elsevier, vol. 85(C).
    7. Hızıroğlu Aygün, Aysun & Kırdar, Murat Güray & Koyuncu, Murat & Stoeffler, Quentin, 2024. "Keeping refugee children in school and out of work: Evidence from the world's largest humanitarian cash transfer program," Journal of Development Economics, Elsevier, vol. 168(C).
    8. Mohamed Ebeid & Umut Oguzoglu, 2023. "Short‐term effect of retirement on health: Evidence from nonparametric fuzzy regression discontinuity design," Health Economics, John Wiley & Sons, Ltd., vol. 32(6), pages 1323-1343, June.
    9. Bonfim, Diana & Custódio, Cláudia & Raposo, Clara, 2023. "Supporting small firms through recessions and recoveries," Journal of Financial Economics, Elsevier, vol. 147(3), pages 658-688.
    10. Cappelletti, Giuseppe & Ponte Marques, Aurea & Varraso, Paolo, 2024. "Impact of higher capital buffers on banks’ lending and risk-taking in the short- and medium-term: Evidence from the euro area experiments," Journal of Financial Stability, Elsevier, vol. 72(C).
    11. Kountouris, Yiannis, 2020. "Higher education and fertility: Evidence from reforms in Greece," Economics of Education Review, Elsevier, vol. 79(C).
    12. Leganza, Jonathan M., 2024. "The effect of required minimum distributions on intergenerational transfers," Journal of Public Economics, Elsevier, vol. 232(C).
    13. Ari Hyytinen & Jaakko Meriläinen & Tuukka Saarimaa & Otto Toivanen & Janne Tukiainen, 2018. "When does regression discontinuity design work? Evidence from random election outcomes," Quantitative Economics, Econometric Society, vol. 9(2), pages 1019-1051, July.
    14. Ciprian Domnisoru, 2021. "Heterogeneity across Families in the Impact of Compulsory Schooling Laws," Economica, London School of Economics and Political Science, vol. 88(350), pages 399-429, April.
    15. Travis A. Smith & Pourya Valizadeh, 2024. "Aging out of WIC and child nutrition: Evidence from a regression discontinuity design," American Journal of Agricultural Economics, John Wiley & Sons, vol. 106(2), pages 904-924, March.
    16. Junquera, Álvaro F., 2024. "More money, more effect? Employment effects of job search programs in Veneto," SocArXiv rjshu, Center for Open Science.
    17. Diana Bonfim & Cláudia Custódio, 2021. "The sensitivity of SME’s investment and employment to the cost of debt financing," Working Papers w202115, Banco de Portugal, Economics and Research Department.
    18. Gugler, Klaus & Haxhimusa, Adhurim & Liebensteiner, Mario, 2023. "Carbon pricing and emissions: Causal effects of Britain's carbon tax," Energy Economics, Elsevier, vol. 121(C).
    19. Cappelletti, Giuseppe & Ponte Marques, Aurea & Salleo, Carmelo & Martín, Diego Vila, 2020. "How do banking groups react to macroprudential policies? Cross-border spillover effects of higher capital buffers on lending, risk-taking and internal markets," Working Paper Series 2497, European Central Bank.
    20. Pauline Leung, 2021. "State Responses to Federal Matching Grants: The Case of Medicaid," Working Papers 647, Princeton University, Department of Economics, Industrial Relations Section..

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    2. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    3. Peter Ganong & Simon Jäger, 2018. "A Permutation Test for the Regression Kink Design," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 494-504, April.
    4. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    5. David Card & David S. Lee & Zhuan Pei & Andrea Weber, 2015. "Inference on Causal Effects in a Generalized Regression Kink Design," Econometrica, Econometric Society, vol. 83, pages 2453-2483, November.
    6. Ari Hyytinen & Jaakko Meriläinen & Tuukka Saarimaa & Otto Toivanen & Janne Tukiainen, 2018. "When does regression discontinuity design work? Evidence from random election outcomes," Quantitative Economics, Econometric Society, vol. 9(2), pages 1019-1051, July.
    7. Yoichi Arai & Hidehiko Ichimura, 2018. "Simultaneous selection of optimal bandwidths for the sharp regression discontinuity estimator," Quantitative Economics, Econometric Society, vol. 9(1), pages 441-482, March.
    8. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    9. Michihito Ando, 2017. "How much should we trust regression-kink-design estimates?," Empirical Economics, Springer, vol. 53(3), pages 1287-1322, November.
    10. Barbara Engels & Johannes Geyer & Peter Haan, 2016. "Pension Incentives and Early Retirement," Discussion Papers of DIW Berlin 1617, DIW Berlin, German Institute for Economic Research.
    11. Yang He & Otávio Bartalotti, 2020. "Wild bootstrap for fuzzy regression discontinuity designs: obtaining robust bias-corrected confidence intervals," The Econometrics Journal, Royal Economic Society, vol. 23(2), pages 211-231.
    12. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    13. Bertanha, Marinho & Moreira, Marcelo J., 2020. "Impossible inference in econometrics: Theory and applications," Journal of Econometrics, Elsevier, vol. 218(2), pages 247-270.
    14. Marinho Bertanha & Guido W. Imbens, 2020. "External Validity in Fuzzy Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(3), pages 593-612, July.
    15. Chiang, Harold D. & Hsu, Yu-Chin & Sasaki, Yuya, 2019. "Robust uniform inference for quantile treatment effects in regression discontinuity designs," Journal of Econometrics, Elsevier, vol. 211(2), pages 589-618.
    16. Ximing Wu, 2021. "Hierarchical Gaussian Process Models for Regression Discontinuity/Kink under Sharp and Fuzzy Designs," Papers 2110.00921, arXiv.org, revised Feb 2022.
    17. Timothy B Armstrong & Michal Kolesár, 2018. "A Simple Adjustment for Bandwidth Snooping," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(2), pages 732-765.
    18. Dong, Yingying, 2010. "Jumpy or Kinky? Regression Discontinuity without the Discontinuity," MPRA Paper 25461, University Library of Munich, Germany.
    19. Kettlewell, Nathan & Siminski, Peter, 2020. "Optimal Model Selection in RDD and Related Settings Using Placebo Zones," IZA Discussion Papers 13639, Institute of Labor Economics (IZA).
    20. 'Agoston Reguly, 2021. "Heterogeneous Treatment Effects in Regression Discontinuity Designs," Papers 2106.11640, arXiv.org, revised Oct 2021.

    More about this item

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:27424. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.