IDEAS home Printed from https://ideas.repec.org/a/wly/quante/v9y2018i2p1019-1051.html
   My bibliography  Save this article

When does regression discontinuity design work? Evidence from random election outcomes

Author

Listed:
  • Ari Hyytinen
  • Jaakko Meriläinen
  • Tuukka Saarimaa
  • Otto Toivanen
  • Janne Tukiainen

Abstract

We use elections data in which a large number of ties in vote counts between candidates are resolved via a lottery to study the personal incumbency advantage. We benchmark non‐experimental regression discontinuity design (RDD) estimates against the estimate produced by this experiment that takes place exactly at the cutoff. The experimental estimate suggests that there is no personal incumbency advantage. In contrast, conventional local polynomial RDD estimates suggest a moderate and statistically significant effect. Bias‐corrected RDD estimates that apply robust inference are, however, in line with the experimental estimate. Therefore, state‐of‐the‐art implementation of RDD can meet the replication standard in the context of close elections.

Suggested Citation

  • Ari Hyytinen & Jaakko Meriläinen & Tuukka Saarimaa & Otto Toivanen & Janne Tukiainen, 2018. "When does regression discontinuity design work? Evidence from random election outcomes," Quantitative Economics, Econometric Society, vol. 9(2), pages 1019-1051, July.
    • Handle: RePEc:wly:quante:v:9:y:2018:i:2:p:1019-1051
    DOI: 10.3982/QE864
    as

    Download full text from publisher

    File URL: https://doi.org/10.3982/QE864
    Download Restriction: no
    File URL: https://libkey.io/10.3982/QE864?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    2. Fernando Ferreira & Joseph Gyourko, 2009. "Do Political Parties Matter? Evidence from U.S. Cities," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(1), pages 399-422.
    3. Bartalotti, Otávio C. & Brummet, Quentin O., 2016. "Regression Discontinuity Designs with Clustered Data: Variance and Bandwidth Choice," Staff General Research Papers Archive 3393, Iowa State University, Department of Economics.
    4. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    5. Zhuan Pei & David S. Lee & David Card & Andrea Weber, 2022. "Local Polynomial Order in Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1259-1267, June.
    6. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    7. Heléne Lundqvist, 2013. "Is it worth it? On the returns to holding political office," Working Papers 2013/14, Institut d'Economia de Barcelona (IEB).
    8. Broockman, David E., 2009. "Do Congressional Candidates Have Reverse Coattails? Evidence from a Regression Discontinuity Design," Political Analysis, Cambridge University Press, vol. 17(4), pages 418-434.
    9. Snyder, James M. & Folke, Olle & Hirano, Shigeo, 2015. "Partisan Imbalance in Regression Discontinuity Studies Based on Electoral Thresholds," Political Science Research and Methods, Cambridge University Press, vol. 3(2), pages 169-186, May.
    10. Erikson, Robert S. & Titiunik, Rocío, 2015. "Using Regression Discontinuity to Uncover the Personal Incumbency Advantage," Quarterly Journal of Political Science, now publishers, vol. 10(1), pages 101-119, May.
    11. De Magalhaes, Leandro, 2015. "Incumbency Effects in a Comparative Perspective: Evidence from Brazilian Mayoral Elections," Political Analysis, Cambridge University Press, vol. 23(1), pages 113-126, January.
    12. Kaisa Kotakorpi & Panu Poutvaara & Marko Terviö, 2017. "Returns to Office in National and Local Politics: A Bootstrap Method and Evidence from Finland," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 33(3), pages 413-442.
    13. Jens Ludwig & Douglas L. Miller, 2007. "Does Head Start Improve Children's Life Chances? Evidence from a Regression Discontinuity Design," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(1), pages 159-208.
    14. Andrew C. Eggers & Anthony Fowler & Jens Hainmueller & Andrew B. Hall & James M. Snyder, 2015. "On the Validity of the Regression Discontinuity Design for Estimating Electoral Effects: New Evidence from Over 40,000 Close Races," American Journal of Political Science, John Wiley & Sons, vol. 59(1), pages 259-274, January.
    15. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
    16. Sebastian Calonico & Matias D. Cattaneo & Rocío Titiunik, 2015. "Optimal Data-Driven Regression Discontinuity Plots," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1753-1769, December.
    17. Yogesh Uppal, 2009. "The disadvantaged incumbents: estimating incumbency effects in Indian state legislatures," Public Choice, Springer, vol. 138(1), pages 9-27, January.
    18. David S. Lee & Enrico Moretti & Matthew J. Butler, 2004. "Do Voters Affect or Elect Policies? Evidence from the U. S. House," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 807-859.
    19. Dan A. Black & Jose Galdo & Jeffrey A. Smith, 2007. "Evaluating the Worker Profiling and Reemployment Services System Using a Regression Discontinuity Approach," American Economic Review, American Economic Association, vol. 97(2), pages 104-107, May.
    20. Lemieux, Thomas & Milligan, Kevin, 2008. "Incentive effects of social assistance: A regression discontinuity approach," Journal of Econometrics, Elsevier, vol. 142(2), pages 807-828, February.
    21. Guido Imbens & Karthik Kalyanaraman, 2012. "Optimal Bandwidth Choice for the Regression Discontinuity Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 933-959.
    22. Olle Folke & James M. Snyder, 2012. "Gubernatorial Midterm Slumps," American Journal of Political Science, John Wiley & Sons, vol. 56(4), pages 931-948, October.
    23. Lee, David S., 2008. "Randomized experiments from non-random selection in U.S. House elections," Journal of Econometrics, Elsevier, vol. 142(2), pages 675-697, February.
    24. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    25. Matias D. Cattaneo & Roc ́ıo Titiunik & Gonzalo Vazquez-Bare, 2016. "Inference in regression discontinuity designs under local randomization," Stata Journal, StataCorp LP, vol. 16(2), pages 331-367, June.
    26. Andrew Gelman & Guido Imbens, 2019. "Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 447-456, July.
    27. Fowler, Anthony & Hall, Andrew B., 2014. "Disentangling the Personal and Partisan Incumbency Advantages: Evidence from Close Elections and Term Limits," Quarterly Journal of Political Science, now publishers, vol. 9(4), pages 501-531, December.
    28. Scott W. Desposato & John R. Petrocik, 2003. "The Variable Incumbency Advantage: New Voters, Redistricting, and the Personal Vote," American Journal of Political Science, John Wiley & Sons, vol. 47(1), pages 18-32, January.
    29. Redmond, Paul & Regan, John, 2015. "Incumbency advantage in a proportional electoral system: A regression discontinuity analysis of Irish elections," European Journal of Political Economy, Elsevier, vol. 38(C), pages 244-256.
    30. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    31. Olle Folke, 2014. "Shades Of Brown And Green: Party Effects In Proportional Election Systems," Journal of the European Economic Association, European Economic Association, vol. 12(5), pages 1361-1395, October.
    32. Erikson, Robert S. & Rader, Kelly, 2017. "Much Ado About Nothing: RDD and the Incumbency Advantage," Political Analysis, Cambridge University Press, vol. 25(2), pages 269-275, April.
    33. Heléne Lundqvist, 2013. "Is it worth it? On the returns to holding political office," Working Papers 2013/14, Institut d'Economia de Barcelona (IEB).
    34. Burt S. Barnow & Matias D. Cattaneo & Rocío Titiunik & Gonzalo Vazquez‐Bare, 2017. "Comparing Inference Approaches for RD Designs: A Reexamination of the Effect of Head Start on Child Mortality," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 36(3), pages 643-681, June.
    35. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    36. Rebecca A. Maynard & Kenneth A. Couch & Coady Wing & Thomas D. Cook, 2013. "Strengthening The Regression Discontinuity Design Using Additional Design Elements: A Within‐Study Comparison," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(4), pages 853-877, September.
    37. Otávio Bartalotti & Quentin Brummet, 2017. "Regression Discontinuity Designs with Clustered Data," Advances in Econometrics, in: Regression Discontinuity Designs, volume 38, pages 383-420, Emerald Group Publishing Limited.
    38. Snyder, James M. & Folke, Olle & Hirano, Shigeo, 2015. "Partisan Imbalance in Regression Discontinuity Studies Based on Electoral Thresholds," Political Science Research and Methods, Cambridge University Press, vol. 3(02), pages 169-186, May.
    39. Elisabeth R Gerber & Daniel J Hopkins, 2011. "When Mayors Matter: Estimating the Impact of Mayoral Partisanship on City Policy," American Journal of Political Science, John Wiley & Sons, vol. 55(2), pages 326-339, April.
    40. Gonzalo Vazquez-Bare & Matias Cattaneo & Rocio Titiunik, 2016. "rdlocrand: a Stata Package for Inference in Regression Discontinuity Designs under Local Randomizati," 2016 Stata Conference 25, Stata Users Group.
    41. Green, Donald P. & Leong, Terence Y. & Kern, Holger L. & Gerber, Alan S. & Larimer, Christopher W., 2009. "Testing the Accuracy of Regression Discontinuity Analysis Using Experimental Benchmarks," Political Analysis, Cambridge University Press, vol. 17(4), pages 400-417.
    42. Thomas Fraker & Rebecca Maynard, 1987. "The Adequacy of Comparison Group Designs for Evaluations of Employment-Related Programs," Journal of Human Resources, University of Wisconsin Press, vol. 22(2), pages 194-227.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    2. Marta Curto-Grau (Universitat de Barcelona) & Albert Sole-Olle (Universitat de Barcelona) & Pilar Sorribas-Navarro(Universitat de Barcelona), 2012. "Partisan targeting of inter-governmental transfers & state interference in local elections: evidence from Spain," Working Papers in Economics 288, Universitat de Barcelona. Espai de Recerca en Economia.
    3. Marta Curto-Grau (Universitat de Barcelona) & Albert Sole-Olle (Universitat de Barcelona) & Pilar Sorribas-Navarro(Universitat de Barcelona), 2012. "Partisan targeting of inter-governmental transfers & state interference in local elections: evidence from Spain," Working Papers in Economics 288, Universitat de Barcelona. Espai de Recerca en Economia.
    4. Marta Curto-Grau & Albert Solé-Ollé & Pilar Sorribas-Navarro, 2012. "Partisan targeting of inter-governmental transfers & state interference in local elections: evidence from Spain," Working Papers 2012/31, Institut d'Economia de Barcelona (IEB).
    5. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    6. Solé-Ollé, Albert & Viladecans-Marsal, Elisabet, 2013. "Do political parties matter for local land use policies?," Journal of Urban Economics, Elsevier, vol. 78(C), pages 42-56.
    7. Joaquín Artés & Ignacio Jurado, 2018. "Government fragmentation and fiscal deficits: a regression discontinuity approach," Public Choice, Springer, vol. 175(3), pages 367-391, June.
    8. Kettlewell, Nathan & Siminski, Peter, 2020. "Optimal Model Selection in RDD and Related Settings Using Placebo Zones," IZA Discussion Papers 13639, Institute of Labor Economics (IZA).
    9. Solé-Ollé, Albert & Viladecans-Marsal, Elisabet, 2013. "Do political parties matter for local land use policies?," Journal of Urban Economics, Elsevier, vol. 78(C), pages 42-56.
    10. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    11. Cappelletti, Giuseppe & Ponte Marques, Aurea & Varraso, Paolo & Budrys, Žymantas & Peeters, Jonas, 2019. "Impact of higher capital buffers on banks’ lending and risk-taking: evidence from the euro area experiments," Working Paper Series 2292, European Central Bank.
    12. Wenchi Wei, 2021. "State fiscal constraint and local overrides: a regression discontinuity design estimation of the fiscal effects," Public Choice, Springer, vol. 189(3), pages 347-373, December.
    13. Prakash, Nishith & Rockmore, Marc & Uppal, Yogesh, 2019. "Do criminally accused politicians affect economic outcomes? Evidence from India," Journal of Development Economics, Elsevier, vol. 141(C).
    14. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    15. Meriläinen, Jaakko, 2013. "Do Single-Party and Coalition Governments Differ in their Economic Outcomes? Evidence from Finnish Municipalities," Working Papers 51, VATT Institute for Economic Research.
    16. Leandro de Magalhaes & Salomo Hirvonen, 2019. "The Incumbent-Challenger Advantage and the Winner-Runner-up Advantage," Bristol Economics Discussion Papers 19/710, School of Economics, University of Bristol, UK.
    17. Marta Curto‐Grau & Albert Solé‐Ollé & Pilar Sorribas‐Navarro, 2017. "Does electoral competition curb party favoritism?," Working Papers 2017/04, Institut d'Economia de Barcelona (IEB).
    18. Cappelletti, Giuseppe & Ponte Marques, Aurea & Varraso, Paolo, 2024. "Impact of higher capital buffers on banks’ lending and risk-taking in the short- and medium-term: Evidence from the euro area experiments," Journal of Financial Stability, Elsevier, vol. 72(C).
    19. Lewis, Blane D. & Nguyen, Hieu T.M. & Hendrawan, Adrianus, 2020. "Political accountability and public service delivery in decentralized Indonesia: Incumbency advantage and the performance of second term mayors," European Journal of Political Economy, Elsevier, vol. 64(C).
    20. Jaakko Meriläinen, 2019. "Single‐Party Rule, Public Spending, and Political Rents: Evidence from Finnish Municipalities," Scandinavian Journal of Economics, Wiley Blackwell, vol. 121(2), pages 736-762, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:quante:v:9:y:2018:i:2:p:1019-1051. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/essssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.