IDEAS home Printed from https://ideas.repec.org/a/bla/pacecr/v28y2023i4p552-569.html
   My bibliography  Save this article

Score manipulation, density continuity and intent‐to‐treat effect for regression discontinuity

Author

Listed:
  • Jin‐young Choi
  • Myoung‐jae Lee

Abstract

Regression discontinuity (RD) is widely used in many disciplines of science to find treatment effect when the treatment is determined by an underlying running variable (‘score') S crossing a cutoff c or not. The main attraction of RD is local randomization around c, which is, however, often ruined by manipulation on S. To detect manipulation, the continuity of score density function fSs at c is routinely tested in practice. In this paper, we examine how informative fS is for RD, and show the following. First, for incumbency effect in election to which RD has been heavily applied, fS may have no information content. Second, for RD in general, the fS continuity is neither necessary nor sufficient for RD validity. Third, if the treatment cannot be implemented without manipulation of S, then the manipulation had better be considered as part of the treatment effect, much as in ‘intent‐to‐treat effect’ for clinical trials. These findings call for relying less on fS continuity tests and, instead, thinking more about how subjects react to the treatment to modify their S, how to design the treatment to lessen manipulation, and what to take as the desired treatment effect.

Suggested Citation

  • Jin‐young Choi & Myoung‐jae Lee, 2023. "Score manipulation, density continuity and intent‐to‐treat effect for regression discontinuity," Pacific Economic Review, Wiley Blackwell, vol. 28(4), pages 552-569, October.
  • Handle: RePEc:bla:pacecr:v:28:y:2023:i:4:p:552-569
    DOI: 10.1111/1468-0106.12380
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/1468-0106.12380
    Download Restriction: no

    File URL: https://libkey.io/10.1111/1468-0106.12380?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ivan A Canay & Vishal Kamat, 2018. "Approximate Permutation Tests and Induced Order Statistics in the Regression Discontinuity Design," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(3), pages 1577-1608.
    2. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    3. Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2020. "Simple Local Polynomial Density Estimators," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(531), pages 1449-1455, July.
    4. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    5. François Gerard & Miikka Rokkanen & Christoph Rothe, 2020. "Bounds on treatment effects in regression discontinuity designs with a manipulated running variable," Quantitative Economics, Econometric Society, vol. 11(3), pages 839-870, July.
    6. Snyder, James M. & Folke, Olle & Hirano, Shigeo, 2015. "Partisan Imbalance in Regression Discontinuity Studies Based on Electoral Thresholds," Political Science Research and Methods, Cambridge University Press, vol. 3(2), pages 169-186, May.
    7. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    8. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    9. Yingying Dong, 2018. "Alternative Assumptions to Identify LATE in Fuzzy Regression Discontinuity Designs," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 80(5), pages 1020-1027, October.
    10. Choi, Jin-young & Lee, Myoung-jae, 2018. "Relaxing conditions for local average treatment effect in fuzzy regression discontinuity," Economics Letters, Elsevier, vol. 173(C), pages 47-50.
    11. Young-sook Kim & Myoung-jae Lee, 2016. "Regression-Kink Approach for Wage Effect on Male Work Hours," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 78(3), pages 424-442, June.
    12. Taisuke Otsu & Ke-Li Xu & Yukitoshi Matsushita, 2013. "Estimation and Inference of Discontinuity in Density," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(4), pages 507-524, October.
    13. Lee Myoung-Jae, 2017. "Regression Discontinuity with Errors in the Running Variable: Effect on Truthful Margin," Journal of Econometric Methods, De Gruyter, vol. 6(1), pages 1-8, January.
    14. Andrew C. Eggers & Anthony Fowler & Jens Hainmueller & Andrew B. Hall & James M. Snyder, 2015. "On the Validity of the Regression Discontinuity Design for Estimating Electoral Effects: New Evidence from Over 40,000 Close Races," American Journal of Political Science, John Wiley & Sons, vol. 59(1), pages 259-274, January.
    15. Caughey, Devin & Sekhon, Jasjeet S., 2011. "Elections and the Regression Discontinuity Design: Lessons from Close U.S. House Races, 1942–2008," Political Analysis, Cambridge University Press, vol. 19(4), pages 385-408.
    16. Joshua D. Angrist & Victor Lavy & Jetson Leder-Luis & Adi Shany, 2019. "Maimonides' Rule Redux," American Economic Review: Insights, American Economic Association, vol. 1(3), pages 309-324, December.
    17. Adam C. Sales & Ben B. Hansen, 2020. "Limitless Regression Discontinuity," Journal of Educational and Behavioral Statistics, , vol. 45(2), pages 143-174, April.
    18. Snyder, James M. & Folke, Olle & Hirano, Shigeo, 2015. "Partisan Imbalance in Regression Discontinuity Studies Based on Electoral Thresholds," Political Science Research and Methods, Cambridge University Press, vol. 3(02), pages 169-186, May.
    19. Matias D. Cattaneo & Nicolas Idrobo & Rocio Titiunik, 2019. "A Practical Introduction to Regression Discontinuity Designs: Foundations," Papers 1911.09511, arXiv.org.
    20. Lee, David S., 2008. "Randomized experiments from non-random selection in U.S. House elections," Journal of Econometrics, Elsevier, vol. 142(2), pages 675-697, February.
    21. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 533-575.
    22. Lee, Myoung-jae, 2016. "Matching, Regression Discontinuity, Difference in Differences, and Beyond," OUP Catalogue, Oxford University Press, number 9780190258740.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hsu, Yu-Chin & Shiu, Ji-Liang & Wan, Yuanyuan, 2024. "Testing identification conditions of LATE in fuzzy regression discontinuity designs," Journal of Econometrics, Elsevier, vol. 241(1).
    2. Yoichi Arai & Yu‐Chin Hsu & Toru Kitagawa & Ismael Mourifié & Yuanyuan Wan, 2022. "Testing identifying assumptions in fuzzy regression discontinuity designs," Quantitative Economics, Econometric Society, vol. 13(1), pages 1-28, January.
    3. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    4. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    5. Bugni, Federico A. & Canay, Ivan A., 2021. "Testing continuity of a density via g-order statistics in the regression discontinuity design," Journal of Econometrics, Elsevier, vol. 221(1), pages 138-159.
    6. Adam C. Sales & Ben B. Hansen, 2020. "Limitless Regression Discontinuity," Journal of Educational and Behavioral Statistics, , vol. 45(2), pages 143-174, April.
    7. Ari Hyytinen & Jaakko Meriläinen & Tuukka Saarimaa & Otto Toivanen & Janne Tukiainen, 2018. "When does regression discontinuity design work? Evidence from random election outcomes," Quantitative Economics, Econometric Society, vol. 9(2), pages 1019-1051, July.
    8. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    9. Takuya Ishihara & Masayuki Sawada, 2020. "Manipulation-Robust Regression Discontinuity Designs," Papers 2009.07551, arXiv.org, revised Sep 2024.
    10. Jun Ma & Zhengfei Yu, 2020. "Empirical Likelihood Covariate Adjustment for Regression Discontinuity Designs," Papers 2008.09263, arXiv.org, revised May 2024.
    11. Koki Fusejima & Takuya Ishihara & Masayuki Sawada, 2022. "A unified diagnostic test for regression discontinuity designs," Papers 2205.04345, arXiv.org, revised Jul 2024.
    12. Joaquín Artés & Ignacio Jurado, 2018. "Government fragmentation and fiscal deficits: a regression discontinuity approach," Public Choice, Springer, vol. 175(3), pages 367-391, June.
    13. De Benedetto, Marco Alberto & De Paola, Maria & Scoppa, Vincenzo & Smirnova, Janna, 2023. "Erasmus Program and Labor Market Outcomes: Evidence from a Fuzzy Regression Discontinuity Design," IZA Discussion Papers 16181, Institute of Labor Economics (IZA).
    14. Babii, Andrii & Kumar, Rohit, 2023. "Isotonic regression discontinuity designs," Journal of Econometrics, Elsevier, vol. 234(2), pages 371-393.
    15. Kettlewell, Nathan & Siminski, Peter, 2020. "Optimal Model Selection in RDD and Related Settings Using Placebo Zones," IZA Discussion Papers 13639, Institute of Labor Economics (IZA).
    16. Steven F. Koch & Jeffrey S. Racine, 2016. "Healthcare facility choice and user fee abolition: regression discontinuity in a multinomial choice setting," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(4), pages 927-950, October.
    17. Goeun Lee & Myoung-jae Lee, 2023. "Regression Discontinuity for Binary Response and Local Maximum Likelihood Estimator to Extrapolate Treatment," Evaluation Review, , vol. 47(2), pages 182-208, April.
    18. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    19. Choi, Jin-young & Lee, Myoung-jae, 2023. "Complier and monotonicity for Fuzzy Multi-score Regression Discontinuity with partial effects," Economics Letters, Elsevier, vol. 228(C).
    20. Aaron A. Elrod & Serkan Karadas & Katherine C. Theyson, 2019. "The effect of gubernatorial political parties on monitoring and enforcement of federal environmental regulation: evidence from the Clean Water Act," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 21(2), pages 171-202, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:pacecr:v:28:y:2023:i:4:p:552-569. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=1361-374X .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.