IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2405.01645.html
   My bibliography  Save this paper

Synthetic Controls with spillover effects: A comparative study

Author

Listed:
  • Andrii Melnychuk

Abstract

Iterative Synthetic Control Method is introduced in this study, a modification of the Synthetic Control Method (SCM) designed to improve its predictive performance by utilizing control units affected by the treatment in question. This method is then compared to other SCM modifications: SCM without any modifications, SCM after removing all spillover-affected units, Inclusive SCM, and the SP SCM model. For the comparison, Monte Carlo simulations are utilized, generating artificial datasets with known counterfactuals and comparing the predictive performance of the methods. Generally, the Inclusive SCM performed best in all settings and is relatively simple to implement. The Iterative SCM, introduced in this paper, was in close seconds, with a small difference in performance and a simpler implementation.

Suggested Citation

  • Andrii Melnychuk, 2024. "Synthetic Controls with spillover effects: A comparative study," Papers 2405.01645, arXiv.org.
    • Handle: RePEc:arx:papers:2405.01645
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2405.01645
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Eli Ben-Michael & Avi Feller & Jesse Rothstein, 2021. "The Augmented Synthetic Control Method," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1789-1803, October.
    2. Oscar Engelbrektson, 2021. "Why Synthetic Control estimators are biased and what to do about it: Introducing Relaxed and Penalized Synthetic Controls," Papers 2111.10784, arXiv.org.
    3. Du, Zaichao & Zhang, Lin, 2015. "Home-purchase restriction, property tax and housing price in China: A counterfactual analysis," Journal of Econometrics, Elsevier, vol. 188(2), pages 558-568.
    4. Jianfei Cao & Connor Dowd, 2019. "Estimation and Inference for Synthetic Control Methods with Spillover Effects," Papers 1902.07343, arXiv.org, revised Nov 2019.
    5. Augusto Cerqua & Guido Pellegrini, 2017. "Industrial policy evaluation in the presence of spillovers," Small Business Economics, Springer, vol. 49(3), pages 671-686, October.
    6. Kathleen T. Li, 2020. "Statistical Inference for Average Treatment Effects Estimated by Synthetic Control Methods," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(532), pages 2068-2083, December.
    7. Eli Ben‐Michael & Avi Feller & Jesse Rothstein, 2022. "Synthetic controls with staggered adoption," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(2), pages 351-381, April.
    8. Eduardo Cavallo & Sebastian Galiani & Ilan Noy & Juan Pantano, 2013. "Catastrophic Natural Disasters and Economic Growth," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1549-1561, December.
    9. Firpo Sergio & Possebom Vitor, 2018. "Synthetic Control Method: Inference, Sensitivity Analysis and Confidence Sets," Journal of Causal Inference, De Gruyter, vol. 6(2), pages 1-26, September.
    10. Michael W. Robbins & Jessica Saunders & Beau Kilmer, 2017. "A Framework for Synthetic Control Methods With High-Dimensional, Micro-Level Data: Evaluating a Neighborhood-Specific Crime Intervention," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 109-126, January.
    11. Martin Huber & Andreas Steinmayr, 2021. "A Framework for Separating Individual-Level Treatment Effects From Spillover Effects," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(2), pages 422-436, March.
    12. Alberto Abadie & Alexis Diamond & Jens Hainmueller, 2015. "Comparative Politics and the Synthetic Control Method," American Journal of Political Science, John Wiley & Sons, vol. 59(2), pages 495-510, February.
    13. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    14. Alberto Abadie, 2021. "Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 391-425, June.
    15. Cheng Hsiao & H. Steve Ching & Shui Ki Wan, 2012. "A Panel Data Approach For Program Evaluation: Measuring The Benefits Of Political And Economic Integration Of Hong Kong With Mainland China," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(5), pages 705-740, August.
    16. Laura Forastiere & Edoardo M. Airoldi & Fabrizia Mealli, 2021. "Identification and Estimation of Treatment and Interference Effects in Observational Studies on Networks," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(534), pages 901-918, April.
    17. Dube, Arindrajit & Zipperer, Ben, 2015. "Pooling Multiple Case Studies Using Synthetic Controls: An Application to Minimum Wage Policies," IZA Discussion Papers 8944, Institute of Labor Economics (IZA).
    18. Xu, Yiqing, 2017. "Generalized Synthetic Control Method: Causal Inference with Interactive Fixed Effects Models," Political Analysis, Cambridge University Press, vol. 25(1), pages 57-76, January.
    19. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    20. Alberto Abadie & Jérémy L’Hour, 2021. "A Penalized Synthetic Control Estimator for Disaggregated Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1817-1834, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stefano, Roberta di & Mellace, Giovanni, 2020. "The inclusive synthetic control method," Discussion Papers on Economics 14/2020, University of Southern Denmark, Department of Economics.
    2. David Gilchrist & Thomas Emery & Nuno Garoupa & Rok Spruk, 2023. "Synthetic Control Method: A tool for comparative case studies in economic history," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 409-445, April.
    3. Tomasz Serwach, 2022. "The European Union and within-country income inequalities. The case of the New Member States," Working Papers hal-03548416, HAL.
    4. Pier Basaglia & Sophie Behr & Moritz A. Drupp, 2023. "De-Fueling Externalities: How Tax Salience and Fuel Substitution Mediate Climate and Health Benefits," Discussion Papers of DIW Berlin 2041, DIW Berlin, German Institute for Economic Research.
    5. Pier Basaglia & Sophie M. Behr & Moritz A. Drupp, 2023. "De-Fueling Externalities: Causal Effects of Fuel Taxation and Mediating Mechanisms for Reducing Climate and Pollution Costs," CESifo Working Paper Series 10508, CESifo.
    6. Maximiliano Marzetti & Rok Spruk, 2023. "Long-Term Economic Effects of Populist Legal Reforms: Evidence from Argentina," Comparative Economic Studies, Palgrave Macmillan;Association for Comparative Economic Studies, vol. 65(1), pages 60-95, March.
    7. Giulio Grossi & Marco Mariani & Alessandra Mattei & Patrizia Lattarulo & Ozge Oner, 2020. "Direct and spillover effects of a new tramway line on the commercial vitality of peripheral streets. A synthetic-control approach," Papers 2004.05027, arXiv.org, revised Nov 2023.
    8. Roy Cerqueti & Raffaella Coppier & Alessandro Girardi & Marco Ventura, 2022. "The sooner the better: lives saved by the lockdown during the COVID-19 outbreak. The case of Italy [Using synthetic controls: Feasibility, data requirements, and methodological aspects]," The Econometrics Journal, Royal Economic Society, vol. 25(1), pages 46-70.
    9. Giulio Grossi, 2023. "The policy is always greener: impact heterogeneity of Covid-19 vaccination lotteries in the US," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(4), pages 1351-1375, October.
    10. Li, Xingyu & Shen, Yan & Zhou, Qiankun, 2024. "Confidence intervals of treatment effects in panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 240(1).
    11. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2022. "Same Root Different Leaves: Time Series and Cross-Sectional Methods in Panel Data," Papers 2207.14481, arXiv.org, revised Oct 2022.
    12. Tomasz Serwach, 2023. "The European Union and within‐country income inequalities. The case of the new member states," The World Economy, Wiley Blackwell, vol. 46(7), pages 1890-1939, July.
    13. Nadine McCloud, 2022. "Does domestic investment respond to inflation targeting? A synthetic control investigation," International Economics, CEPII research center, issue 169, pages 98-134.
    14. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Mar 2024.
    15. Justin Wiltshire, 2021. "allsynth: Synthetic control bias-corrections utilities for Stata," 2021 Stata Conference 15, Stata Users Group.
    16. Ignacio Martinez & Jaume Vives-i-Bastida, 2022. "Bayesian and Frequentist Inference for Synthetic Controls," Papers 2206.01779, arXiv.org, revised Feb 2023.
    17. Guillaume Allaire Pouliot & Zhen Xie, 2022. "Degrees of Freedom and Information Criteria for the Synthetic Control Method," Papers 2207.02943, arXiv.org.
    18. Joakim Weill, 2023. "Flood Risk Mapping and the Distributional Impacts of Climate Information," Working Papers 2023.10, FAERE - French Association of Environmental and Resource Economists.
    19. Rong J. B. Zhu, 2023. "Synthetic Regressing Control Method," Papers 2306.02584, arXiv.org, revised Oct 2023.
    20. Joakim A. Weill, 2023. "Flood Risk Mapping and the Distributional Impacts of Climate Information," Finance and Economics Discussion Series 2023-066, Board of Governors of the Federal Reserve System (U.S.).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2405.01645. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.