IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2207.02943.html
   My bibliography  Save this paper

Degrees of Freedom and Information Criteria for the Synthetic Control Method

Author

Listed:
  • Guillaume Allaire Pouliot
  • Zhen Xie

Abstract

We provide an analytical characterization of the model flexibility of the synthetic control method (SCM) in the familiar form of degrees of freedom. We obtain estimable information criteria. These may be used to circumvent cross-validation when selecting either the weighting matrix in the SCM with covariates, or the tuning parameter in model averaging or penalized variants of SCM. We assess the impact of car license rationing in Tianjin and make a novel use of SCM; while a natural match is available, it and other donors are noisy, inviting the use of SCM to average over approximately matching donors. The very large number of candidate donors calls for model averaging or penalized variants of SCM and, with short pre-treatment series, model selection per information criteria outperforms that per cross-validation.

Suggested Citation

  • Guillaume Allaire Pouliot & Zhen Xie, 2022. "Degrees of Freedom and Information Criteria for the Synthetic Control Method," Papers 2207.02943, arXiv.org.
    • Handle: RePEc:arx:papers:2207.02943
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2207.02943
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bradley Efron, 2004. "The Estimation of Prediction Error: Covariance Penalties and Cross-Validation," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 619-632, January.
    2. Eli Ben-Michael & Avi Feller & Jesse Rothstein, 2021. "The Augmented Synthetic Control Method," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1789-1803, October.
    3. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    4. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    5. Robert Bifulco & Ross Rubenstein & Hosung Sohn, 2017. "Using Synthetic Controls to Evaluate the Effect of Unique Interventions: The Case of Say Yes to Education," Evaluation Review, , vol. 41(6), pages 593-619, December.
    6. Eduardo Cavallo & Sebastian Galiani & Ilan Noy & Juan Pantano, 2013. "Catastrophic Natural Disasters and Economic Growth," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1549-1561, December.
    7. Giovanni Peri & Vasil Yasenov, 2019. "The Labor Market Effects of a Refugee Wave: Synthetic Control Method Meets the Mariel Boatlift," Journal of Human Resources, University of Wisconsin Press, vol. 54(2), pages 267-309.
    8. Sarah Bohn & Magnus Lofstrom & Steven Raphael, 2014. "Did the 2007 Legal Arizona Workers Act Reduce the State's Unauthorized Immigrant Population?," The Review of Economics and Statistics, MIT Press, vol. 96(2), pages 258-269, May.
    9. Matias D. Cattaneo & Yingjie Feng & Rocio Titiunik, 2021. "Prediction Intervals for Synthetic Control Methods," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1865-1880, October.
    10. Alberto Abadie & Alexis Diamond & Jens Hainmueller, 2015. "Comparative Politics and the Synthetic Control Method," American Journal of Political Science, John Wiley & Sons, vol. 59(2), pages 495-510, February.
    11. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    12. Bruno Ferman & Cristine Pinto, 2021. "Synthetic controls with imperfect pretreatment fit," Quantitative Economics, Econometric Society, vol. 12(4), pages 1197-1221, November.
    13. Breusch, T S & Pagan, A R, 1979. "A Simple Test for Heteroscedasticity and Random Coefficient Variation," Econometrica, Econometric Society, vol. 47(5), pages 1287-1294, September.
    14. A. Mukherjee & K. Chen & N. Wang & J. Zhu, 2015. "On the degrees of freedom of reduced-rank estimators in multivariate regression," Biometrika, Biometrika Trust, vol. 102(2), pages 457-477.
    15. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258, September.
    16. Alberto Abadie, 2021. "Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 391-425, June.
    17. Nikolay Doudchenko & Guido W. Imbens, 2016. "Balancing, Regression, Difference-In-Differences and Synthetic Control Methods: A Synthesis," NBER Working Papers 22791, National Bureau of Economic Research, Inc.
    18. Andreas Billmeier & Tommaso Nannicini, 2013. "Assessing Economic Liberalization Episodes: A Synthetic Control Approach," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 983-1001, July.
    19. Xu, Yiqing, 2017. "Generalized Synthetic Control Method: Causal Inference with Interactive Fixed Effects Models," Political Analysis, Cambridge University Press, vol. 25(1), pages 57-76, January.
    20. Joydeep Dutta & Stephan Dempe, 2006. "Bilevel programming with convex lower level problems," Springer Optimization and Its Applications, in: Stephan Dempe & Vyacheslav Kalashnikov (ed.), Optimization with Multivalued Mappings, pages 51-71, Springer.
    21. Kato, Kengo, 2009. "On the degrees of freedom in shrinkage estimation," Journal of Multivariate Analysis, Elsevier, vol. 100(7), pages 1338-1352, August.
    22. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    23. Minami, Kentaro, 2020. "Degrees of freedom in submodular regularization: A computational perspective of Stein’s unbiased risk estimate," Journal of Multivariate Analysis, Elsevier, vol. 175(C).
    24. Alberto Abadie & Jérémy L’Hour, 2021. "A Penalized Synthetic Control Estimator for Disaggregated Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1817-1834, October.
    25. {O}ystein Daljord & Guillaume Pouliot & Junji Xiao & Mandy Hu, 2021. "The Black Market for Beijing License Plates," Papers 2105.00517, arXiv.org.
    26. Heersink, Boris & Peterson, Brenton D. & Jenkins, Jeffery A., 2017. "Disasters and Elections: Estimating the Net Effect of Damage and Relief in Historical Perspective," Political Analysis, Cambridge University Press, vol. 25(2), pages 260-268, April.
    27. Maxwell Kellogg & Magne Mogstad & Guillaume A. Pouliot & Alexander Torgovitsky, 2021. "Combining Matching and Synthetic Control to Tradeoff Biases From Extrapolation and Interpolation," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1804-1816, October.
    28. Shanjun Li, 2018. "Better Lucky Than Rich? Welfare Analysis of Automobile Licence Allocations in Beijing and Shanghai," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(4), pages 2389-2428.
    29. Xi Chen & Qihang Lin & Bodhisattva Sen, 2020. "On Degrees of Freedom of Projection Estimators With Applications to Multivariate Nonparametric Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(529), pages 173-186, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David Gilchrist & Thomas Emery & Nuno Garoupa & Rok Spruk, 2023. "Synthetic Control Method: A tool for comparative case studies in economic history," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 409-445, April.
    2. Pier Basaglia & Sophie M. Behr & Moritz A. Drupp, 2023. "De-Fueling Externalities: How Tax Salience and Fuel Substitution Mediate Climate and Health Benefits," Discussion Papers of DIW Berlin 2041, DIW Berlin, German Institute for Economic Research.
    3. Pier Basaglia & Sophie M. Behr & Moritz A. Drupp, 2023. "De-Fueling Externalities: Causal Effects of Fuel Taxation and Mediating Mechanisms for Reducing Climate and Pollution Costs," CESifo Working Paper Series 10508, CESifo.
    4. Nuno Garoupa & Rok Spruk, 2024. "Populist Constitutional Backsliding and Judicial Independence: Evidence from Turkiye," Papers 2410.02439, arXiv.org.
    5. Maximiliano Marzetti & Rok Spruk, 2023. "Long-Term Economic Effects of Populist Legal Reforms: Evidence from Argentina," Comparative Economic Studies, Palgrave Macmillan;Association for Comparative Economic Studies, vol. 65(1), pages 60-95, March.
    6. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2022. "Same Root Different Leaves: Time Series and Cross-Sectional Methods in Panel Data," Papers 2207.14481, arXiv.org, revised Oct 2022.
    7. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Jun 2024.
    8. Li, Xingyu & Shen, Yan & Zhou, Qiankun, 2024. "Confidence intervals of treatment effects in panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 240(1).
    9. Cummins Joseph & Miller Douglas L. & Smith Brock & Simon David, 2024. "Matching on Noise: Finite Sample Bias in the Synthetic Control Estimator," Journal of Econometric Methods, De Gruyter, vol. 13(1), pages 67-95, January.
    10. Stefano, Roberta di & Mellace, Giovanni, 2020. "The inclusive synthetic control method," Discussion Papers on Economics 14/2020, University of Southern Denmark, Department of Economics.
    11. Zongwu Cai & Ying Fang & Ming Lin & Zixuan Wu, 2023. "A Quasi Synthetic Control Method for Nonlinear Models With High-Dimensional Covariates," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202305, University of Kansas, Department of Economics, revised Aug 2023.
    12. Robert Kraemer & Jonne Lehtimäki, 2024. "Government debt, European Institutions and fiscal rules: a synthetic control approach," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 31(4), pages 1112-1157, August.
    13. Andrii Melnychuk, 2024. "Synthetic Controls with spillover effects: A comparative study," Papers 2405.01645, arXiv.org.
    14. Tomasz Serwach, 2023. "The European Union and within‐country income inequalities. The case of the new member states," The World Economy, Wiley Blackwell, vol. 46(7), pages 1890-1939, July.
    15. Tomasz Serwach, 2022. "The European Union and within-country income inequalities. The case of the New Member States," Working Papers hal-03548416, HAL.
    16. Roy Cerqueti & Raffaella Coppier & Alessandro Girardi & Marco Ventura, 2022. "The sooner the better: lives saved by the lockdown during the COVID-19 outbreak. The case of Italy," The Econometrics Journal, Royal Economic Society, vol. 25(1), pages 46-70.
    17. Daniel Albalate & Germà Bel & Ferran A. Mazaira-Font, 2021. "Decoupling synthetic control methods to ensure stability, accuracy and meaningfulness," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 12(4), pages 549-584, December.
    18. Wei Tian & Seojeong Lee & Valentyn Panchenko, 2023. "Synthetic Controls with Multiple Outcomes," Papers 2304.02272, arXiv.org, revised Jul 2024.
    19. Emery, Thomas & Mélon, Lela & Spruk, Rok, 2023. "Does e-procurement matter for economic growth? Subnational evidence from Australia," The Quarterly Review of Economics and Finance, Elsevier, vol. 89(C), pages 318-334.
    20. Rong J. B. Zhu, 2023. "Synthetic Regressing Control Method," Papers 2306.02584, arXiv.org, revised Oct 2023.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2207.02943. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.