IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2302.12777.html
   My bibliography  Save this paper

On the Misspecification of Linear Assumptions in Synthetic Control

Author

Listed:
  • Achille Nazaret
  • Claudia Shi
  • David M. Blei

Abstract

The synthetic control (SC) method is a popular approach for estimating treatment effects from observational panel data. It rests on a crucial assumption that we can write the treated unit as a linear combination of the untreated units. This linearity assumption, however, can be unlikely to hold in practice and, when violated, the resulting SC estimates are incorrect. In this paper we examine two questions: (1) How large can the misspecification error be? (2) How can we limit it? First, we provide theoretical bounds to quantify the misspecification error. The bounds are comforting: small misspecifications induce small errors. With these bounds in hand, we then develop new SC estimators that are specially designed to minimize misspecification error. The estimators are based on additional data about each unit, which is used to produce the SC weights. (For example, if the units are countries then the additional data might be demographic information about each.) We study our estimators on synthetic data; we find they produce more accurate causal estimates than standard synthetic controls. We then re-analyze the California tobacco-program data of the original SC paper, now including additional data from the US census about per-state demographics. Our estimators show that the observations in the pre-treatment period lie within the bounds of misspecification error, and that the observations post-treatment lie outside of those bounds. This is evidence that our SC methods have uncovered a true effect.

Suggested Citation

  • Achille Nazaret & Claudia Shi & David M. Blei, 2023. "On the Misspecification of Linear Assumptions in Synthetic Control," Papers 2302.12777, arXiv.org.
    • Handle: RePEc:arx:papers:2302.12777
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2302.12777
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sylvia Allegretto & Arindrajit Dube & Michael Reich & Ben Zipperer, 2017. "Credible Research Designs for Minimum Wage Studies," ILR Review, Cornell University, ILR School, vol. 70(3), pages 559-592, May.
    2. Nikolay Doudchenko & Guido W. Imbens, 2016. "Balancing, Regression, Difference-In-Differences and Synthetic Control Methods: A Synthesis," NBER Working Papers 22791, National Bureau of Economic Research, Inc.
    3. Guido Imbens & Nathan Kallus & Xiaojie Mao, 2021. "Controlling for Unmeasured Confounding in Panel Data Using Minimal Bridge Functions: From Two-Way Fixed Effects to Factor Models," Papers 2108.03849, arXiv.org.
    4. Victor Chernozhukov & Kaspar Wüthrich & Yinchu Zhu, 2021. "An Exact and Robust Conformal Inference Method for Counterfactual and Synthetic Controls," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1849-1864, October.
    5. Kathleen T. Li, 2020. "Statistical Inference for Average Treatment Effects Estimated by Synthetic Control Methods," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(532), pages 2068-2083, December.
    6. Heersink, Boris & Peterson, Brenton D. & Jenkins, Jeffery A., 2017. "Disasters and Elections: Estimating the Net Effect of Damage and Relief in Historical Perspective," Political Analysis, Cambridge University Press, vol. 25(2), pages 260-268, April.
    7. Alberto Abadie, 2021. "Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 391-425, June.
    8. Paolo Pinotti, 2015. "The Economic Costs of Organised Crime: Evidence from Southern Italy," Economic Journal, Royal Economic Society, vol. 125(586), pages 203-232, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Masahiro Kato & Akari Ohda & Masaaki Imaizumi, 2023. "Asymptotically Unbiased Synthetic Control Methods by Distribution Matching," Papers 2307.11127, arXiv.org, revised May 2024.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2022. "Same Root Different Leaves: Time Series and Cross-Sectional Methods in Panel Data," Papers 2207.14481, arXiv.org, revised Oct 2022.
    2. Claudia Shi & Dhanya Sridhar & Vishal Misra & David M. Blei, 2021. "On the Assumptions of Synthetic Control Methods," Papers 2112.05671, arXiv.org, revised Dec 2021.
    3. Masahiro Kato & Akari Ohda & Masaaki Imaizumi, 2023. "Asymptotically Unbiased Synthetic Control Methods by Distribution Matching," Papers 2307.11127, arXiv.org, revised May 2024.
    4. Rong J. B. Zhu, 2023. "Synthetic Regressing Control Method," Papers 2306.02584, arXiv.org, revised Oct 2023.
    5. Peter Backus & Thien Nguyen, 2021. "The Effect of the Sex Buyer Law on the Market for Sex, Sexual Health and Sexual Violence," Economics Discussion Paper Series 2106, Economics, The University of Manchester.
    6. David Gilchrist & Thomas Emery & Nuno Garoupa & Rok Spruk, 2023. "Synthetic Control Method: A tool for comparative case studies in economic history," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 409-445, April.
    7. Lea Bottmer & Guido Imbens & Jann Spiess & Merrill Warnick, 2021. "A Design-Based Perspective on Synthetic Control Methods," Papers 2101.09398, arXiv.org, revised Jul 2023.
    8. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Jun 2024.
    9. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    10. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2023. "Same Root Different Leaves: Time Series and Cross‐Sectional Methods in Panel Data," Econometrica, Econometric Society, vol. 91(6), pages 2125-2154, November.
    11. Justin Wiltshire, 2021. "allsynth: Synthetic control bias-corrections utilities for Stata," 2021 Stata Conference 15, Stata Users Group.
    12. Kathleen T. Li & Christophe Van den Bulte, 2023. "Augmented Difference-in-Differences," Marketing Science, INFORMS, vol. 42(4), pages 746-767, July.
    13. Ignacio Martinez & Jaume Vives-i-Bastida, 2022. "Bayesian and Frequentist Inference for Synthetic Controls," Papers 2206.01779, arXiv.org, revised Jul 2024.
    14. Alberto Abadie & Jinglong Zhao, 2021. "Synthetic Controls for Experimental Design," Papers 2108.02196, arXiv.org, revised Sep 2024.
    15. Alberto Abadie & Jaume Vives-i-Bastida, 2022. "Synthetic Controls in Action," Papers 2203.06279, arXiv.org.
    16. Jiafeng Chen, 2023. "Synthetic Control as Online Linear Regression," Econometrica, Econometric Society, vol. 91(2), pages 465-491, March.
    17. Guillaume Allaire Pouliot & Zhen Xie, 2022. "Degrees of Freedom and Information Criteria for the Synthetic Control Method," Papers 2207.02943, arXiv.org.
    18. Luis Costa & Vivek F. Farias & Patricio Foncea & Jingyuan (Donna) Gan & Ayush Garg & Ivo Rosa Montenegro & Kumarjit Pathak & Tianyi Peng & Dusan Popovic, 2023. "Generalized Synthetic Control for TestOps at ABI: Models, Algorithms, and Infrastructure," Interfaces, INFORMS, vol. 53(5), pages 336-349, September.
    19. Matias D. Cattaneo & Yingjie Feng & Filippo Palomba & Rocio Titiunik, 2022. "scpi: Uncertainty Quantification for Synthetic Control Methods," Papers 2202.05984, arXiv.org, revised Oct 2022.
    20. Zongwu Cai & Ying Fang & Ming Lin & Zixuan Wu, 2023. "A Quasi Synthetic Control Method for Nonlinear Models With High-Dimensional Covariates," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202305, University of Kansas, Department of Economics, revised Aug 2023.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2302.12777. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.