IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/fc9xt_v1.html
   My bibliography  Save this paper

Tactics for design and inference in synthetic control studies: An applied example using high-dimensional data

Author

Listed:
  • Hollingsworth, Alex
  • Wing, Coady

Abstract

Most applied synthetic control studies do not explain the identifying assumptions supporting causal inference. We describe these assumptions, illustrate how they can fail, and examine the consequences of such failures. We offer recommendations for discretionary implementation decisions, connecting each to a core identifying assumption. We also show how to implement a Synthetic Control Using Lasso, which allows a high-dimensional donor pool, automates model selection, allows donors from multiple variable types, and permits extrapolation and negative weights. In an application, we estimate how recreational marijuana legalization affects sales of alcohol and over-the-counter painkillers, finding reductions in alcohol sales.

Suggested Citation

  • Hollingsworth, Alex & Wing, Coady, 2020. "Tactics for design and inference in synthetic control studies: An applied example using high-dimensional data," SocArXiv fc9xt_v1, Center for Open Science.
  • Handle: RePEc:osf:socarx:fc9xt_v1
    DOI: 10.31219/osf.io/fc9xt_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/5eae4f470ffc0500996f92d8/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/fc9xt_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Firpo Sergio & Possebom Vitor, 2018. "Synthetic Control Method: Inference, Sensitivity Analysis and Confidence Sets," Journal of Causal Inference, De Gruyter, vol. 6(2), pages 1-26, September.
    2. Hainmueller, Jens, 2012. "Entropy Balancing for Causal Effects: A Multivariate Reweighting Method to Produce Balanced Samples in Observational Studies," Political Analysis, Cambridge University Press, vol. 20(1), pages 25-46, January.
    3. Xu, Yiqing, 2017. "Generalized Synthetic Control Method: Causal Inference with Interactive Fixed Effects Models," Political Analysis, Cambridge University Press, vol. 25(1), pages 57-76, January.
    4. William N. Evans & Ethan M. J. Lieber & Patrick Power, 2019. "How the Reformulation of OxyContin Ignited the Heroin Epidemic," The Review of Economics and Statistics, MIT Press, vol. 101(1), pages 1-15, March.
    5. Laurent Gobillon & Thierry Magnac, 2016. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," The Review of Economics and Statistics, MIT Press, vol. 98(3), pages 535-551, July.
    6. Jesper Roine & Daniel Waldenström, 2011. "Common Trends and Shocks to Top Incomes: A Structural Breaks Approach," The Review of Economics and Statistics, MIT Press, vol. 93(3), pages 832-846, August.
    7. Powell, David & Pacula, Rosalie Liccardo & Jacobson, Mireille, 2018. "Do medical marijuana laws reduce addictions and deaths related to pain killers?," Journal of Health Economics, Elsevier, vol. 58(C), pages 29-42.
    8. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    9. Crost, Benjamin & Guerrero, Santiago, 2012. "The effect of alcohol availability on marijuana use: Evidence from the minimum legal drinking age," Journal of Health Economics, Elsevier, vol. 31(1), pages 112-121.
    10. Rosalie Liccardo Pacula & David Powell & Paul Heaton & Eric L. Sevigny, 2013. "Assessing the Effects of Medical Marijuana Laws on Marijuana and Alcohol Use: The Devil is in the Details," NBER Working Papers 19302, National Bureau of Economic Research, Inc.
    11. Irene Botosaru & Bruno Ferman, 2019. "On the role of covariates in the synthetic control method," The Econometrics Journal, Royal Economic Society, vol. 22(2), pages 117-130.
    12. Holtz-Eakin, Douglas & Newey, Whitney & Rosen, Harvey S, 1988. "Estimating Vector Autoregressions with Panel Data," Econometrica, Econometric Society, vol. 56(6), pages 1371-1395, November.
    13. J. Williams & Rosalie Liccardo Pacula & Frank J. Chaloupka & Henry Wechsler, 2004. "Alcohol and marijuana use among college students: economic complements or substitutes?," Health Economics, John Wiley & Sons, Ltd., vol. 13(9), pages 825-843, September.
    14. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    15. Dube, Arindrajit & Zipperer, Ben, 2015. "Pooling Multiple Case Studies Using Synthetic Controls: An Application to Minimum Wage Policies," IZA Discussion Papers 8944, Institute of Labor Economics (IZA).
    16. Alex Hollingsworth & Coady Wing & Ashley C. Bradford, 2022. "Comparative Effects of Recreational and Medical Marijuana Laws on Drug Use among Adults and Adolescents," Journal of Law and Economics, University of Chicago Press, vol. 65(3), pages 515-554.
    17. Lisa Cameron & Jenny Williams, 2001. "Cannabis, Alcohol and Cigarettes: Substitutes or Complements?," The Economic Record, The Economic Society of Australia, vol. 77(236), pages 19-34, March.
    18. Angela K. Dills & Sietse Goffard & Jeffrey Miron, 2017. "The Effects of Marijuana Liberalizations: Evidence from Monitoring the Future," NBER Working Papers 23779, National Bureau of Economic Research, Inc.
    19. Jushan Bai, 2009. "Panel Data Models With Interactive Fixed Effects," Econometrica, Econometric Society, vol. 77(4), pages 1229-1279, July.
    20. Ho, Daniel E. & Imai, Kosuke & King, Gary & Stuart, Elizabeth A., 2007. "Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference," Political Analysis, Cambridge University Press, vol. 15(3), pages 199-236, July.
    21. DiNardo, John & Lemieux, Thomas, 2001. "Alcohol, marijuana, and American youth: the unintended consequences of government regulation," Journal of Health Economics, Elsevier, vol. 20(6), pages 991-1010, November.
    22. D. Mark Anderson & Benjamin Hansen & Daniel I. Rees, 2013. "Medical Marijuana Laws, Traffic Fatalities, and Alcohol Consumption," Journal of Law and Economics, University of Chicago Press, vol. 56(2), pages 333-369.
    23. Ashley C. Bradford & W. David Bradford, 2018. "The Impact of Medical Cannabis Legalization on Prescription Medication Use and Costs under Medicare Part D," Journal of Law and Economics, University of Chicago Press, vol. 61(3), pages 461-487.
    24. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hollingsworth, Alex & Wing, Coady, 2020. "Tactics for design and inference in synthetic control studies: An applied example using high-dimensional data," SocArXiv fc9xt, Center for Open Science.
    2. Chakraborty Avinandan & Doremus Jacqueline & Stith Sarah, 2021. "The effects of recreational cannabis access on labor markets: evidence from Colorado," IZA Journal of Labor Economics, Sciendo & Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 10(1), pages 1-86, January.
    3. Eli Ben-Michael & Avi Feller & Jesse Rothstein, 2021. "The Augmented Synthetic Control Method," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1789-1803, October.
    4. Anderson, D. Mark & Rees, Daniel I., 2021. "The Public Health Effects of Legalizing Marijuana," IZA Discussion Papers 14292, Institute of Labor Economics (IZA).
    5. Bruno Ferman, 2021. "On the Properties of the Synthetic Control Estimator with Many Periods and Many Controls," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1764-1772, October.
    6. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Jun 2024.
    7. Sabia, Joseph J. & Dave, Dhaval & Alotaibi, Fawaz & Rees, Daniel I., 2024. "The effects of recreational marijuana laws on drug use and crime," Journal of Public Economics, Elsevier, vol. 234(C).
    8. Sabia, Joseph J. & Nguyen, Thanh Tam, 2016. "The Effect of Medical Marijuana Laws on Labor Market Outcomes," IZA Discussion Papers 9831, Institute of Labor Economics (IZA).
    9. Dmitry Arkhangelsky & Susan Athey & David A. Hirshberg & Guido W. Imbens & Stefan Wager, 2021. "Synthetic Difference-in-Differences," American Economic Review, American Economic Association, vol. 111(12), pages 4088-4118, December.
    10. Bruno Ferman & Cristine Pinto, 2021. "Synthetic controls with imperfect pretreatment fit," Quantitative Economics, Econometric Society, vol. 12(4), pages 1197-1221, November.
    11. Joseph J. Sabia & Jeffrey Swigert & Timothy Young, 2017. "The Effect of Medical Marijuana Laws on Body Weight," Health Economics, John Wiley & Sons, Ltd., vol. 26(1), pages 6-34, January.
    12. Xiaomeng Zhang & Wendun Wang & Xinyu Zhang, 2022. "Asymptotic Properties of the Synthetic Control Method," Papers 2211.12095, arXiv.org.
    13. Li, Xingyu & Shen, Yan & Zhou, Qiankun, 2024. "Confidence intervals of treatment effects in panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 240(1).
    14. David Gilchrist & Thomas Emery & Nuno Garoupa & Rok Spruk, 2023. "Synthetic Control Method: A tool for comparative case studies in economic history," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 409-445, April.
    15. Fry, Joseph, 2024. "A method of moments approach to asymptotically unbiased Synthetic Controls," Journal of Econometrics, Elsevier, vol. 244(1).
    16. Michael Funke & Kadri Männasoo & Helery Tasane, 2023. "Regional Economic Impacts of the Øresund Cross-Border Fixed Link: Cui Bono?," CESifo Working Paper Series 10557, CESifo.
    17. Xiong, Ruoxuan & Pelger, Markus, 2023. "Large dimensional latent factor modeling with missing observations and applications to causal inference," Journal of Econometrics, Elsevier, vol. 233(1), pages 271-301.
    18. Jinyong Hahn & Ruoyao Shi, 2017. "Synthetic Control and Inference," Econometrics, MDPI, vol. 5(4), pages 1-12, November.
    19. Michał Marcin Kobierecki & Michał Pierzgalski, 2022. "Sports Mega-Events and Economic Growth: A Synthetic Control Approach," Journal of Sports Economics, , vol. 23(5), pages 567-597, June.
    20. Borbely, Daniel & Lenhart, Otto & Norris, Jonathan & Romiti, Agnese, 2022. "Marijuana Legalization and Mental Health," IZA Discussion Papers 15729, Institute of Labor Economics (IZA).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:fc9xt_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.