IDEAS home Printed from https://ideas.repec.org/p/diw/diwwpp/dp1870.html
   My bibliography  Save this paper

Difference-in-Differences to Identify Causal Effects of COVID-19 Policies

Author

Listed:
  • Andrew Goodman-Bacon
  • Jan Marcus

Abstract

Policymakers have implemented a wide range of non-pharmaceutical interventions to fight the spread of COVID-19. Variation in policies across jurisdictions and over time strongly suggests a difference-in-differences (DD) research design to estimate causal effects of counter-COVID measures. We discuss threats to the validity of these DD designs and make recommendations about how researchers can avoid bias, interpret results accurately, and provide sound guidance to policymakers seeking to protect public health and facilitate an eventual economic recovery.

Suggested Citation

  • Andrew Goodman-Bacon & Jan Marcus, 2020. "Difference-in-Differences to Identify Causal Effects of COVID-19 Policies," Discussion Papers of DIW Berlin 1870, DIW Berlin, German Institute for Economic Research.
    • Handle: RePEc:diw:diwwpp:dp1870
    as

    Download full text from publisher

    File URL: https://www.diw.de/documents/publikationen/73/diw_01.c.789794.de/dp1870.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lechner, Michael, 2011. "The Estimation of Causal Effects by Difference-in-Difference Methods," Foundations and Trends(R) in Econometrics, now publishers, vol. 4(3), pages 165-224, November.
    2. Solomon Hsiang & Daniel Allen & Sébastien Annan-Phan & Kendon Bell & Ian Bolliger & Trinetta Chong & Hannah Druckenmiller & Luna Yue Huang & Andrew Hultgren & Emma Krasovich & Peiley Lau & Jaecheol Le, 2020. "The effect of large-scale anti-contagion policies on the COVID-19 pandemic," Nature, Nature, vol. 584(7820), pages 262-267, August.
    3. Brantly Callaway & Pedro H. C. Sant'Anna, 2018. "Difference-in-Differences with Multiple Time Periods and an Application on the Minimum Wage and Employment," DETU Working Papers 1804, Department of Economics, Temple University.
    4. Fang, Hanming & Wang, Long & Yang, Yang, 2020. "Human mobility restrictions and the spread of the Novel Coronavirus (2019-nCoV) in China," Journal of Public Economics, Elsevier, vol. 191(C).
    5. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    6. Dhaval Dave & Andrew I. Friedson & Kyutaro Matsuzawa & Joseph J. Sabia, 2021. "When Do Shelter‐In‐Place Orders Fight Covid‐19 Best? Policy Heterogeneity Across States And Adoption Time," Economic Inquiry, Western Economic Association International, vol. 59(1), pages 29-52, January.
    7. Friedson, Andrew I. & McNichols, Drew & Sabia, Joseph J. & Dave, Dhaval M., 2020. "Did California's Shelter-In-Place Order Work? Early Coronavirus-Related Public Health Effects," IZA Discussion Papers 13160, Institute of Labor Economics (IZA).
    8. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    9. Sumedha Gupta & Thuy D. Nguyen & Felipe Lozano Rojas & Shyam Raman & Byungkyu Lee & Ana Bento & Kosali I. Simon & Coady Wing, 2020. "Tracking Public and Private Responses to the COVID-19 Epidemic: Evidence from State and Local Government Actions," NBER Working Papers 27027, National Bureau of Economic Research, Inc.
    10. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Goolsbee, Austan & Syverson, Chad, 2021. "Fear, lockdown, and diversion: Comparing drivers of pandemic economic decline 2020," Journal of Public Economics, Elsevier, vol. 193(C).
    2. Robert J. R. Elliott & Ingmar Schumacher & Cees Withagen, 2020. "Suggestions for a Covid-19 Post-Pandemic Research Agenda in Environmental Economics," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 76(4), pages 1187-1213, August.
    3. Dave, Dhaval M. & Friedson, Andrew I. & Matsuzawa, Kyutaro & Sabia, Joseph J. & Safford, Samuel, 2020. "Black Lives Matter Protests, Social Distancing, and COVID-19," IZA Discussion Papers 13388, Institute of Labor Economics (IZA).
    4. Brodeur, Abel & Cook, Nikolai & Wright, Taylor, 2021. "On the effects of COVID-19 safer-at-home policies on social distancing, car crashes and pollution," Journal of Environmental Economics and Management, Elsevier, vol. 106(C).
    5. Edoardo Di Porto & Paolo Naticchioni & Vincenzo Scrutinio, 2020. "Partial Lockdown and the Spread of Covid-19: Lessons from the Italian Case," CSEF Working Papers 569, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
    6. Dhaval M. Dave & Andrew I. Friedson & Kyutaro Matsuzawa & Joseph J. Sabia & Samuel Safford, 2020. "Black Lives Matter Protests and Risk Avoidance: The Case of Civil Unrest During a Pandemic," NBER Working Papers 27408, National Bureau of Economic Research, Inc.
    7. Alexander Ahammer & Martin Halla & Mario Lackner, 2023. "Mass gatherings contributed to early COVID‐19 mortality: Evidence from US sports," Contemporary Economic Policy, Western Economic Association International, vol. 41(3), pages 471-488, July.
    8. Porto, Edoardo Di & Naticchioni, Paolo & Scrutinio, Vincenzo, 2022. "Lockdown, essential sectors, and Covid-19: Lessons from Italy," Journal of Health Economics, Elsevier, vol. 81(C).
    9. Callaway, Brantly & Li, Tong, 2023. "Policy evaluation during a pandemic," Journal of Econometrics, Elsevier, vol. 236(1).
    10. Martin Andersen & Johanna Catherine Maclean & Michael F. Pesko & Kosali I. Simon, 2020. "Paid sick-leave and physical mobility: Evidence from the United States during a pandemic," NBER Working Papers 27138, National Bureau of Economic Research, Inc.
    11. Carlos B. Carneiro & I'uri H. Ferreira & Marcelo C. Medeiros & Henrique F. Pires & Eduardo Zilberman, 2020. "Lockdown effects in US states: an artificial counterfactual approach," Papers 2009.13484, arXiv.org, revised Feb 2021.
    12. Wright, Austin L. & Sonin, Konstantin & Driscoll, Jesse & Wilson, Jarnickae, 2020. "Poverty and economic dislocation reduce compliance with COVID-19 shelter-in-place protocols," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 544-554.
    13. Arne Henningsen & Guy Low & David Wuepper & Tobias Dalhaus & Hugo Storm & Dagim Belay & Stefan Hirsch, 2024. "Estimating Causal Effects with Observational Data: Guidelines for Agricultural and Applied Economists," IFRO Working Paper 2024/03, University of Copenhagen, Department of Food and Resource Economics.
    14. Abel Brodeur & David Gray & Anik Islam & Suraiya Bhuiyan, 2021. "A literature review of the economics of COVID‐19," Journal of Economic Surveys, Wiley Blackwell, vol. 35(4), pages 1007-1044, September.
    15. Sloczynski, Tymon, 2018. "A General Weighted Average Representation of the Ordinary and Two-Stage Least Squares Estimands," IZA Discussion Papers 11866, Institute of Labor Economics (IZA).
    16. Miquel Oliu-Barton & Bary S. R. Pradelski & Nicolas Woloszko & Lionel Guetta-Jeanrenaud & Philippe Aghion & Patrick Artus & Arnaud Fontanet & Philippe Martin & Guntram B. Wolff, 2022. "The effect of COVID certificates on vaccine uptake, health outcomes, and the economy," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    17. Hao, Shiming, 2021. "True structure change, spurious treatment effect? A novel approach to disentangle treatment effects from structure changes," MPRA Paper 108679, University Library of Munich, Germany.
    18. Andrew G. Atkeson & Karen A. Kopecky & Tao Zha, 2024. "Four Stylized Facts About Covid‐19," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 65(1), pages 3-42, February.
    19. Matthew Spiegel & Heather Tookes, 2021. "Business Restrictions and COVID-19 Fatalities [The immediate effect of COVID-19 policies on social distancing behavior in the United States]," The Review of Financial Studies, Society for Financial Studies, vol. 34(11), pages 5266-5308.
    20. Kong, Edward & Prinz, Daniel, 2020. "Disentangling policy effects using proxy data: Which shutdown policies affected unemployment during the COVID-19 pandemic?," Journal of Public Economics, Elsevier, vol. 189(C).

    More about this item

    Keywords

    Difference-in-differences; non-pharmaceutical interventions; COVID-19; causal inference;
    All these keywords.

    JEL classification:

    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • I18 - Health, Education, and Welfare - - Health - - - Government Policy; Regulation; Public Health

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:diw:diwwpp:dp1870. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Bibliothek (email available below). General contact details of provider: https://edirc.repec.org/data/diwbede.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.