IDEAS home Printed from https://ideas.repec.org/a/sae/amerec/v67y2022i1p46-63.html
   My bibliography  Save this article

A Guide to Using the Synthetic Control Method to Quantify the Effects of Shocks, Policies, and Shocking Policies

Author

Listed:
  • Bibek Adhikari

Abstract

Governments introduce various policies intending to improve the overall economy or to influence individual behavior. However, estimating the causal impact of these policies is challenging. I describe how the Synthetic Control Method (SCM) can be used in undergraduate econometrics or capstone courses to estimate the impact of economic policies. The SCM is a data-driven design that provides a systematic way of constructing a comparison group that looks very similar to the group implementing the policy. Thus, it allows us to estimate the policy’s impact by comparing the outcome variable’s post-policy path between the policy group and the comparison group. I review a broad range of policies and events that are analyzed using this method, briefly describe the theory behind the method, discuss various best practices, and provide a step-by-step implementation guide using the adoption of a value-added tax (VAT) by France as an example. JEL Classifications : C01, A1, A2

Suggested Citation

  • Bibek Adhikari, 2022. "A Guide to Using the Synthetic Control Method to Quantify the Effects of Shocks, Policies, and Shocking Policies," The American Economist, Sage Publications, vol. 67(1), pages 46-63, March.
    • Handle: RePEc:sae:amerec:v:67:y:2022:i:1:p:46-63
    DOI: 10.1177/05694345211019714
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/05694345211019714
    Download Restriction: no
    File URL: https://libkey.io/10.1177/05694345211019714?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Nauro Campos & Fabrizio Coricelli & Luigi Moretti, 2015. "Norwegian Rhapsody? The Political Economy Benefits of Regional Integration," Working Papers halshs-01267252, HAL.
    2. Breinlich, Holger & Leromain, Elsa & Novy, Dennis & Sampson, Thomas, 2020. "Voting with their money: Brexit and outward investment by UK firms," European Economic Review, Elsevier, vol. 124(C).
    3. David Card, 1990. "The Impact of the Mariel Boatlift on the Miami Labor Market," ILR Review, Cornell University, ILR School, vol. 43(2), pages 245-257, January.
    4. Bibek Adhikari & Romain Duval & Bingjie Hu & Prakash Loungani, 2018. "Can Reform Waves Turn the Tide? Some Case Studies using the Synthetic Control Method," Open Economies Review, Springer, vol. 29(4), pages 879-910, September.
    5. Christian Dustmann & Uta Schönberg & Jan Stuhler, 2017. "Labor Supply Shocks, Native Wages, and the Adjustment of Local Employment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(1), pages 435-483.
    6. Ufuk Akcigit & Salomé Baslandze & Stefanie Stantcheva, 2016. "Taxation and the International Mobility of Inventors," American Economic Review, American Economic Association, vol. 106(10), pages 2930-2981, October.
    7. Chu, Yu-Wei Luke & Townsend, Wilbur, 2019. "Joint culpability: The effects of medical marijuana laws on crime," Journal of Economic Behavior & Organization, Elsevier, vol. 159(C), pages 502-525.
    8. Benjamin Born & Gernot J Müller & Moritz Schularick & Petr Sedláček, 2019. "The Costs of Economic Nationalism: Evidence from the Brexit Experiment," The Economic Journal, Royal Economic Society, vol. 129(623), pages 2722-2744.
    9. Manuel Funke & Moritz Schularick & Christoph Trebesch, 2023. "Populist Leaders and the Economy," American Economic Review, American Economic Association, vol. 113(12), pages 3249-3288, December.
    10. Giovanni Peri & Vasil Yasenov, 2019. "The Labor Market Effects of a Refugee Wave: Synthetic Control Method Meets the Mariel Boatlift," Journal of Human Resources, University of Wisconsin Press, vol. 54(2), pages 267-309.
    11. Ozkan Eren & Serkan Ozbeklik, 2016. "What Do Right‐to‐Work Laws Do? Evidence from a Synthetic Control Method Analysis," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 35(1), pages 173-194, January.
    12. John J. Donohue & Abhay Aneja & Kyle D. Weber, 2019. "Right‐to‐Carry Laws and Violent Crime: A Comprehensive Assessment Using Panel Data and a State‐Level Synthetic Control Analysis," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 16(2), pages 198-247, June.
    13. Alberto Abadie & Alexis Diamond & Jens Hainmueller, 2015. "Comparative Politics and the Synthetic Control Method," American Journal of Political Science, John Wiley & Sons, vol. 59(2), pages 495-510, February.
    14. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    15. Scott Cunningham & Manisha Shah, 2018. "Decriminalizing Indoor Prostitution: Implications for Sexual Violence and Public Health," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(3), pages 1683-1715.
    16. Bibek Adhikari & James Alm, 2016. "Evaluating the Economic Effects of Flat Tax Reforms Using Synthetic Control Methods," Southern Economic Journal, John Wiley & Sons, vol. 83(2), pages 437-463, October.
    17. Enrico Rubolino & Daniel Waldenström, 2020. "Tax progressivity and top incomes evidence from tax reforms," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 18(3), pages 261-289, September.
    18. repec:oup:econjl:v:129:y:2019:i:10:p:2722-2744. is not listed on IDEAS
    19. Grier, Kevin & Maynard, Norman, 2016. "The economic consequences of Hugo Chavez: A synthetic control analysis," Journal of Economic Behavior & Organization, Elsevier, vol. 125(C), pages 1-21.
    20. Andreas Billmeier & Tommaso Nannicini, 2013. "Assessing Economic Liberalization Episodes: A Synthetic Control Approach," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 983-1001, July.
    21. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    22. Eduardo Cavallo & Sebastian Galiani & Ilan Noy & Juan Pantano, 2013. "Catastrophic Natural Disasters and Economic Growth," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1549-1561, December.
    23. Benjamin Hansen & Keaton Miller & Caroline Weber, 2020. "Early Evidence On Recreational Marijuana Legalization And Traffic Fatalities," Economic Inquiry, Western Economic Association International, vol. 58(2), pages 547-568, April.
    24. Campos, Nauro F. & Coricelli, Fabrizio & Moretti, Luigi, 2019. "Institutional integration and economic growth in Europe," Journal of Monetary Economics, Elsevier, vol. 103(C), pages 88-104.
    25. Joshua C. Hall & Josh Matti & Yang Zhou, 2020. "The economic impact of city–county consolidations: a synthetic control approach," Public Choice, Springer, vol. 184(1), pages 43-77, July.
    26. Benjamin Born & Alexander M Dietrich & Gernot J Müller, 2021. "The lockdown effect: A counterfactual for Sweden," PLOS ONE, Public Library of Science, vol. 16(4), pages 1-13, April.
    27. Henrik Jacobsen Kleven & Camille Landais & Emmanuel Saez, 2013. "Taxation and International Migration of Superstars: Evidence from the European Football Market," American Economic Review, American Economic Association, vol. 103(5), pages 1892-1924, August.
    28. Xiang, Di & Lawley, Chad, 2019. "The impact of British Columbia's carbon tax on residential natural gas consumption," Energy Economics, Elsevier, vol. 80(C), pages 206-218.
    29. Joshua D. Angrist & Jörn-Steffen Pischke, 2015. "The path from cause to effect: mastering 'metrics," CentrePiece - The magazine for economic performance 442, Centre for Economic Performance, LSE.
    30. Saia, Alessandro, 2017. "Choosing the open sea: The cost to the UK of staying out of the euro," Journal of International Economics, Elsevier, vol. 108(C), pages 82-98.
    31. Andrew I. Friedson & Drew McNichols & Joseph J. Sabia & Dhaval Dave, 2020. "Did California’s Shelter-in-Place Order Work? Early Coronavirus-Related Public Health Effects," NBER Working Papers 26992, National Bureau of Economic Research, Inc.
    32. Benjamin Born & Gernot J. Müller & Moritz Schularick & Petr Sedláček, 2021. "The macroeconomic impact of Trump," Policy Studies, Taylor & Francis Journals, vol. 42(5-6), pages 580-591, November.
    33. Absher, Samuel & Grier, Kevin & Grier, Robin, 2020. "The economic consequences of durable left-populist regimes in Latin America," Journal of Economic Behavior & Organization, Elsevier, vol. 177(C), pages 787-817.
    34. Sang-Wook (Stanley) Cho, 2020. "Quantifying the impact of nonpharmaceutical interventions during the COVID-19 outbreak: The case of Sweden," The Econometrics Journal, Royal Economic Society, vol. 23(3), pages 323-344.
    35. Tommaso Nannicini & Andreas Billmeier, 2011. "Economies in Transition: How Important Is Trade Openness for Growth?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 73(3), pages 287-314, June.
    36. Maamoun, Nada, 2019. "The Kyoto protocol: Empirical evidence of a hidden success," Journal of Environmental Economics and Management, Elsevier, vol. 95(C), pages 227-256.
    37. Félix, Sónia & Portugal, Pedro & Tavares, Ana, 2017. "Going after the Addiction, Not the Addicted: The Impact of Drug Decriminalization in Portugal," IZA Discussion Papers 10895, Institute of Labor Economics (IZA).
    38. repec:wly:soecon:v:83:2:y:2016:p:437-463 is not listed on IDEAS
    39. Paolo Pinotti, 2015. "The Economic Costs of Organised Crime: Evidence from Southern Italy," Economic Journal, Royal Economic Society, vol. 125(586), pages 203-232, August.
    40. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    41. Daniel S. Grossman & David J.G. Slusky, 2019. "The Impact of the Flint Water Crisis on Fertility," Demography, Springer;Population Association of America (PAA), vol. 56(6), pages 2005-2031, December.
    42. Kaul, Ashok & Klößner, Stefan & Pfeifer, Gregor & Schieler, Manuel, 2015. "Synthetic Control Methods: Never Use All Pre-Intervention Outcomes Together With Covariates," MPRA Paper 83790, University Library of Munich, Germany.
    43. Powell, Benjamin & Clark, J.R. & Nowrasteh, Alex, 2017. "Does mass immigration destroy institutions? 1990s Israel as a natural experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 141(C), pages 83-95.
    44. Julius J. Andersson, 2019. "Carbon Taxes and CO2 Emissions: Sweden as a Case Study," American Economic Journal: Economic Policy, American Economic Association, vol. 11(4), pages 1-30, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bilbao-Goyoaga, Eugenia, 2023. "Perceptions Matter: Quasi-Experimental Evidence on the Effects of Minimum Income on Objective and Subjective Financial Wellbeing in Spain," SocArXiv wv7xt, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pier Basaglia & Sophie M. Behr & Moritz A. Drupp, 2023. "De-Fueling Externalities: How Tax Salience and Fuel Substitution Mediate Climate and Health Benefits," Discussion Papers of DIW Berlin 2041, DIW Berlin, German Institute for Economic Research.
    2. Pier Basaglia & Sophie M. Behr & Moritz A. Drupp, 2023. "De-Fueling Externalities: Causal Effects of Fuel Taxation and Mediating Mechanisms for Reducing Climate and Pollution Costs," CESifo Working Paper Series 10508, CESifo.
    3. David Powell, 2016. "Synthetic Control Estimation Beyond Case Studies Does the Minimum Wage Reduce Employment?," Working Papers WR-1142, RAND Corporation.
    4. Samuel Verevis & Murat Üngör, 2021. "What has New Zealand gained from The FTA with China?: Two counterfactual analyses†," Scottish Journal of Political Economy, Scottish Economic Society, vol. 68(1), pages 20-50, February.
    5. Bruno Ferman & Cristine Pinto & Vitor Possebom, 2020. "Cherry Picking with Synthetic Controls," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 510-532, March.
    6. Giulio Grossi & Marco Mariani & Alessandra Mattei & Patrizia Lattarulo & Ozge Oner, 2020. "Direct and spillover effects of a new tramway line on the commercial vitality of peripheral streets. A synthetic-control approach," Papers 2004.05027, arXiv.org, revised Nov 2023.
    7. Robbert Maseland & Rok Spruk, 2023. "The benefits of US statehood: an analysis of the growth effects of joining the USA," Cliometrica, Springer;Cliometric Society (Association Francaise de Cliométrie), vol. 17(1), pages 49-89, January.
    8. David Gilchrist & Thomas Emery & Nuno Garoupa & Rok Spruk, 2023. "Synthetic Control Method: A tool for comparative case studies in economic history," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 409-445, April.
    9. Demirci, Murat, 2023. "Youth responses to political populism: Education abroad as a step toward emigration," Journal of Comparative Economics, Elsevier, vol. 51(2), pages 653-673.
    10. Billy, Alexander & Packard, Michael, 2022. "Crime and the Mariel Boatlift," International Review of Law and Economics, Elsevier, vol. 72(C).
    11. Kerianne Lawson, 2023. "Using property rights to fight crime: the Khaya Lam project," Journal of Economics and Finance, Springer;Academy of Economics and Finance, vol. 47(2), pages 269-302, June.
    12. Niklas Potrafke & Fabian Ruthardt & Kaspar Wuthrich, 2020. "Protectionism and economic growth: Causal evidence from the first era of globalization," Papers 2010.02378, arXiv.org, revised Mar 2022.
    13. Cummins Joseph & Miller Douglas L. & Smith Brock & Simon David, 2024. "Matching on Noise: Finite Sample Bias in the Synthetic Control Estimator," Journal of Econometric Methods, De Gruyter, vol. 13(1), pages 67-95, January.
    14. Tomasz Serwach, 2022. "The European Union and within-country income inequalities. The case of the New Member States," Working Papers hal-03548416, HAL.
    15. Roy Cerqueti & Raffaella Coppier & Alessandro Girardi & Marco Ventura, 2022. "The sooner the better: lives saved by the lockdown during the COVID-19 outbreak. The case of Italy," The Econometrics Journal, Royal Economic Society, vol. 25(1), pages 46-70.
    16. Maïmouna Diakite & Jean-François Brun & Souleymane Diarra & Nasser Ary Tanimoune, 2017. "The effects of tax coordination on the tax revenue mobilization in West African Economic and Monetary Union (WAEMU)," CERDI Working papers halshs-01535104, HAL.
    17. Kaul, Ashok & Klößner, Stefan & Pfeifer, Gregor & Schieler, Manuel, 2015. "Synthetic Control Methods: Never Use All Pre-Intervention Outcomes Together With Covariates," MPRA Paper 83790, University Library of Munich, Germany.
    18. Ana Venâncio & João Pereira dos Santos, 2021. "The effect of Brexit on British workers living in the EU," Working Papers REM 2021/0197, ISEG - Lisbon School of Economics and Management, REM, Universidade de Lisboa.
    19. Juan S. Mora‐Sanguinetti & Rok Spruk, 2023. "Economic effects of recent experiences of federalism: Analysis of the regionalization process in Spain," Journal of Regional Science, Wiley Blackwell, vol. 63(1), pages 30-63, January.
    20. Lili Yao & J. Brandon Bolen & Claudia R. Williamson, 2021. "The effect of mass legalization on US state-level institutions: Evidence from the immigration reform and control act," Public Choice, Springer, vol. 189(3), pages 427-463, December.

    More about this item

    Keywords

    synthetic control method; applied econometrics; policy evaluation;
    All these keywords.

    JEL classification:

    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • A1 - General Economics and Teaching - - General Economics
    • A2 - General Economics and Teaching - - Economic Education and Teaching of Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:amerec:v:67:y:2022:i:1:p:46-63. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: http://journals.sagepub.com/home/aex .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.