IDEAS home Printed from https://ideas.repec.org/a/bis/bisqtr/0912e.html
   My bibliography  Save this article

Macro stress tests and crises: what can we learn?

Author

Listed:
  • Rodrigo Alfaro
  • Mathias Drehmann

Abstract

Few, if any, of the macro stress tests undertaken before the current crisis uncovered significant vulnerabilities. This article examines the reasons for the poor performance by comparing the outcomes of simple stress tests with actual events for a large sample of historical banking crises. The results highlight that the structural assumptions underlying stress testing models do not match output growth around many crises. Furthermore, unless macro conditions are already weak prior to the eruption of the crisis, the vast majority of stress scenarios based on historical data are not severe enough. Last, stress testing models are not robust, as statistical relationships tend to break down during crises. These insights have important implications for the design and conduct of stress tests in the future.

Suggested Citation

  • Rodrigo Alfaro & Mathias Drehmann, 2009. "Macro stress tests and crises: what can we learn?," BIS Quarterly Review, Bank for International Settlements, December.
    • Handle: RePEc:bis:bisqtr:0912e
    as

    Download full text from publisher

    File URL: http://www.bis.org/publ/qtrpdf/r_qt0912e.pdf
    Download Restriction: no
    File URL: http://www.bis.org/publ/qtrpdf/r_qt0912e.htm
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Claudio Borio & Mathias Drehmann, 2011. "Toward an Operational Framework for Financial Stability: “Fuzzy” Measurement and Its Consequences," Central Banking, Analysis, and Economic Policies Book Series, in: Rodrigo Alfaro (ed.),Financial Stability, Monetary Policy, and Central Banking, edition 1, volume 15, chapter 4, pages 063-123, Central Bank of Chile.
    2. Douglas W. Diamond & Philip H. Dybvig, 2000. "Bank runs, deposit insurance, and liquidity," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 24(Win), pages 14-23.
    3. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521634809, January.
    4. Gorton, Gary, 1988. "Banking Panics and Business Cycles," Oxford Economic Papers, Oxford University Press, vol. 40(4), pages 751-781, December.
    5. Quagliariello,Mario (ed.), 2009. "Stress-testing the Banking System," Cambridge Books, Cambridge University Press, number 9780521767309, November.
    6. Reinhart, Carmen M. & Rogoff, Kenneth S., 2013. "Banking crises: An equal opportunity menace," Journal of Banking & Finance, Elsevier, vol. 37(11), pages 4557-4573.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Claudio Borio & Mathias Drehmann, 2011. "Toward an Operational Framework for Financial Stability: “Fuzzy” Measurement and Its Consequences," Central Banking, Analysis, and Economic Policies Book Series, in: Rodrigo Alfaro (ed.),Financial Stability, Monetary Policy, and Central Banking, edition 1, volume 15, chapter 4, pages 063-123, Central Bank of Chile.
    2. Ebrahimi Kahou, Mahdi & Lehar, Alfred, 2017. "Macroprudential policy: A review," Journal of Financial Stability, Elsevier, vol. 29(C), pages 92-105.
    3. Ryo Kato & Takayuki Tsuruga, 2022. "Pecuniary externalities, bank overleverage, and macroeconomic fragility," International Journal of Economic Theory, The International Society for Economic Theory, vol. 18(4), pages 554-577, December.
    4. Xavier Vives, 2011. "Competition and Stability in Banking," Central Banking, Analysis, and Economic Policies Book Series, in: Luis Felipe Céspedes & Roberto Chang & Diego Saravia (ed.),Monetary Policy under Financial Turbulence, edition 1, volume 16, chapter 12, pages 455-502, Central Bank of Chile.
    5. Paolo Di Caro & Giuseppe Pernagallo & Antonino Damiano Rossello & Benedetto Torrisi, 2019. "Empirical facts characterizing banking crises: an analysis via binary time series," Papers 1904.12526, arXiv.org.
    6. Chris Hunt, 2009. "Banking crises in New Zealand - an historical perspective," Reserve Bank of New Zealand Bulletin, Reserve Bank of New Zealand, vol. 72, pages 26-41, December.
    7. Bitetto, Alessandro & Cerchiello, Paola & Mertzanis, Charilaos, 2023. "Measuring financial soundness around the world: A machine learning approach," International Review of Financial Analysis, Elsevier, vol. 85(C).
    8. Gary B. Gorton, 2019. "The Regulation of Private Money," NBER Working Papers 25891, National Bureau of Economic Research, Inc.
    9. Gabriele Galati & Richhild Moessner, 2018. "What Do We Know About the Effects of Macroprudential Policy?," Economica, London School of Economics and Political Science, vol. 85(340), pages 735-770, October.
    10. Gary B. Gorton, 2012. "Some Reflections on the Recent Financial Crisis," NBER Working Papers 18397, National Bureau of Economic Research, Inc.
    11. Hamdaoui, Mekki, 2016. "Are systemic banking crises in developed and developing countries predictable?," Journal of Multinational Financial Management, Elsevier, vol. 37, pages 114-138.
    12. Oriol Carreras & E Philip Davis & Rebecca Piggott, 2016. "Macroprudential tools, transmission and modelling," National Institute of Economic and Social Research (NIESR) Discussion Papers 470, National Institute of Economic and Social Research.
    13. Kauko, Karlo, 2014. "How to foresee banking crises? A survey of the empirical literature," Economic Systems, Elsevier, vol. 38(3), pages 289-308.
    14. Michiel Bijlsma & Wouter Elsenburg & Michiel van Leuvensteijn, 2010. "Four Futures for Finance; A scenario study," CPB Document 211.rdf, CPB Netherlands Bureau for Economic Policy Analysis.
    15. Goedde-Menke, Michael & Langer, Thomas & Pfingsten, Andreas, 2014. "Impact of the financial crisis on bank run risk – Danger of the days after," Journal of Banking & Finance, Elsevier, vol. 40(C), pages 522-533.
    16. Hubert Janos Kiss & Ismael Rodriguez‐Lara & Alfonso Rosa‐García, 2012. "On the Effects of Deposit Insurance and Observability on Bank Runs: An Experimental Study," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 44(8), pages 1651-1665, December.
    17. Chanelle Duley & Prasanna Gai, 2020. "When the penny doesn't drop - Macroeconomic tail risk and currency crises," National Institute of Economic and Social Research (NIESR) Discussion Papers 520, National Institute of Economic and Social Research.
    18. Stijn Claessens & M. Ayhan Kose, 2013. "Financial Crises: Explanations, Types and Implications," CAMA Working Papers 2013-06, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    19. Chen, Qi & Goldstein, Itay & Jiang, Wei, 2010. "Payoff complementarities and financial fragility: Evidence from mutual fund outflows," Journal of Financial Economics, Elsevier, vol. 97(2), pages 239-262, August.
    20. Carletti, Elena & De Marco, Filippo & Ioannidou, Vasso & Sette, Enrico, 2021. "Banks as patient lenders: Evidence from a tax reform," Journal of Financial Economics, Elsevier, vol. 141(1), pages 6-26.

    More about this item

    JEL classification:

    • E44 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Financial Markets and the Macroeconomy
    • G01 - Financial Economics - - General - - - Financial Crises
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bis:bisqtr:0912e. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Martin Fessler (email available below). General contact details of provider: https://edirc.repec.org/data/bisssch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.