IDEAS home Printed from https://ideas.repec.org/a/wly/jforec/v44y2025i1p3-40.html
   My bibliography  Save this article

New forecasting methods for an old problem: Predicting 147 years of systemic financial crises

Author

Listed:
  • Emile du Plessis
  • Ulrich Fritsche

Abstract

This paper develops new forecasting methods for an old and ongoing problem by employing 13 machine learning algorithms to study 147 years of systemic financial crises across 17 countries. Findings suggest that fixed capital formation is the most important variable. GDP per capita and consumer inflation have increased in prominence whereas debt‐to‐GDP, stock market, and consumption were dominant at the turn of the 20th century. A lag structure and rolling window both improve on optimized contemporaneous and individual country formats. Through a lag structure, banking sector predictors on average describe 28% of the variation in crisis prevalence, the real sector 64%, and the external sector 8%. Nearly half of all algorithms reach peak performance through a lag structure. As measured through AUC, F1 and Brier scores, top‐performing machine learning methods consistently produce high accuracy rates, with both random forests and gradient boosting in front with 77% correct forecasts, and consistently outperform traditional regression algorithms. Learning from other countries improves predictive strength, and non‐linear models generally deliver higher accuracy rates than linear models. Algorithms retaining all variables perform better than those minimizing the influence of variables.

Suggested Citation

  • Emile du Plessis & Ulrich Fritsche, 2025. "New forecasting methods for an old problem: Predicting 147 years of systemic financial crises," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 44(1), pages 3-40, January.
  • Handle: RePEc:wly:jforec:v:44:y:2025:i:1:p:3-40
    DOI: 10.1002/for.3184
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/for.3184
    Download Restriction: no

    File URL: https://libkey.io/10.1002/for.3184?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Mr. Luc Laeven & Mr. Fabian Valencia, 2010. "Resolution of Banking Crises: The Good, the Bad, and the Ugly," IMF Working Papers 2010/146, International Monetary Fund.
    2. Òscar Jordà & Moritz Schularick & Alan M. Taylor, 2017. "Macrofinancial History and the New Business Cycle Facts," NBER Macroeconomics Annual, University of Chicago Press, vol. 31(1), pages 213-263.
    3. Ms. Wenjie Chen & Mr. Mico Mrkaic & Mr. Malhar S Nabar, 2019. "The Global Economic Recovery 10 Years After the 2008 Financial Crisis," IMF Working Papers 2019/083, International Monetary Fund.
    4. Alessi, Lucia & Detken, Carsten, 2018. "Identifying excessive credit growth and leverage," Journal of Financial Stability, Elsevier, vol. 35(C), pages 215-225.
    5. Beutel, Johannes & List, Sophia & von Schweinitz, Gregor, 2018. "An evaluation of early warning models for systemic banking crises: Does machine learning improve predictions?," Discussion Papers 48/2018, Deutsche Bundesbank.
    6. Carmen M. Reinhart & Graciela L. Kaminsky, 1999. "The Twin Crises: The Causes of Banking and Balance-of-Payments Problems," American Economic Review, American Economic Association, vol. 89(3), pages 473-500, June.
    7. Bluwstein, Kristina & Buckmann, Marcus & Joseph, Andreas & Kapadia, Sujit & Şimşek, Özgür, 2023. "Credit growth, the yield curve and financial crisis prediction: Evidence from a machine learning approach," Journal of International Economics, Elsevier, vol. 145(C).
    8. Carmen M. Reinhart & Kenneth S. Rogoff, 2014. "This Time is Different: A Panoramic View of Eight Centuries of Financial Crises," Annals of Economics and Finance, Society for AEF, vol. 15(2), pages 215-268, November.
    9. Andrew Berg & Eduardo Borensztein & Catherine Pattillo, 2005. "Assessing Early Warning Systems: How Have They Worked in Practice?," IMF Staff Papers, Palgrave Macmillan, vol. 52(3), pages 1-5.
    10. Carmen M. Reinhart & Graciela L. Kaminsky, 1999. "The Twin Crises: The Causes of Banking and Balance-of-Payments Problems," American Economic Review, American Economic Association, vol. 89(3), pages 473-500, June.
    11. Funke, Manuel & Schularick, Moritz & Trebesch, Christoph, 2016. "Going to extremes: Politics after financial crises, 1870–2014," European Economic Review, Elsevier, vol. 88(C), pages 227-260.
    12. J.S. Cramer, 2002. "The Origins of Logistic Regression," Tinbergen Institute Discussion Papers 02-119/4, Tinbergen Institute.
    13. Swati R. Ghosh & Atish R. Ghosh, 2003. "Structural Vulnerabilities and Currency Crises," IMF Staff Papers, Palgrave Macmillan, vol. 50(3), pages 1-7.
    14. Casabianca, Elizabeth Jane & Catalano, Michele & Forni, Lorenzo & Giarda, Elena & Passeri, Simone, 2022. "A machine learning approach to rank the determinants of banking crises over time and across countries," Journal of International Money and Finance, Elsevier, vol. 129(C).
    15. Mr. Luc Laeven & Mr. Fabian Valencia, 2018. "Systemic Banking Crises Revisited," IMF Working Papers 2018/206, International Monetary Fund.
    16. Reinhart, Carmen & Rogoff, Kenneth, 2009. "This Time It’s Different: Eight Centuries of Financial Folly-Preface," MPRA Paper 17451, University Library of Munich, Germany.
    17. Carmen M. Reinhart & Kenneth S. Rogoff, 2009. "Varieties of Crises and Their Dates," Introductory Chapters, in: This Time Is Different: Eight Centuries of Financial Folly, Princeton University Press.
    18. Mr. Fabian Valencia & Mr. Luc Laeven, 2008. "Systemic Banking Crises: A New Database," IMF Working Papers 2008/224, International Monetary Fund.
    19. Reinhart, Carmen & Rogoff, Kenneth, 2009. "This Time It’s Different: Eight Centuries of Financial Folly-Chapter 1," MPRA Paper 17452, University Library of Munich, Germany.
    20. √Íscar Jord√Ä & Moritz Schularick & Alan M. Taylor, 2013. "When Credit Bites Back," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 45(s2), pages 3-28, December.
    21. repec:oup:ecpoli:v:16:y:2001:i:32:p:51-82 is not listed on IDEAS
    22. Felix Ward, 2017. "Spotting the Danger Zone: Forecasting Financial Crises With Classification Tree Ensembles and Many Predictors," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(2), pages 359-378, March.
    23. Emile du Plessis, 2022. "Dynamic forecasting of banking crises with a Qual VAR," Journal of Applied Economics, Taylor & Francis Journals, vol. 25(1), pages 477-503, December.
    24. Mark Joy & Marek Rusnák & Kateřina Šmídková & Bořek Vašíček, 2017. "Banking and Currency Crises: Differential Diagnostics for Developed Countries," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 22(1), pages 44-67, January.
    25. du Plessis, Emile, 2022. "Multinomial modeling methods: Predicting four decades of international banking crises," Economic Systems, Elsevier, vol. 46(2).
    26. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    27. Marcos Chamon & Paolo Manasse & Alessandro Prati, 2007. "Can We Predict the Next Capital Account Crisis?," IMF Staff Papers, Palgrave Macmillan, vol. 54(2), pages 270-305, June.
    28. Luca Benzoni & Olena Chyruk & David Kelley, 2018. "Why Does the Yield-Curve Slope Predict Recessions?," Chicago Fed Letter, Federal Reserve Bank of Chicago.
    29. Michael Bordo & Barry Eichengreen & Daniela Klingebiel & Maria Soledad Martinez-Peria, 2001. "Is the crisis problem growing more severe?," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 16(32), pages 52-82.
    30. E. Philip Davis & Dilruba Karim, 2008. "Could Early Warning Systems Have Helped To Predict the Sub-Prime Crisis?," National Institute Economic Review, National Institute of Economic and Social Research, vol. 206(1), pages 35-47, October.
    31. E. Davis & Dilruba Karim & Iana Liadze, 2011. "Should multivariate early warning systems for banking crises pool across regions?," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 147(4), pages 693-716, November.
    32. Ottar Hellevik, 2009. "Linear versus logistic regression when the dependent variable is a dichotomy," Quality & Quantity: International Journal of Methodology, Springer, vol. 43(1), pages 59-74, January.
    33. Döpke, Jörg & Fritsche, Ulrich & Pierdzioch, Christian, 2017. "Predicting recessions with boosted regression trees," International Journal of Forecasting, Elsevier, vol. 33(4), pages 745-759.
    34. Beutel, Johannes & List, Sophia & von Schweinitz, Gregor, 2019. "Does machine learning help us predict banking crises?," Journal of Financial Stability, Elsevier, vol. 45(C).
    35. Bair, Eric & Hastie, Trevor & Paul, Debashis & Tibshirani, Robert, 2006. "Prediction by Supervised Principal Components," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 119-137, March.
    36. Alessi, Lucia & Antunes, Antonio & Babecky, Jan & Baltussen, Simon & Behn, Markus & Bonfim, Diana & Bush, Oliver & Detken, Carsten & Frost, Jon & Guimaraes, Rodrigo & Havranek, Tomas & Joy, Mark & Kau, 2015. "Comparing different early warning systems: Results from a horse race competition among members of the Macro-prudential Research Network," MPRA Paper 62194, University Library of Munich, Germany.
    37. Duttagupta, Rupa & Cashin, Paul, 2011. "Anatomy of banking crises in developing and emerging market countries," Journal of International Money and Finance, Elsevier, vol. 30(2), pages 354-376, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. du Plessis, Emile, 2022. "Multinomial modeling methods: Predicting four decades of international banking crises," Economic Systems, Elsevier, vol. 46(2).
    2. Bluwstein, Kristina & Buckmann, Marcus & Joseph, Andreas & Kapadia, Sujit & Şimşek, Özgür, 2023. "Credit growth, the yield curve and financial crisis prediction: Evidence from a machine learning approach," Journal of International Economics, Elsevier, vol. 145(C).
    3. Tölö, Eero, 2020. "Predicting systemic financial crises with recurrent neural networks," Journal of Financial Stability, Elsevier, vol. 49(C).
    4. Lanbiao Liu & Chen Chen & Bo Wang, 2022. "Predicting financial crises with machine learning methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(5), pages 871-910, August.
    5. Casabianca, Elizabeth Jane & Catalano, Michele & Forni, Lorenzo & Giarda, Elena & Passeri, Simone, 2022. "A machine learning approach to rank the determinants of banking crises over time and across countries," Journal of International Money and Finance, Elsevier, vol. 129(C).
    6. Huynh, Tran & Uebelmesser, Silke, 2024. "Early warning models for systemic banking crises: Can political indicators improve prediction?," European Journal of Political Economy, Elsevier, vol. 81(C).
    7. Filippopoulou, Chryssanthi & Galariotis, Emilios & Spyrou, Spyros, 2020. "An early warning system for predicting systemic banking crises in the Eurozone: A logit regression approach," Journal of Economic Behavior & Organization, Elsevier, vol. 172(C), pages 344-363.
    8. Rakesh Padhan & K. P. Prabheesh, 2019. "Effectiveness Of Early Warning Models: A Critical Review And New Agenda For Future Direction," Bulletin of Monetary Economics and Banking, Bank Indonesia, vol. 22(4), pages 457-484, December.
    9. Kauko, Karlo, 2014. "How to foresee banking crises? A survey of the empirical literature," Economic Systems, Elsevier, vol. 38(3), pages 289-308.
    10. Alexandr Patalaha & Maria A. Shchepeleva, 2023. "Bank Crisis Management Policies and the New Instability," Finansovyj žhurnal — Financial Journal, Financial Research Institute, Moscow 125375, Russia, issue 6, pages 43-60, December.
    11. Hartwig, Benny & Meinerding, Christoph & Schüler, Yves S., 2021. "Identifying indicators of systemic risk," Journal of International Economics, Elsevier, vol. 132(C).
    12. Jon Danielsson & Marcela Valenzuela & Ilknur Zer, 2018. "Learning from History: Volatility and Financial Crises," The Review of Financial Studies, Society for Financial Studies, vol. 31(7), pages 2774-2805.
    13. Dieckelmann, Daniel, 2020. "Cross-border lending and the international transmission of banking crises," Discussion Papers 2020/13, Free University Berlin, School of Business & Economics.
    14. C. Bora Durdu & Alex Martin & Ilknur Zer, 2020. "The Role of US Monetary Policy in Banking Crises Across the World," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 68(1), pages 66-107, March.
    15. Sever, Can, 2021. "Political booms and currency crises," Journal of Macroeconomics, Elsevier, vol. 70(C).
    16. Bordo, M.D. & Meissner, C.M., 2016. "Fiscal and Financial Crises," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 355-412, Elsevier.
    17. Thanh C. Nguyen & Vítor Castro & Justine Wood, 2022. "Political environment and financial crises," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 417-438, January.
    18. Stijn Claessens & M. Ayhan Kose, 2013. "Financial Crises: Explanations, Types and Implications," CAMA Working Papers 2013-06, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    19. Bora Durdu & Alex Martin & Ilknur Zer, 2019. "The Role of U.S. Monetary Policy in Global Banking Crises," Finance and Economics Discussion Series 2019-039, Board of Governors of the Federal Reserve System (U.S.).
    20. Ellis, Scott & Sharma, Satish & Brzeszczyński, Janusz, 2022. "Systemic risk measures and regulatory challenges," Journal of Financial Stability, Elsevier, vol. 61(C).

    More about this item

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C35 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • E44 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Financial Markets and the Macroeconomy
    • G21 - Financial Economics - - Financial Institutions and Services - - - Banks; Other Depository Institutions; Micro Finance Institutions; Mortgages

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jforec:v:44:y:2025:i:1:p:3-40. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.