IDEAS home Printed from https://ideas.repec.org/a/eee/joecas/v28y2023ics1703494923000348.html
   My bibliography  Save this article

Analysing financial stability reports as crisis predictors with the use of text-mining

Author

Listed:
  • Kurowski, Łukasz
  • Smaga, Paweł

Abstract

Central bank analyses and external communication play an important role in maintaining its credibility, as well as effectiveness of monetary and macroprudential policies. A financial stability report is one of the main channels of communication between central banks and the financial market. The aim of the study is to verify whether the linguistic content of those reports contains early warning signals of an upcoming financial crisis. We carefully select 848 words related to Early Warning Indicators and examine whether their appearance in the 604 financial stability reports published by 18 central banks could have indicated an impending global financial crisis (2007+). We use the novel approach of joint application of text-mining and the concept of receiver operating characteristic curve to compare the frequency of selected words before and after the global financial crisis. According to the results, the linguistic content of financial stability reports does not emit any early warning signals (except for the single case of the Central Bank of Iceland). On the one hand, this may indicate potential weaknesses in the quality of analyses in those reports, but on the other hand, it may show a central bank's deliberate avoidance of actions prompting negative effects of a ‘self-fulfilling prophecy’.

Suggested Citation

  • Kurowski, Łukasz & Smaga, Paweł, 2023. "Analysing financial stability reports as crisis predictors with the use of text-mining," The Journal of Economic Asymmetries, Elsevier, vol. 28(C).
  • Handle: RePEc:eee:joecas:v:28:y:2023:i:c:s1703494923000348
    DOI: 10.1016/j.jeca.2023.e00322
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1703494923000348
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeca.2023.e00322?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Qingyu Du & Wei Wang, 2021. "Financial Crisis Early Warning Based on Panel Data and Dynamic Dual Choice Model," Complexity, Hindawi, vol. 2021, pages 1-10, April.
    2. Nyman, Rickard & Kapadia, Sujit & Tuckett, David, 2021. "News and narratives in financial systems: Exploiting big data for systemic risk assessment," Journal of Economic Dynamics and Control, Elsevier, vol. 127(C).
    3. Cindy K Soo, 2018. "Quantifying Sentiment with News Media across Local Housing Markets," The Review of Financial Studies, Society for Financial Studies, vol. 31(10), pages 3689-3719.
    4. Jonathan Benchimol & Sophia Kazinnik & Yossi Saadon, 2021. "Federal Reserve Communication and the COVID-19 Pandemic," Bank of Israel Working Papers 2021.15, Bank of Israel.
    5. Theologos Dergiades & Costas Milas & Theodore Panagiotidis, 2015. "Tweets, Google trends, and sovereign spreads in the GIIPS," Oxford Economic Papers, Oxford University Press, vol. 67(2), pages 406-432.
    6. Beaupain, Renaud & Girard, Alexandre, 2020. "The value of understanding central bank communication," Economic Modelling, Elsevier, vol. 85(C), pages 154-165.
    7. Ernest Aigner & Matthias Aistleitner & Florentin Glotzl & Jakob Kapeller, 2018. "The Focus of Academic Economics: Before and After the Crisis," Working Papers Series 75, Institute for New Economic Thinking.
    8. de Haan, Jakob & Eijffinger, Sylvester C.W. & Rybinski, Krzysztof, 2007. "Central bank transparency and central bank communication: Editorial introduction," European Journal of Political Economy, Elsevier, vol. 23(1), pages 1-8, March.
    9. Scott Hendry & Alison Madeley, 2010. "Text Mining and the Information Content of Bank of Canada Communications," Staff Working Papers 10-31, Bank of Canada.
    10. Anastasios Petropoulos & Vasilis Siakoulis, 2021. "Can central bank speeches predict financial market turbulence? Evidence from an adaptive NLP sentiment index analysis using XGBoost machine learning technique," Central Bank Review, Research and Monetary Policy Department, Central Bank of the Republic of Turkey, vol. 21(4), pages 141-153.
    11. Luc Laeven & Fabian Valencia, 2020. "Systemic Banking Crises Database II," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 68(2), pages 307-361, June.
    12. Iwanicz-Drozdowska Małgorzata & Kurowski Łukasz, 2021. "Keep your friends close and your enemies closer – the case of monetary policy and financial imbalances," German Economic Review, De Gruyter, vol. 22(4), pages 383-414, November.
    13. Jon Christensson & Kenneth Spong & Jim Wilkinson, 2011. "What can financial stability reports tell us about macroprudential supervision?," Research Working Paper RWP 11-15, Federal Reserve Bank of Kansas City.
    14. Hansen, Stephen & McMahon, Michael, 2016. "Shocking language: Understanding the macroeconomic effects of central bank communication," Journal of International Economics, Elsevier, vol. 99(S1), pages 114-133.
    15. Adriana Breaban & Charles N Noussair, 2018. "Emotional State and Market Behavior [Bubbling with excitement: en experiment]," Review of Finance, European Finance Association, vol. 22(1), pages 279-309.
    16. Mr. Martin Cihak, 2006. "How Do Central Banks Writeon Financial Stability?," IMF Working Papers 2006/163, International Monetary Fund.
    17. Oosterloo, Sander & de Haan, Jakob & Jong-A-Pin, Richard, 2007. "Financial stability reviews: A first empirical analysis," Journal of Financial Stability, Elsevier, vol. 2(4), pages 337-355, March.
    18. David Bholat & Stephen Hans & Pedro Santos & Cheryl Schonhardt-Bailey, 2015. "Text mining for central banks," Handbooks, Centre for Central Banking Studies, Bank of England, number 33, April.
    19. Levy, Daniel & Mayer, Tamir & Raviv, Alon, 2022. "Economists in the 2008 financial crisis: Slow to see, fast to act," Journal of Financial Stability, Elsevier, vol. 60(C).
    20. Ricardo Correa & Keshav Garud & Juan M Londono & Nathan Mislang, 2021. "Sentiment in Central Banks’ Financial Stability Reports," Review of Finance, European Finance Association, vol. 25(1), pages 85-120.
    21. Costas Milas & Theodore Panagiotidis & Theologos Dergiades, 2021. "Does It Matter Where You Search? Twitter versus Traditional News Media," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 53(7), pages 1757-1795, October.
    22. Benjamin Born & Michael Ehrmann & Marcel Fratzscher, 2011. "How Should Central Banks Deal with a Financial Stability Objective? The Evolving Role of Communication as a Policy Instrument," Chapters, in: Sylvester Eijffinger & Donato Masciandaro (ed.), Handbook of Central Banking, Financial Regulation and Supervision, chapter 9, Edward Elgar Publishing.
    23. Mathias Drehmann & James Yetman, 2021. "Which Credit Gap Is Better at Predicting Financial Crises? A Comparison of Univariate Filters," International Journal of Central Banking, International Journal of Central Banking, vol. 17(70), pages 1-31, October.
    24. Benjamin Born & Michael Ehrmann & Marcel Fratzscher, 2014. "Central Bank Communication on Financial Stability," Economic Journal, Royal Economic Society, vol. 124(577), pages 701-734, June.
    25. Lars E. O. Svensson, 2002. "Monetary policy and real stabilization," Proceedings - Economic Policy Symposium - Jackson Hole, Federal Reserve Bank of Kansas City, pages 261-312.
    26. Markus Holopainen & Peter Sarlin, 2017. "Toward robust early-warning models: a horse race, ensembles and model uncertainty," Quantitative Finance, Taylor & Francis Journals, vol. 17(12), pages 1933-1963, December.
    27. Aaryan Gupta & Vinya Dengre & Hamza Abubakar Kheruwala & Manan Shah, 2020. "Comprehensive review of text-mining applications in finance," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 6(1), pages 1-25, December.
    28. Filippopoulou, Chryssanthi & Galariotis, Emilios & Spyrou, Spyros, 2020. "An early warning system for predicting systemic banking crises in the Eurozone: A logit regression approach," Journal of Economic Behavior & Organization, Elsevier, vol. 172(C), pages 344-363.
    29. Benjamin Born & Michael Ehrmann & Marcel Fratzscher, 2012. "Communicating About Macro-prudential Supervision – A New Challenge for Central Banks," International Finance, Wiley Blackwell, vol. 15(2), pages 179-203, June.
    30. Jansen, David-Jan & De Haan, Jakob, 2005. "Talking heads: the effects of ECB statements on the euro-dollar exchange rate," Journal of International Money and Finance, Elsevier, vol. 24(2), pages 343-361, March.
    31. Magnus Hansson, 2021. "Evolution of topics in central bank speech communication," Papers 2109.10058, arXiv.org.
    32. Alegría, Andrés & Alfaro, Rodrigo & Córdova, Felipe, 2021. "The effect of warnings published in a financial stability report on loan-to-value ratios," Latin American Journal of Central Banking (previously Monetaria), Elsevier, vol. 2(4).
    33. Tanaka, Katsuyuki & Kinkyo, Takuji & Hamori, Shigeyuki, 2016. "Random forests-based early warning system for bank failures," Economics Letters, Elsevier, vol. 148(C), pages 118-121.
    34. David O. Lucca & Francesco Trebbi, 2009. "Measuring Central Bank Communication: An Automated Approach with Application to FOMC Statements," NBER Working Papers 15367, National Bureau of Economic Research, Inc.
    35. Hailiang Chen & Prabuddha De & Yu (Jeffrey) Hu & Byoung-Hyoun Hwang, 2014. "Wisdom of Crowds: The Value of Stock Opinions Transmitted Through Social Media," The Review of Financial Studies, Society for Financial Studies, vol. 27(5), pages 1367-1403.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Donato Masciandaro & Davide Romelli & Gaia Rubera, 2021. "Monetary policy and financial markets: evidence from Twitter traffic," BAFFI CAREFIN Working Papers 21160, BAFFI CAREFIN, Centre for Applied Research on International Markets Banking Finance and Regulation, Universita' Bocconi, Milano, Italy.
    2. Donato Masciandaro & Davide Romelli & Gaia Rubera, 2020. "Tweeting on Monetary Policy and Market Sentiments: The Central Bank Surprise Index," BAFFI CAREFIN Working Papers 20134, BAFFI CAREFIN, Centre for Applied Research on International Markets Banking Finance and Regulation, Universita' Bocconi, Milano, Italy.
    3. Beutel, Johannes & Metiu, Norbert & Stockerl, Valentin, 2021. "Toothless tiger with claws? Financial stability communication, expectations, and risk-taking," Journal of Monetary Economics, Elsevier, vol. 120(C), pages 53-69.
    4. Fraccaroli, Nicolò & Giovannini, Alessandro & Jamet, Jean-François & Persson, Eric, 2022. "Ideology and monetary policy. The role of political parties’ stances in the European Central Bank’s parliamentary hearings," European Journal of Political Economy, Elsevier, vol. 74(C).
    5. Youngjoon Lee & Soohyon Kim & Ki Young Park, 2018. "Deciphering Monetary Policy Committee Minutes with Text Mining Approach: A Case of South Korea," Working papers 2018rwp-132, Yonsei University, Yonsei Economics Research Institute.
    6. Du, Xiuli & Cheng, Jinfeng & Zhu, Degao & Xing, Mengyue, 2023. "Does central bank communication on financial stability work? ——An empirical study based on Chinese stock market," International Review of Economics & Finance, Elsevier, vol. 85(C), pages 390-407.
    7. Ricardo Correa & Keshav Garud & Juan M Londono & Nathan Mislang, 2021. "Sentiment in Central Banks’ Financial Stability Reports," Review of Finance, European Finance Association, vol. 25(1), pages 85-120.
    8. Jianhao Lin & Jiacheng Fan & Yifan Zhang & Liangyuan Chen, 2023. "Real‐time macroeconomic projection using narrative central bank communication," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(2), pages 202-221, March.
    9. Nicolò Fraccaroli & Alessandro Giovannini & Jean-François Jamet & Eric Persson, 2023. "Central Banks in Parliaments: A Text Analysis of the Parliamentary Hearings of the Bank of England, the European Central Bank, and the Federal Reserve," International Journal of Central Banking, International Journal of Central Banking, vol. 19(2), pages 543-600, June.
    10. Angelo M. Fasolo & Flávia M. Graminho & Saulo B. Bastos, 2021. "Seeing the Forest for the Trees: using hLDA models to evaluate communication in Banco Central do Brasil," Working Papers Series 555, Central Bank of Brazil, Research Department.
    11. Jochen Lüdering & Peter Tillmann, 2016. "Monetary Policy on Twitter and its Effect on Asset Prices: Evidence from Computational Text Analysis," MAGKS Papers on Economics 201612, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    12. Benjamin Born & Michael Ehrmann & Marcel Fratzscher, 2011. "Macroprudential policy and central bank communication," BIS Papers chapters, in: Bank for International Settlements (ed.), Macroprudential regulation and policy, volume 60, pages 107-110, Bank for International Settlements.
    13. Lin, Jianhao & Mei, Ziwei & Chen, Liangyuan & Zhu, Chuanqi, 2023. "Is the People's Bank of China consistent in words and deeds?," China Economic Review, Elsevier, vol. 78(C).
    14. Fraccaroli, Nicolò & Giovannini, Alessandro & Jamet, Jean-Francois & Persson, Eric, 2022. "Ideology and monetary policy: the role of political parties’ stances in the ECB’s parliamentary hearings," Working Paper Series 2655, European Central Bank.
    15. Donato Masciandaro & Oana Peia & Davide Romelli, 2024. "Central bank communication and social media: From silence to Twitter," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 365-388, April.
    16. Justyna Klejdysz & Robin L. Lumsdaine, 2023. "Shifts in ECB Communication: A Textual Analysis of the Press Conference," International Journal of Central Banking, International Journal of Central Banking, vol. 19(2), pages 473-542, June.
    17. Lüdering, Jochen & Tillmann, Peter, 2020. "Monetary policy on twitter and asset prices: Evidence from computational text analysis," The North American Journal of Economics and Finance, Elsevier, vol. 51(C).
    18. Kawamura, Kohei & Kobashi, Yohei & Shizume, Masato & Ueda, Kozo, 2019. "Strategic central bank communication: Discourse analysis of the Bank of Japan’s Monthly Report," Journal of Economic Dynamics and Control, Elsevier, vol. 100(C), pages 230-250.
    19. Stijn Claessens & Ricardo Correa & Juan M. Londono, 2021. "Financial Stability Governance and Central Bank Communications," International Finance Discussion Papers 1328, Board of Governors of the Federal Reserve System (U.S.).
    20. Cheng Hoon Lim & Alexander D. Klemm & Sumiko Ogawa & Marco Pani & Claudio Visconti, 2019. "Financial Stability Reports in Latin America and the Caribbean," Journal of Banking and Financial Economics, University of Warsaw, Faculty of Management, vol. 1(11), pages 46-78, January.

    More about this item

    Keywords

    Financial stability; Text-mining; Communication; Early warning signal; Crisis; Central bank;
    All these keywords.

    JEL classification:

    • E50 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - General
    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies
    • E61 - Macroeconomics and Monetary Economics - - Macroeconomic Policy, Macroeconomic Aspects of Public Finance, and General Outlook - - - Policy Objectives; Policy Designs and Consistency; Policy Coordination
    • G01 - Financial Economics - - General - - - Financial Crises

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:joecas:v:28:y:2023:i:c:s1703494923000348. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/the-journal-of-economic-asymmetries/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.