IDEAS home Printed from https://ideas.repec.org/a/eee/jbfina/v154y2023ics037842662300167x.html
   My bibliography  Save this article

Consistency of banks' internal probability of default estimates: Empirical evidence from the COVID-19 crisis

Author

Listed:
  • Stepankova, Barbora
  • Teply, Petr

Abstract

The Basel III post-crisis reforms target the application of internal credit risk models for the estimation of the risk weighted assets of banks due to concerns about model risk. We use a unique dataset of 4.9 million probability of default (PD) estimates covering the January 2016 - June 2020 period sourced from 28 global banks to provide a deep insight into the comparability of model outputs. Our contribution is four-fold. Firstly, we confirm that there is a substantial variance in credit risk estimates. Secondly, we show that the level of PD variance is dependent on the entity type, industry, and location. Thirdly, we conclude that a considerable part of the variance is systematic, especially for credit risk estimates of funds. Finally, we illustrate the massive impact of the COVID-19 pandemic on the PD variance. The results highlight areas with relatively larger comparability issues, and they can be used by regulators to design more targeted policies.

Suggested Citation

  • Stepankova, Barbora & Teply, Petr, 2023. "Consistency of banks' internal probability of default estimates: Empirical evidence from the COVID-19 crisis," Journal of Banking & Finance, Elsevier, vol. 154(C).
    • Handle: RePEc:eee:jbfina:v:154:y:2023:i:c:s037842662300167x
    DOI: 10.1016/j.jbankfin.2023.106969
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S037842662300167X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbankfin.2023.106969?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Nickell, Pamela & Perraudin, William & Varotto, Simone, 2000. "Stability of rating transitions," Journal of Banking & Finance, Elsevier, vol. 24(1-2), pages 203-227, January.
    2. Mariathasan, Mike & Merrouche, Ouarda, 2014. "The manipulation of basel risk-weights," Journal of Financial Intermediation, Elsevier, vol. 23(3), pages 300-321.
    3. Cummings, James R. & Durrani, Kassim J., 2016. "Effect of the Basel Accord capital requirements on the loan-loss provisioning practices of Australian banks," Journal of Banking & Finance, Elsevier, vol. 67(C), pages 23-36.
    4. Danielsson, Jon & James, Kevin R. & Valenzuela, Marcela & Zer, Ilknur, 2016. "Model risk of risk models," Journal of Financial Stability, Elsevier, vol. 23(C), pages 79-91.
    5. Andrew G. Haldane & Vasileios Madouros, 2012. "The dog and the frisbee," Proceedings - Economic Policy Symposium - Jackson Hole, Federal Reserve Bank of Kansas City, pages 109-159.
    6. Boucher, Christophe M. & Daníelsson, Jón & Kouontchou, Patrick S. & Maillet, Bertrand B., 2014. "Risk models-at-risk," Journal of Banking & Finance, Elsevier, vol. 44(C), pages 72-92.
    7. Markus Behn & Rainer Haselmann & Vikrant Vig, 2022. "The Limits of Model‐Based Regulation," Journal of Finance, American Finance Association, vol. 77(3), pages 1635-1684, June.
    8. Cucinelli, Doriana & Battista, Maria Luisa Di & Marchese, Malvina & Nieri, Laura, 2018. "Credit risk in European banks: The bright side of the internal ratings based approach," Journal of Banking & Finance, Elsevier, vol. 93(C), pages 213-229.
    9. Paul Glasserman & Xingbo Xu, 2014. "Robust risk measurement and model risk," Quantitative Finance, Taylor & Francis Journals, vol. 14(1), pages 29-58, January.
    10. Jacobson, Tor & Linde, Jesper & Roszbach, Kasper, 2006. "Internal ratings systems, implied credit risk and the consistency of banks' risk classification policies," Journal of Banking & Finance, Elsevier, vol. 30(7), pages 1899-1926, July.
    11. Ms. Sofiya Avramova & Mrs. Vanessa Le Lesle, 2012. "Revisiting Risk-Weighted Assets," IMF Working Papers 2012/090, International Monetary Fund.
    12. Telg, Sean & Dubinova, Anna & Lucas, Andre, 2023. "Covid-19, credit risk management modeling, and government support," Journal of Banking & Finance, Elsevier, vol. 147(C).
    13. Yuhong Xu, 2014. "Robust valuation and risk measurement under model uncertainty," Papers 1407.8024, arXiv.org.
    14. Pérez Montes, Carlos & Trucharte Artigas, Carlos & Cristófoli, María Elizabeth & Lavín San Segundo, Nadia, 2018. "The impact of the IRB approach on the risk weights of European banks," Journal of Financial Stability, Elsevier, vol. 39(C), pages 147-166.
    15. Taylor A. Begley & Amiyatosh Purnanandam & Kuncheng Zheng, 2017. "The Strategic Underreporting of Bank Risk," The Review of Financial Studies, Society for Financial Studies, vol. 30(10), pages 3376-3415.
    16. repec:ces:ifodic:v:8:y:2010:i:2:p:14566986 is not listed on IDEAS
    17. James M. O'Brien & Pawel J. Szerszen, 2014. "An Evaluation of Bank VaR Measures for Market Risk During and Before the Financial Crisis," Finance and Economics Discussion Series 2014-21, Board of Governors of the Federal Reserve System (U.S.).
    18. Frydman, Halina & Schuermann, Til, 2008. "Credit rating dynamics and Markov mixture models," Journal of Banking & Finance, Elsevier, vol. 32(6), pages 1062-1075, June.
    19. Brunella Bruno & Giacomo Nocera & Andrea Resti, 2015. "The credibility of European banks’ risk-weighted capital: structural differences or national segmentations?," BAFFI CAREFIN Working Papers 1509, BAFFI CAREFIN, Centre for Applied Research on International Markets Banking Finance and Regulation, Universita' Bocconi, Milano, Italy.
    20. Carol Alexander & José María Sarabia, 2012. "Quantile Uncertainty and Value‐at‐Risk Model Risk," Risk Analysis, John Wiley & Sons, vol. 32(8), pages 1293-1308, August.
    21. Ferri, Giovanni & Pesic, Valerio, 2017. "Bank regulatory arbitrage via risk weighted assets dispersion," Journal of Financial Stability, Elsevier, vol. 33(C), pages 331-345.
    22. Francesco Vallascas & Jens Hagendorff, 2013. "The Risk Sensitivity of Capital Requirements: Evidence from an International Sample of Large Banks," Review of Finance, European Finance Association, vol. 17(6), pages 1947-1988.
    23. Bian, Xun & Lin, Zhenguo & Liu, Yingchun, 2018. "House price, loan-to-value ratio and credit risk," Journal of Banking & Finance, Elsevier, vol. 92(C), pages 1-12.
    24. Matthew Plosser & João A. C. Santos, 2014. "Banks' incentives and the quality of internal risk models," Staff Reports 704, Federal Reserve Bank of New York.
    25. Merikas, Andreas & Merika, Anna & Penikas, Henry I. & Surkov, Mikhail A., 2020. "The Basel II internal ratings based (IRB) model and the transition impact on the listed Greek banks," The Journal of Economic Asymmetries, Elsevier, vol. 22(C).
    26. Livingston, Miles & Poon, Winnie P.H. & Zhou, Lei, 2018. "Are Chinese credit ratings relevant? A study of the Chinese bond market and credit rating industry," Journal of Banking & Finance, Elsevier, vol. 87(C), pages 216-232.
    27. Berg, Tobias & Koziol, Philipp, 2017. "An analysis of the consistency of banks’ internal ratings," Journal of Banking & Finance, Elsevier, vol. 78(C), pages 27-41.
    28. Liu, Cai, 2021. "The IRB model, bank regulatory arbitrage, and the Eurozone crisis," Journal of International Money and Finance, Elsevier, vol. 116(C).
    29. Martin Hellwig, 2010. "Capital Regulation after the Crisis: Business as Usual?," ifo DICE Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 8(02), pages 40-46, July.
    30. Raffaele Gallo, 2020. "The impact of the IRB approach on the relationship between the cost of credit for public companies and financial market conditions," Temi di discussione (Economic working papers) 1290, Bank of Italy, Economic Research and International Relations Area.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Merikas, Andreas & Merika, Anna & Penikas, Henry I. & Surkov, Mikhail A., 2020. "The Basel II internal ratings based (IRB) model and the transition impact on the listed Greek banks," The Journal of Economic Asymmetries, Elsevier, vol. 22(C).
    2. Cucinelli, Doriana & Battista, Maria Luisa Di & Marchese, Malvina & Nieri, Laura, 2018. "Credit risk in European banks: The bright side of the internal ratings based approach," Journal of Banking & Finance, Elsevier, vol. 93(C), pages 213-229.
    3. Böhnke, Victoria & Ongena, Steven & Paraschiv, Florentina & Reite, Endre J., 2023. "Back to the roots of internal credit risk models: Does risk explain why banks' risk-weighted asset levels converge over time?," Journal of Banking & Finance, Elsevier, vol. 156(C).
    4. Dal Borgo, Mariela, 2022. "Internal models for deposits: Effects on banks' capital and interest rate risk of assets," Journal of Banking & Finance, Elsevier, vol. 135(C).
    5. Schlam, Carina & Woyand, Corinna, 2023. "The rollout of internal credit risk models: Implications for the novel partial-use philosophy," Discussion Papers 07/2023, Deutsche Bundesbank.
    6. Markus Behn & Rainer Haselmann & Vikrant Vig, 2022. "The Limits of Model‐Based Regulation," Journal of Finance, American Finance Association, vol. 77(3), pages 1635-1684, June.
    7. Barucci, Emilio & Milani, Carlo, 2018. "Do European banks manipulate risk weights?," International Review of Financial Analysis, Elsevier, vol. 59(C), pages 47-57.
    8. Abbassi, Puriya & Schmidt, Michael, 2018. "A comprehensive view on risk reporting: Evidence from supervisory data," Journal of Financial Intermediation, Elsevier, vol. 36(C), pages 74-85.
    9. Liu, Cai, 2021. "The IRB model, bank regulatory arbitrage, and the Eurozone crisis," Journal of International Money and Finance, Elsevier, vol. 116(C).
    10. Raffaele Gallo, 2020. "The impact of the IRB approach on the relationship between the cost of credit for public companies and financial market conditions," Temi di discussione (Economic working papers) 1290, Bank of Italy, Economic Research and International Relations Area.
    11. repec:zbw:bofrdp:2018_016 is not listed on IDEAS
    12. Ferri, Giovanni & Pesic, Valerio, 2017. "Bank regulatory arbitrage via risk weighted assets dispersion," Journal of Financial Stability, Elsevier, vol. 33(C), pages 331-345.
    13. Jean-Edouard Colliard, 2019. "Strategic Selection of Risk Models and Bank Capital Regulation," Management Science, INFORMS, vol. 67(6), pages 2591-2606, June.
    14. Fritzsch, Simon & Timphus, Maike & Weiß, Gregor, 2024. "Marginals versus copulas: Which account for more model risk in multivariate risk forecasting?," Journal of Banking & Finance, Elsevier, vol. 158(C).
    15. Gehrig, Thomas & Iannino, Maria Chiara, 2021. "Did the Basel Process of capital regulation enhance the resiliency of European banks?," Journal of Financial Stability, Elsevier, vol. 55(C).
    16. Sophia Döme & Stefan Kerbl, 2017. "Comparability of Basel risk weights in the EU banking sector," Financial Stability Report, Oesterreichische Nationalbank (Austrian Central Bank), issue 34, pages 68-89.
    17. Edson Bastos e Santos & Neil Esho & Marc Farag & Christopher Zuin, 2020. "Variability in risk-weighted assets: what does the market think?," BIS Working Papers 844, Bank for International Settlements.
    18. Yu Feng & Ralph Rudd & Christopher Baker & Qaphela Mashalaba & Melusi Mavuso & Erik Schlögl, 2021. "Quantifying the Model Risk Inherent in the Calibration and Recalibration of Option Pricing Models," Risks, MDPI, vol. 9(1), pages 1-20, January.
    19. Hinterschweiger, Marc & Neumann, Tobias & Saporta, Victoria, 2018. "Risk sensitivity and risk shifting in banking regulation," Bank of England Financial Stability Papers 44, Bank of England.
    20. Niepmann, Friederike & Stebunovs, Viktors, 2018. "Modeling Your Stress Away," CEPR Discussion Papers 12624, C.E.P.R. Discussion Papers.
    21. Mohamed Albaity & Mohammadmahdi Toobaee, 2017. "The Risk-sensitivity of Bank Capital Requirements: The Moderating Effects of Capital Regulation and Supervisory Power," International Journal of Economics and Financial Issues, Econjournals, vol. 7(2), pages 94-102.

    More about this item

    Keywords

    Banking; Credit risk; Probability of default; Bank regulation; COVID-19;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • G21 - Financial Economics - - Financial Institutions and Services - - - Banks; Other Depository Institutions; Micro Finance Institutions; Mortgages
    • G32 - Financial Economics - - Corporate Finance and Governance - - - Financing Policy; Financial Risk and Risk Management; Capital and Ownership Structure; Value of Firms; Goodwill

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbfina:v:154:y:2023:i:c:s037842662300167x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbf .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.