IDEAS home Printed from https://ideas.repec.org/a/gam/jrisks/v12y2024i8p131-d1458069.html
   My bibliography  Save this article

A Hypothesis Test for the Long-Term Calibration in Rating Systems with Overlapping Time Windows

Author

Listed:
  • Patrick Kurth

    (Landesbank Baden-Württemberg, 70173 Stuttgart, Germany)

  • Max Nendel

    (Center for Mathematical Economics, Bielefeld University, 33615 Bielefeld, Germany)

  • Jan Streicher

    (Landesbank Baden-Württemberg, 70173 Stuttgart, Germany
    Center for Mathematical Economics, Bielefeld University, 33615 Bielefeld, Germany)

Abstract

We present a statistical test for the long-term calibration in rating systems that can deal with overlapping time windows as required by the guidelines of the European Banking Authority (EBA), which apply to major financial institutions in the European System. In accordance with regulation, rating systems are to be calibrated and validated with respect to the long-run default rate. The consideration of one-year default rates on a quarterly basis leads to correlation effects which drastically influence the variance of the long-run default rate. In a first step, we show that the long-run default rate is approximately normally distributed. We then perform a detailed analysis of the correlation effects caused by the overlapping time windows and solve the problem of an unknown distribution of default probabilities.

Suggested Citation

  • Patrick Kurth & Max Nendel & Jan Streicher, 2024. "A Hypothesis Test for the Long-Term Calibration in Rating Systems with Overlapping Time Windows," Risks, MDPI, vol. 12(8), pages 1-28, August.
    • Handle: RePEc:gam:jrisks:v:12:y:2024:i:8:p:131-:d:1458069
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-9091/12/8/131/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-9091/12/8/131/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sergio Caprioli & Emanuele Cagliero & Riccardo Crupi, 2023. "Quantifying Credit Portfolio sensitivity to asset correlations with interpretable generative neural networks," Papers 2309.08652, arXiv.org, revised Nov 2023.
    2. Dirk Tasche, 2003. "A traffic lights approach to PD validation," Papers cond-mat/0305038, arXiv.org.
    3. Aussenegg, Wolfgang & Resch, Florian & Winkler, Gerhard, 2011. "Pitfalls and remedies in testing the calibration quality of rating systems," Journal of Banking & Finance, Elsevier, vol. 35(3), pages 698-708, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wosnitza, Jan Henrik, 2022. "Calibration alternatives to logistic regression and their potential for transferring the dispersion of discriminatory power into uncertainties of probabilities of default," Discussion Papers 04/2022, Deutsche Bundesbank.
    2. Sauer, Stephan & Coppens, François & Mayer, Manuel & Millischer, Laurent & Resch, Florian & Schulze, Klaas, 2016. "Advances in multivariate back-testing for credit risk underestimation," Working Paper Series 1885, European Central Bank.
    3. Patrick Kurth & Max Nendel & Jan Streicher, 2023. "A hypothesis test for the long-term calibration in rating systems with overlapping time windows," Papers 2312.14765, arXiv.org.
    4. François Coppens & Fernando Gonzáles & Gerhard Winkler, 2007. "The performance of credit rating systems in the assessment of collateral used in Eurosystem monetary policy operations," Working Paper Research 118, National Bank of Belgium.
    5. Emilia ?I?AN & Adela Ioana TUDOR, 2011. "Conceptual and Statistical Issues Regarding the Probability of Default and Modeling Default Risk," Database Systems Journal, Academy of Economic Studies - Bucharest, Romania, vol. 2(1), pages 13-22, March.
    6. Natalia Nehrebecka, 2017. "Probability-of-default curve calibration and validation of internal rating systems," IFC Bulletins chapters, in: Bank for International Settlements (ed.), Statistical implications of the new financial landscape, volume 43, Bank for International Settlements.
    7. Krink, Thiemo & Paterlini, Sandra & Resti, Andrea, 2008. "The optimal structure of PD buckets," Journal of Banking & Finance, Elsevier, vol. 32(10), pages 2275-2286, October.
    8. A. R. Provenzano & D. Trifir`o & A. Datteo & L. Giada & N. Jean & A. Riciputi & G. Le Pera & M. Spadaccino & L. Massaron & C. Nordio, 2020. "Machine Learning approach for Credit Scoring," Papers 2008.01687, arXiv.org.
    9. Casellina, Simone & Pandolfo, Giuseppe & Quagliariello, Mario, 2020. "Applying the Pre-Commitment Approach to bottom-up stress tests: A new old story," Journal of Economics and Business, Elsevier, vol. 112(C).
    10. António Antunes & Homero Gonçalves & Pedro Prego, 2017. "Firm default probabilities revisited," IFC Bulletins chapters, in: Bank for International Settlements (ed.), Uses of central balance sheet data offices' information, volume 45, Bank for International Settlements.
    11. O. Didkovskyi & N. Jean & G. Le Pera & C. Nordio, 2024. "Cross-Domain Behavioral Credit Modeling: transferability from private to central data," Papers 2401.09778, arXiv.org.
    12. António Antunes & Homero Gonçalves & Pedro Prego, 2017. "Firm default probabilities revisited," IFC Bulletins chapters, in: Bank for International Settlements (ed.), Uses of central balance sheet data offices' information, volume 45, Bank for International Settlements.
    13. Natalia Nehrebecka, 2021. "COVID-19: stress-testing non-financial companies: a macroprudential perspective. The experience of Poland," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 11(2), pages 283-319, June.
    14. D Martens & T Van Gestel & M De Backer & R Haesen & J Vanthienen & B Baesens, 2010. "Credit rating prediction using Ant Colony Optimization," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(4), pages 561-573, April.
    15. Stefan Blochwitz & Marcus R. W. Martin & Carsten S. Wehn, 2006. "Statistical Approaches to PD Validation," Springer Books, in: Bernd Engelmann & Robert Rauhmeier (ed.), The Basel II Risk Parameters, chapter 0, pages 289-306, Springer.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jrisks:v:12:y:2024:i:8:p:131-:d:1458069. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.