IDEAS home Printed from https://ideas.repec.org/p/zbw/bubdp2/2225.html
   My bibliography  Save this paper

Measuring the Discriminative Power of Rating Systems

Author

Listed:
  • Engelmann, Bernd
  • Hayden, Evelyn
  • Tasche, Dirk

Abstract

Assessing the discriminative power of rating systems is an important question to banks and to regulators. In this article we analyze the Cumulative Accuracy Profile (CAP) and the Receiver Operating Characteristic (ROC) which are both commonly used in practice. We give a test-theoretic interpretation for the concavity of the CAP and the ROC curve and demonstrate how this observation can be used for more efficiently exploiting the informational contents of accounting ratios. Furthermore, we show that two popular summary statistics of these concepts, namely the Accuracy Ratio and the area under the ROC curve, contain the same information and we analyse the statistical properties of these measures. We show in detail how to identify accounting ratios with high discriminative power, how to calculate confidence intervals for the area below the ROC curve, and how to test if two rating models validated on the same data set are different. All concepts are illustrated by applications to real data.

Suggested Citation

  • Engelmann, Bernd & Hayden, Evelyn & Tasche, Dirk, 2003. "Measuring the Discriminative Power of Rating Systems," Discussion Paper Series 2: Banking and Financial Studies 2003,01, Deutsche Bundesbank.
    • Handle: RePEc:zbw:bubdp2:2225
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/19726/1/200301dkp_b.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dirk Tasche, 2002. "Remarks on the monotonicity of default probabilities," Papers cond-mat/0207555, arXiv.org.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dirk Tasche, 2006. "Validation of internal rating systems and PD estimates," Papers physics/0606071, arXiv.org.
    2. Raffaella Calabrese, 2012. "Improving Classifier Performance Assessment of Credit Scoring Models," Working Papers 201204, Geary Institute, University College Dublin.
    3. Raffaella Calabrese, 2011. "Cost-sensitive classification for rare events: an application to the credit rating model validation for SMEs," Working Papers 201134, Geary Institute, University College Dublin.

    More about this item

    Keywords

    Validation; Rating Models; Credit Analysis;
    All these keywords.

    JEL classification:

    • G10 - Financial Economics - - General Financial Markets - - - General (includes Measurement and Data)
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:bubdp2:2225. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/dbbgvde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.