IDEAS home Printed from https://ideas.repec.org/p/ucd/wpaper/201134.html
   My bibliography  Save this paper

Cost-sensitive classification for rare events: an application to the credit rating model validation for SMEs

Author

Listed:
  • Raffaella Calabrese

    (Dynamics Lab, Geary Institute, University College Dublin)

Abstract

Receiver Operating Characteristic (ROC) curve is used to assess the discriminatory power of credit rating models. To identify the optimal threshold on the ROC curve, the iso-performance lines are used. The ROC curve and the iso-performance line assume equal classification error costs and that the two classification groups are relatively balanced. These assumptions are unrealistic in the application to credit risk. In order to remove these hypotheses, the curve of Classification Error Costs is proposed. Coherent with this curve, a methodology to identify the optimal threshold is suggested. Monte Carlo simulations that reproduce similar characteristics to the empirical credit scoring models for SMEs show that our proposal performs better that the iso-performance line. Finally, we apply the suggested methodologies to empirical data on Italian Small and Medium Enterprises (SMEs).

Suggested Citation

  • Raffaella Calabrese, 2011. "Cost-sensitive classification for rare events: an application to the credit rating model validation for SMEs," Working Papers 201134, Geary Institute, University College Dublin.
    • Handle: RePEc:ucd:wpaper:201134
    as

    Download full text from publisher

    File URL: http://www.ucd.ie/geary/static/publications/workingpapers/gearywp201134.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. D. J. Hand & W. E. Henley, 1997. "Statistical Classification Methods in Consumer Credit Scoring: a Review," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 160(3), pages 523-541, September.
    2. Dirk Tasche, 2006. "Validation of internal rating systems and PD estimates," Papers physics/0606071, arXiv.org.
    3. Raffaella Calabrese & Silvia Angela Osmetti, 2011. "Generalized Extreme Value Regression for Binary Rare Events Data: an Application to Credit Defaults," Working Papers 201120, Geary Institute, University College Dublin.
    4. Calabrese, Raffaella & Zenga, Michele, 2010. "Bank loan recovery rates: Measuring and nonparametric density estimation," Journal of Banking & Finance, Elsevier, vol. 34(5), pages 903-911, May.
    5. Fantazzini, Dean, 2008. "Credit Risk Management," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 12(4), pages 84-137.
    6. King, Gary & Zeng, Langche, 2001. "Logistic Regression in Rare Events Data," Political Analysis, Cambridge University Press, vol. 9(2), pages 137-163, January.
    7. Stein, Roger M., 2005. "The relationship between default prediction and lending profits: Integrating ROC analysis and loan pricing," Journal of Banking & Finance, Elsevier, vol. 29(5), pages 1213-1236, May.
    8. Altman, Edward I. & Haldeman, Robert G. & Narayanan, P., 1977. "ZETATM analysis A new model to identify bankruptcy risk of corporations," Journal of Banking & Finance, Elsevier, vol. 1(1), pages 29-54, June.
    9. Dirk Tasche, 2002. "Remarks on the monotonicity of default probabilities," Papers cond-mat/0207555, arXiv.org.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Raffaella Calabrese, 2012. "Improving Classifier Performance Assessment of Credit Scoring Models," Working Papers 201204, Geary Institute, University College Dublin.
    2. Neuberg Richard & Hannah Lauren, 2017. "Loan pricing under estimation risk," Statistics & Risk Modeling, De Gruyter, vol. 34(1-2), pages 69-87, June.
    3. Raffaella Calabrese & Silvia Angela Osmetti, 2011. "Generalized Extreme Value Regression for Binary Rare Events Data: an Application to Credit Defaults," Working Papers 201120, Geary Institute, University College Dublin.
    4. Marcin Chlebus, 2014. "One-day prediction of state of turbulence for financial instrument based on models for binary dependent variable," Ekonomia journal, Faculty of Economic Sciences, University of Warsaw, vol. 37.
    5. Alina Mihaela Dima & Simona Vasilache, 2016. "Credit Risk modeling for Companies Default Prediction using Neural Networks," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(3), pages 127-143, September.
    6. Agarwal, Vineet & Taffler, Richard, 2008. "Comparing the performance of market-based and accounting-based bankruptcy prediction models," Journal of Banking & Finance, Elsevier, vol. 32(8), pages 1541-1551, August.
    7. Ha-Thu Nguyen, 2015. "How is credit scoring used to predict default in China?," EconomiX Working Papers 2015-1, University of Paris Nanterre, EconomiX.
    8. repec:ctc:sdimse:dime21_01 is not listed on IDEAS
    9. Paulo V. Carvalho & José D. Curto & Rodrigo Primor, 2022. "Macroeconomic determinants of credit risk: Evidence from the Eurozone," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 27(2), pages 2054-2072, April.
    10. Vo, D.H. & Pham, B.V.-N. & Pham, T.V.-T. & McAleer, M.J., 2019. "Corporate Financial Distress of Industry Level Listings in an Emerging Market," Econometric Institute Research Papers EI2019-15, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    11. Petr Jakubík & Petr Teplý, 2011. "The JT Index as an Indicator of Financial Stability of Corporate Sector," Prague Economic Papers, Prague University of Economics and Business, vol. 2011(2), pages 157-176.
    12. R. John Irwin & Timothy C. Irwin, 2013. "Appraising Credit Ratings: Does The Cap Fit Better Than The Roc?," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 18(4), pages 396-408, October.
    13. Andreeva, Galina & Calabrese, Raffaella & Osmetti, Silvia Angela, 2016. "A comparative analysis of the UK and Italian small businesses using Generalised Extreme Value models," European Journal of Operational Research, Elsevier, vol. 249(2), pages 506-516.
    14. Nehrebecka Natalia, 2018. "An Evaluation of the Discriminatory Power of Selected Polish Bankruptcy Prediction Models As Part of the Validation Process," Financial Sciences. Nauki o Finansach, Sciendo, vol. 23(4), pages 63-88, December.
    15. Kaposty, Florian & Kriebel, Johannes & Löderbusch, Matthias, 2020. "Predicting loss given default in leasing: A closer look at models and variable selection," International Journal of Forecasting, Elsevier, vol. 36(2), pages 248-266.
    16. Kajal Lahiri & Liu Yang, 2018. "Confidence Bands for ROC Curves With Serially Dependent Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 115-130, January.
    17. Simon Cornée, 2012. "The Relevance of Soft Information for Predicting Small Business Credit Default: Evidence from a Social Bank," Economics Working Paper Archive (University of Rennes & University of Caen) 201226, Center for Research in Economics and Management (CREM), University of Rennes, University of Caen and CNRS, revised Sep 2015.
    18. Rafał Balina & Marta Idasz-Balina & Noer Azam Achsani, 2021. "Predicting Insolvency of the Construction Companies in the Creditworthiness Assessment Process—Empirical Evidence from Poland," JRFM, MDPI, vol. 14(10), pages 1-16, September.
    19. Ha Thu Nguyen, 2015. "How is credit scoring used to predict default in China?," Working Papers hal-04133309, HAL.
    20. Khandani, Amir E. & Kim, Adlar J. & Lo, Andrew W., 2010. "Consumer credit-risk models via machine-learning algorithms," Journal of Banking & Finance, Elsevier, vol. 34(11), pages 2767-2787, November.
    21. Ana Paula Matias Gama & Helena Susana Amaral Geraldes, 2012. "Credit risk assessment and the impact of the New Basel Capital Accord on small and medium‐sized enterprises," Management Research Review, Emerald Group Publishing Limited, vol. 35(8), pages 727-749, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ucd:wpaper:201134. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Geary Tech (email available below). General contact details of provider: https://edirc.repec.org/data/geucdie.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.