IDEAS home Printed from https://ideas.repec.org/a/eee/finana/v47y2016icp70-85.html
   My bibliography  Save this article

Validation of default probability models: A stress testing approach

Author

Listed:
  • Tsukahara, Fábio Yasuhiro
  • Kimura, Herbert
  • Sobreiro, Vinicius Amorim
  • Zambrano, Juan Carlos Arismendi

Abstract

This study aims to evaluate the techniques used for the validation of default probability (DP) models. By generating simulated stress data, we build ideal conditions to assess the adequacy of the metrics in different stress scenarios. In addition, we empirically analyze the evaluation metrics using the information on 30,686 delisted US public companies as a proxy of default. Using simulated data, we find that entropy based metrics such as measure M are more sensitive to changes in the characteristics of distributions of credit scores. The empirical sub-samples stress test data show that AUROC is the metric most sensitive to changes in market conditions, being followed by measure M. Our results can help risk managers to make rapid decisions regarding the validation of risk models in different scenarios.

Suggested Citation

  • Tsukahara, Fábio Yasuhiro & Kimura, Herbert & Sobreiro, Vinicius Amorim & Zambrano, Juan Carlos Arismendi, 2016. "Validation of default probability models: A stress testing approach," International Review of Financial Analysis, Elsevier, vol. 47(C), pages 70-85.
    • Handle: RePEc:eee:finana:v:47:y:2016:i:c:p:70-85
    DOI: 10.1016/j.irfa.2016.06.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1057521916301028
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.irfa.2016.06.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hakenes, Hendrik & Schnabel, Isabel, 2011. "Bank size and risk-taking under Basel II," Journal of Banking & Finance, Elsevier, vol. 35(6), pages 1436-1449, June.
    2. Kiefer, Nicholas M., 2009. "Default estimation for low-default portfolios," Journal of Empirical Finance, Elsevier, vol. 16(1), pages 164-173, January.
    3. Verbraken, Thomas & Bravo, Cristián & Weber, Richard & Baesens, Bart, 2014. "Development and application of consumer credit scoring models using profit-based classification measures," European Journal of Operational Research, Elsevier, vol. 238(2), pages 505-513.
    4. Jobst, Norbert J. & Zenios, Stavros A., 2005. "On the simulation of portfolios of interest rate and credit risk sensitive securities," European Journal of Operational Research, Elsevier, vol. 161(2), pages 298-324, March.
    5. Merton, Robert C, 1974. "On the Pricing of Corporate Debt: The Risk Structure of Interest Rates," Journal of Finance, American Finance Association, vol. 29(2), pages 449-470, May.
    6. Steenackers, A. & Goovaerts, M. J., 1989. "A credit scoring model for personal loans," Insurance: Mathematics and Economics, Elsevier, vol. 8(1), pages 31-34, March.
    7. Carol Alexander & Stamatis Leontsinis, 2011. "Model Risk in Variance Swap Rates," ICMA Centre Discussion Papers in Finance icma-dp2011-10, Henley Business School, University of Reading.
    8. B Baesens & T Van Gestel & S Viaene & M Stepanova & J Suykens & J Vanthienen, 2003. "Benchmarking state-of-the-art classification algorithms for credit scoring," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(6), pages 627-635, June.
    9. Agarwal, Vineet & Taffler, Richard, 2008. "Comparing the performance of market-based and accounting-based bankruptcy prediction models," Journal of Banking & Finance, Elsevier, vol. 32(8), pages 1541-1551, August.
    10. Kerkhof, Jeroen & Melenberg, Bertrand, 2004. "Backtesting for risk-based regulatory capital," Journal of Banking & Finance, Elsevier, vol. 28(8), pages 1845-1865, August.
    11. Colletaz, Gilbert & Hurlin, Christophe & Pérignon, Christophe, 2013. "The Risk Map: A new tool for validating risk models," Journal of Banking & Finance, Elsevier, vol. 37(10), pages 3843-3854.
    12. Eliazar, Iddo I. & Sokolov, Igor M., 2010. "Measuring statistical heterogeneity: The Pietra index," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 389(1), pages 117-125.
    13. Boucher, Christophe M. & Daníelsson, Jón & Kouontchou, Patrick S. & Maillet, Bertrand B., 2014. "Risk models-at-risk," Journal of Banking & Finance, Elsevier, vol. 44(C), pages 72-92.
    14. Edward I. Altman, 1968. "Financial Ratios, Discriminant Analysis And The Prediction Of Corporate Bankruptcy," Journal of Finance, American Finance Association, vol. 23(4), pages 589-609, September.
    15. Hagedoorn, John, 1996. "Innovation and Entrepreneurship: Schumpeter Revisited," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 5(3), pages 883-896.
    16. Marshall, Andrew & Tang, Leilei & Milne, Alistair, 2010. "Variable reduction, sample selection bias and bank retail credit scoring," Journal of Empirical Finance, Elsevier, vol. 17(3), pages 501-512, June.
    17. Lopez, Jose A. & Saidenberg, Marc R., 2000. "Evaluating credit risk models," Journal of Banking & Finance, Elsevier, vol. 24(1-2), pages 151-165, January.
    18. Alexander, Carol & Sheedy, Elizabeth, 2008. "Developing a stress testing framework based on market risk models," Journal of Banking & Finance, Elsevier, vol. 32(10), pages 2220-2236, October.
    19. Shumway, Tyler, 2001. "Forecasting Bankruptcy More Accurately: A Simple Hazard Model," The Journal of Business, University of Chicago Press, vol. 74(1), pages 101-124, January.
    20. Edward I. Altman, 1968. "The Prediction Of Corporate Bankruptcy: A Discriminant Analysis," Journal of Finance, American Finance Association, vol. 23(1), pages 193-194, March.
    21. Christoph Zott, 2003. "Dynamic capabilities and the emergence of intraindustry differential firm performance: insights from a simulation study," Strategic Management Journal, Wiley Blackwell, vol. 24(2), pages 97-125, February.
    22. Medema, Lydian & Koning, Ruud H. & Lensink, Robert, 2009. "A practical approach to validating a PD model," Journal of Banking & Finance, Elsevier, vol. 33(4), pages 701-708, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wang, Zheqi & Crook, Jonathan & Andreeva, Galina, 2020. "Reducing estimation risk using a Bayesian posterior distribution approach: Application to stress testing mortgage loan default," European Journal of Operational Research, Elsevier, vol. 287(2), pages 725-738.
    2. Dainelli, Francesco & Bet, Gianmarco & Fabrizi, Eugenio, 2024. "The financial health of a company and the risk of its default: Back to the future," International Review of Financial Analysis, Elsevier, vol. 95(PB).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pesaran, M. Hashem & Schuermann, Til & Treutler, Bjorn-Jakob & Weiner, Scott M., 2006. "Macroeconomic Dynamics and Credit Risk: A Global Perspective," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(5), pages 1211-1261, August.
    2. Serrano-Cinca, Carlos & Gutiérrez-Nieto, Begoña & Bernate-Valbuena, Martha, 2019. "The use of accounting anomalies indicators to predict business failure," European Management Journal, Elsevier, vol. 37(3), pages 353-375.
    3. Huang, Hsing-Hua & Lee, Han-Hsing, 2013. "Product market competition and credit risk," Journal of Banking & Finance, Elsevier, vol. 37(2), pages 324-340.
    4. Mousavi, Mohammad M. & Ouenniche, Jamal & Xu, Bing, 2015. "Performance evaluation of bankruptcy prediction models: An orientation-free super-efficiency DEA-based framework," International Review of Financial Analysis, Elsevier, vol. 42(C), pages 64-75.
    5. Aggarwal, Nidhi & Singh, Manish K. & Thomas, Susan, 2023. "Do decreases in Distance-to-Default predict rating downgrades?," Economic Modelling, Elsevier, vol. 129(C).
    6. Charitou, Andreas & Dionysiou, Dionysia & Lambertides, Neophytos & Trigeorgis, Lenos, 2013. "Alternative bankruptcy prediction models using option-pricing theory," Journal of Banking & Finance, Elsevier, vol. 37(7), pages 2329-2341.
    7. Mohammad Mahdi Mousavi & Jamal Ouenniche & Kaoru Tone, 2023. "A dynamic performance evaluation of distress prediction models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(4), pages 756-784, July.
    8. Duc Hong Vo & Binh Ninh Vo Pham & Chi Minh Ho & Michael McAleer, 2019. "Corporate Financial Distress of Industry Level Listings in Vietnam," JRFM, MDPI, vol. 12(4), pages 1-17, September.
    9. Evangelos C. Charalambakis, 2015. "On the Prediction of Corporate Financial Distress in the Light of the Financial Crisis: Empirical Evidence from Greek Listed Firms," International Journal of the Economics of Business, Taylor & Francis Journals, vol. 22(3), pages 407-428, November.
    10. John Nkwoma Inekwe, 2016. "Financial Distress, Employees’ Welfare and Entrepreneurship Among SMEs," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 129(3), pages 1135-1153, December.
    11. Clara Cardone-Riportella & Antonio Trujillo-Ponce & Anahí Briozzo, 2013. "Analyzing the role of mutual guarantee societies on bank capital requirements for small and medium-sized enterprises," Journal of Economic Policy Reform, Taylor & Francis Journals, vol. 16(2), pages 142-159, June.
    12. Inekwe, John Nkwoma & Jin, Yi & Valenzuela, Ma. Rebecca, 2018. "The effects of financial distress: Evidence from US GDP growth," Economic Modelling, Elsevier, vol. 72(C), pages 8-21.
    13. Elena Ivona DUMITRESCU & Sullivan HUE & Christophe HURLIN & Sessi TOKPAVI, 2020. "Machine Learning or Econometrics for Credit Scoring: Let’s Get the Best of Both Worlds," LEO Working Papers / DR LEO 2839, Orleans Economics Laboratory / Laboratoire d'Economie d'Orleans (LEO), University of Orleans.
    14. Boubaker, Sabri & Cellier, Alexis & Manita, Riadh & Saeed, Asif, 2020. "Does corporate social responsibility reduce financial distress risk?," Economic Modelling, Elsevier, vol. 91(C), pages 835-851.
    15. Alessandro Bitetto & Stefano Filomeni & Michele Modina, 2021. "Understanding corporate default using Random Forest: The role of accounting and market information," DEM Working Papers Series 205, University of Pavia, Department of Economics and Management.
    16. Maurice Peat & Stewart Jones, 2012. "Using Neural Nets To Combine Information Sets In Corporate Bankruptcy Prediction," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 19(2), pages 90-101, April.
    17. Miao, Hong & Ramchander, Sanjay & Ryan, Patricia & Wang, Tianyang, 2018. "Default prediction models: The role of forward-looking measures of returns and volatility," Journal of Empirical Finance, Elsevier, vol. 46(C), pages 146-162.
    18. Evangelos C. Charalambakis & Ian Garrett, 2016. "On the prediction of financial distress in developed and emerging markets: Does the choice of accounting and market information matter? A comparison of UK and Indian Firms," Review of Quantitative Finance and Accounting, Springer, vol. 47(1), pages 1-28, July.
    19. Bauer, Julian & Agarwal, Vineet, 2014. "Are hazard models superior to traditional bankruptcy prediction approaches? A comprehensive test," Journal of Banking & Finance, Elsevier, vol. 40(C), pages 432-442.
    20. Krüger, Steffen & Oehme, Toni & Rösch, Daniel & Scheule, Harald, 2018. "A copula sample selection model for predicting multi-year LGDs and Lifetime Expected Losses," Journal of Empirical Finance, Elsevier, vol. 47(C), pages 246-262.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:finana:v:47:y:2016:i:c:p:70-85. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620166 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.