IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-04223161.html
   My bibliography  Save this paper

Bankruptcy prediction using machine learning and Shapley additive explanations

Author

Listed:
  • Hoang Hiep Nguyen

    (CREM - Centre de recherche en économie et management - UNICAEN - Université de Caen Normandie - NU - Normandie Université - UR - Université de Rennes - CNRS - Centre National de la Recherche Scientifique)

  • Jean-Laurent Viviani

    (CREM - Centre de recherche en économie et management - UNICAEN - Université de Caen Normandie - NU - Normandie Université - UR - Université de Rennes - CNRS - Centre National de la Recherche Scientifique)

  • Sami Ben Jabeur

    (ESDES - ESDES, Lyon Business School - UCLy - UCLy - UCLy (Lyon Catholic University), UCLy - UCLy (Lyon Catholic University))

Abstract

Recently, ensemble-based machine learning models have been widely used and have demonstrated their efficiency in bankruptcy prediction. However, these algorithms are black box models and people cannot understand why they make their forecasts. This explains why interpretability methods in machine learning attract attention from many artificial intelligence researchers. In this paper, we evaluate the prediction performance of Random Forest, LightGBM, XGBoost, and NGBoost (Natural Gradient Boosting for probabilistic prediction) for French firms from different industries with the horizon of 1-5 years. We then use Shapley Additive Explanations (SHAP), a model-agnostic method to explain XGBoost, one of the best models for our data. SHAP can show how each feature impacts the output from XGBoost. Furthermore, single prediction can also be explained, thus allowing black box models to be used in credit risk management.

Suggested Citation

  • Hoang Hiep Nguyen & Jean-Laurent Viviani & Sami Ben Jabeur, 2023. "Bankruptcy prediction using machine learning and Shapley additive explanations," Post-Print hal-04223161, HAL.
    • Handle: RePEc:hal:journl:hal-04223161
    DOI: 10.1007/s11156-023-01192-x
    Note: View the original document on HAL open archive server: https://hal.science/hal-04223161
    as

    Download full text from publisher

    File URL: https://hal.science/hal-04223161/document
    Download Restriction: no
    File URL: https://libkey.io/10.1007/s11156-023-01192-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Matthew Smith & Francisco Alvarez, 2022. "Predicting Firm-Level Bankruptcy in the Spanish Economy Using Extreme Gradient Boosting," Computational Economics, Springer;Society for Computational Economics, vol. 59(1), pages 263-295, January.
    2. Michaela Staňková, 2023. "Threshold Moving Approach with Logit Models for Bankruptcy Prediction," Computational Economics, Springer;Society for Computational Economics, vol. 61(3), pages 1251-1272, March.
    3. du Jardin, Philippe, 2010. "Predicting bankruptcy using neural networks and other classification methods: the influence of variable selection techniques on model accuracy," MPRA Paper 44375, University Library of Munich, Germany.
    4. Chris Charalambous & Spiros H. Martzoukos & Zenon Taoushianis, 2022. "Estimating corporate bankruptcy forecasting models by maximizing discriminatory power," Review of Quantitative Finance and Accounting, Springer, vol. 58(1), pages 297-328, January.
    5. Mercadier, Mathieu & Lardy, Jean-Pierre, 2019. "Credit spread approximation and improvement using random forest regression," European Journal of Operational Research, Elsevier, vol. 277(1), pages 351-365.
    6. Ben Jabeur, Sami & Serret, Vanessa, 2023. "Bankruptcy prediction using fuzzy convolutional neural networks," Research in International Business and Finance, Elsevier, vol. 64(C).
    7. Eric Severin & David Veganzones & Souhir Chlibi, 2023. "Influence of earnings management on forecasting corporate failure," Post-Print hal-04335071, HAL.
    8. Christophe Schalck & Meryem Yankol-Schalck, 2021. "Predicting French SME failures: new evidence from machine learning techniques," Applied Economics, Taylor & Francis Journals, vol. 53(51), pages 5948-5963, November.
    9. Balcaen, Sofie & Ooghe, Hubert, 2006. "35 years of studies on business failure: an overview of the classic statistical methodologies and their related problems," The British Accounting Review, Elsevier, vol. 38(1), pages 63-93.
    10. Edward I. Altman, 1968. "Financial Ratios, Discriminant Analysis And The Prediction Of Corporate Bankruptcy," Journal of Finance, American Finance Association, vol. 23(4), pages 589-609, September.
    11. Niklas Bussmann & Paolo Giudici & Dimitri Marinelli & Jochen Papenbrock, 2021. "Explainable Machine Learning in Credit Risk Management," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 203-216, January.
    12. Sigrist, Fabio & Leuenberger, Nicola, 2023. "Machine learning for corporate default risk: Multi-period prediction, frailty correlation, loan portfolios, and tail probabilities," European Journal of Operational Research, Elsevier, vol. 305(3), pages 1390-1406.
    13. Zhao, Shuping & Xu, Kai & Wang, Zhao & Liang, Changyong & Lu, Wenxing & Chen, Bo, 2022. "Financial distress prediction by combining sentiment tone features," Economic Modelling, Elsevier, vol. 106(C).
    14. Ohlson, Ja, 1980. "Financial Ratios And The Probabilistic Prediction Of Bankruptcy," Journal of Accounting Research, Wiley Blackwell, vol. 18(1), pages 109-131.
    15. Zmijewski, Me, 1984. "Methodological Issues Related To The Estimation Of Financial Distress Prediction Models," Journal of Accounting Research, Wiley Blackwell, vol. 22, pages 59-82.
    16. Beaver, Wh, 1966. "Financial Ratios As Predictors Of Failure - Reply," Journal of Accounting Research, Wiley Blackwell, vol. 4, pages 123-127.
    17. du Jardin, Philippe, 2015. "Bankruptcy prediction using terminal failure processes," European Journal of Operational Research, Elsevier, vol. 242(1), pages 286-303.
    18. du Jardin, Philippe, 2016. "A two-stage classification technique for bankruptcy prediction," European Journal of Operational Research, Elsevier, vol. 254(1), pages 236-252.
    19. Climent, Francisco & Momparler, Alexandre & Carmona, Pedro, 2019. "Anticipating bank distress in the Eurozone: An Extreme Gradient Boosting approach," Journal of Business Research, Elsevier, vol. 101(C), pages 885-896.
    20. Veganzones, David & Séverin, Eric & Chlibi, Souhir, 2023. "Influence of earnings management on forecasting corporate failure," International Journal of Forecasting, Elsevier, vol. 39(1), pages 123-143.
    21. Kellner, Ralf & Nagl, Maximilian & Rösch, Daniel, 2022. "Opening the black box – Quantile neural networks for loss given default prediction," Journal of Banking & Finance, Elsevier, vol. 134(C).
    22. Beaver, Wh, 1966. "Financial Ratios As Predictors Of Failure," Journal of Accounting Research, Wiley Blackwell, vol. 4, pages 71-111.
    23. Stewart Jones & David Johnstone & Roy Wilson, 2017. "Predicting Corporate Bankruptcy: An Evaluation of Alternative Statistical Frameworks," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 44(1-2), pages 3-34, January.
    24. Altman, Edward I. & Haldeman, Robert G. & Narayanan, P., 1977. "ZETATM analysis A new model to identify bankruptcy risk of corporations," Journal of Banking & Finance, Elsevier, vol. 1(1), pages 29-54, June.
    25. Sigrist, Fabio & Hirnschall, Christoph, 2019. "Grabit: Gradient tree-boosted Tobit models for default prediction," Journal of Banking & Finance, Elsevier, vol. 102(C), pages 177-192.
    26. Eric Séverin & David Veganzones, 2021. "Can earnings management information improve bankruptcy prediction models?," Annals of Operations Research, Springer, vol. 306(1), pages 247-272, November.
    27. Sami Ben Jabeur & Nicolae Stef & Pedro Carmona, 2023. "Bankruptcy Prediction using the XGBoost Algorithm and Variable Importance Feature Engineering," Computational Economics, Springer;Society for Computational Economics, vol. 61(2), pages 715-741, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alessandro Bitetto & Paola Cerchiello & Stefano Filomeni & Alessandra Tanda & Barbara Tarantino, 2024. "Can we trust machine learning to predict the credit risk of small businesses?," Review of Quantitative Finance and Accounting, Springer, vol. 63(3), pages 925-954, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Serrano-Cinca, Carlos & Gutiérrez-Nieto, Begoña & Bernate-Valbuena, Martha, 2019. "The use of accounting anomalies indicators to predict business failure," European Management Journal, Elsevier, vol. 37(3), pages 353-375.
    2. Francesco Ciampi & Valentina Cillo & Fabio Fiano, 2020. "Combining Kohonen maps and prior payment behavior for small enterprise default prediction," Small Business Economics, Springer, vol. 54(4), pages 1007-1039, April.
    3. Noora Alzayed & Rasol Eskandari & Hassan Yazdifar, 2023. "Bank failure prediction: corporate governance and financial indicators," Review of Quantitative Finance and Accounting, Springer, vol. 61(2), pages 601-631, August.
    4. Apostolos G. Christopoulos & Ioannis G. Dokas & Iraklis Kollias & John Leventides, 2019. "An implementation of Soft Set Theory in the Variables Selection Process for Corporate Failure Prediction Models. Evidence from NASDAQ Listed Firms," Bulletin of Applied Economics, Risk Market Journals, vol. 6(1), pages 1-20.
    5. Stewart Jones, 2017. "Corporate bankruptcy prediction: a high dimensional analysis," Review of Accounting Studies, Springer, vol. 22(3), pages 1366-1422, September.
    6. Xavier Brédart & Eric Séverin & David Veganzones, 2021. "Human resources and corporate failure prediction modeling: Evidence from Belgium," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(7), pages 1325-1341, November.
    7. Sanghoon Lee & Keunho Choi & Donghee Yoo, 2023. "Building a core rule-based decision tree to explain the causes of insolvency in small and medium-sized enterprises more easily," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-16, December.
    8. Alam, Nurul & Gao, Junbin & Jones, Stewart, 2021. "Corporate failure prediction: An evaluation of deep learning vs discrete hazard models," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 75(C).
    9. Zeineb Affes & Rania Hentati-Kaffel, 2019. "Predicting US Banks Bankruptcy: Logit Versus Canonical Discriminant Analysis," Computational Economics, Springer;Society for Computational Economics, vol. 54(1), pages 199-244, June.
    10. Soumya Ranjan Sethi & Dushyant Ashok Mahadik & Rajkiran V. Bilolikar, 2024. "Exploring Trends and Advancements in Financial Distress Prediction Research: A Bibliometric Study," International Journal of Economics and Financial Issues, Econjournals, vol. 14(1), pages 164-179, January.
    11. Jackson, Richard H.G. & Wood, Anthony, 2013. "The performance of insolvency prediction and credit risk models in the UK: A comparative study," The British Accounting Review, Elsevier, vol. 45(3), pages 183-202.
    12. Bhanu Pratap Singh & Alok Kumar Mishra, 2016. "Re-estimation and comparisons of alternative accounting based bankruptcy prediction models for Indian companies," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 2(1), pages 1-28, December.
    13. Li, Chunyu & Lou, Chenxin & Luo, Dan & Xing, Kai, 2021. "Chinese corporate distress prediction using LASSO: The role of earnings management," International Review of Financial Analysis, Elsevier, vol. 76(C).
    14. Adriana Csikosova & Maria Janoskova & Katarina Culkova, 2020. "Application of Discriminant Analysis for Avoiding the Risk of Quarry Operation Failure," JRFM, MDPI, vol. 13(10), pages 1-14, September.
    15. Ken Li, 2024. "Liquidity ratios and corporate failures," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 64(1), pages 1111-1134, March.
    16. Kumar, Rahul & Deb, Soumya Guha & Mukherjee, Shubhadeep, 2020. "Do words reveal the latent truth? Identifying communication patterns of corporate losers," Journal of Behavioral and Experimental Finance, Elsevier, vol. 26(C).
    17. Amin Jan & Maran Marimuthu & Muhammad Kashif Shad & Haseeb ur-Rehman & Muhammad Zahid & Ahmad Ali Jan, 2019. "Bankruptcy profile of the Islamic and conventional banks in Malaysia: a post-crisis period analysis," Economic Change and Restructuring, Springer, vol. 52(1), pages 67-87, February.
    18. Mohammad Mahdi Mousavi & Jamal Ouenniche & Kaoru Tone, 2023. "A dynamic performance evaluation of distress prediction models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(4), pages 756-784, July.
    19. du Jardin, Philippe, 2015. "Bankruptcy prediction using terminal failure processes," European Journal of Operational Research, Elsevier, vol. 242(1), pages 286-303.
    20. Duc Hong Vo & Binh Ninh Vo Pham & Chi Minh Ho & Michael McAleer, 2019. "Corporate Financial Distress of Industry Level Listings in Vietnam," JRFM, MDPI, vol. 12(4), pages 1-17, September.

    More about this item

    Keywords

    Shapley additive explanations; Explainable machine learning; Bankruptcy prediction; Ensemble-based model; XGBoost;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-04223161. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.