IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v64y2024i3d10.1007_s10614-023-10496-y.html
   My bibliography  Save this article

Performance Assessment of Logistic Regression (LR), Artificial Neural Network (ANN), Fuzzy Inference System (FIS) and Adaptive Neuro-Fuzzy System (ANFIS) in Predicting Default Probability: The Case of a Tunisian Islamic Bank

Author

Listed:
  • Nadia Ayed

    (Higher Institute of Computer Science and Management of Kairouan, University of Kairouan
    LARIMRAF LR21ES29, ESCT, University of Manouba)

  • Khemaies Bougatef

    (Higher Institute of Computer Science and Management of Kairouan, University of Kairouan
    LARIMRAF LR21ES29, ESCT, University of Manouba)

Abstract

This paper aims to compare the performance of four credit scoring models, namely logistic regression (LR), artificial neural network (ANN), fuzzy inference system (FIS) and adaptive neuro-fuzzy inference system (ANFIS) in predicting default probability. We use a sample of 1045 consumer credits (after oversampling the initial sample of 660 customers) granted by a Tunisian Islamic bank. The six explanatory variables retained to predict the probability of default are: residual wage, age, job tenure, profession, financing type and region of residence. Our findings reveal that ANFIS and LR have the highest discriminating power (AUC = 0.9). Regarding the type I error (false-positive) and the type II (false-negative) error, it has been proved that ANFIS has the lowest misclassification costs (MC = 0.15). The outperformance of the ANFIS comes from combining the advantages of neural networks with a fuzzy inference system. Thus, our results suggest that the ANFIS seems to be the most efficient and transparent technique for predicting credit risk in Islamic banks. Unlike ANN, the ANFIS allows bankers to justify the reasons behind the rejection of credit applications.

Suggested Citation

  • Nadia Ayed & Khemaies Bougatef, 2024. "Performance Assessment of Logistic Regression (LR), Artificial Neural Network (ANN), Fuzzy Inference System (FIS) and Adaptive Neuro-Fuzzy System (ANFIS) in Predicting Default Probability: The Case of," Computational Economics, Springer;Society for Computational Economics, vol. 64(3), pages 1803-1835, September.
    • Handle: RePEc:kap:compec:v:64:y:2024:i:3:d:10.1007_s10614-023-10496-y
    DOI: 10.1007/s10614-023-10496-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-023-10496-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10614-023-10496-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hussein A. Abdou & John Pointon, 2009. "Credit scoring and decision making in Egyptian public sector banks," International Journal of Managerial Finance, Emerald Group Publishing Limited, vol. 5(4), pages 391-406, September.
    2. Shorouq Fathi Eletter & Saad Ghaleb Yaseen, 2017. "Loan decision models for the Jordanian commercial banks," Global Business and Economics Review, Inderscience Enterprises Ltd, vol. 19(3), pages 323-338.
    3. Runchi Zhang & Zhiyi Qiu, 2020. "Optimizing hyper-parameters of neural networks with swarm intelligence: A novel framework for credit scoring," PLOS ONE, Public Library of Science, vol. 15(6), pages 1-35, June.
    4. Malhotra, Rashmi & Malhotra, D. K., 2002. "Differentiating between good credits and bad credits using neuro-fuzzy systems," European Journal of Operational Research, Elsevier, vol. 136(1), pages 190-211, January.
    5. Syed Alamdar Ali Shah & Raditya Sukmana & Bayu Arie Fianto, 2021. "Integration of Islamic bank specific risks and their impact on the portfolios of Islamic Banks," International Journal of Islamic and Middle Eastern Finance and Management, Emerald Group Publishing Limited, vol. 14(3), pages 561-578, January.
    6. Hong Wang & Qingsong Xu & Lifeng Zhou, 2015. "Large Unbalanced Credit Scoring Using Lasso-Logistic Regression Ensemble," PLOS ONE, Public Library of Science, vol. 10(2), pages 1-20, February.
    7. Hand, David J., 2009. "Mining the past to determine the future: Problems and possibilities," International Journal of Forecasting, Elsevier, vol. 25(3), pages 441-451, July.
    8. Abdui Rahim Al-Saati, 2003. "The Permissible Gharar (Risk) in Classical Islamic Jurisprudence الغرر المسموح به في الشريعة الإسلامية," Journal of King Abdulaziz University: Islamic Economics, King Abdulaziz University, Islamic Economics Institute., vol. 16(2), pages 3-19, January.
    9. Hameeda Abu Hussain & Jasim Al‐Ajmi, 2012. "Risk management practices of conventional and Islamic banks in Bahrain," Journal of Risk Finance, Emerald Group Publishing Limited, vol. 13(3), pages 215-239, May.
    10. B Baesens & T Van Gestel & S Viaene & M Stepanova & J Suykens & J Vanthienen, 2003. "Benchmarking state-of-the-art classification algorithms for credit scoring," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(6), pages 627-635, June.
    11. Martens, David & Baesens, Bart & Van Gestel, Tony & Vanthienen, Jan, 2007. "Comprehensible credit scoring models using rule extraction from support vector machines," European Journal of Operational Research, Elsevier, vol. 183(3), pages 1466-1476, December.
    12. D. J. Hand & W. E. Henley, 1997. "Statistical Classification Methods in Consumer Credit Scoring: a Review," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 160(3), pages 523-541, September.
    13. Lkhagvadorj Munkhdalai & Tsendsuren Munkhdalai & Oyun-Erdene Namsrai & Jong Yun Lee & Keun Ho Ryu, 2019. "An Empirical Comparison of Machine-Learning Methods on Bank Client Credit Assessments," Sustainability, MDPI, vol. 11(3), pages 1-23, January.
    14. Khemaies Bougatef, 2015. "The impact of corruption on the soundness of Islamic banks," Borsa Istanbul Review, Research and Business Development Department, Borsa Istanbul, vol. 15(4), pages 283-295, December.
    15. Daniel Björkegren & Darrell Grissen, 2018. "The Potential of Digital Credit to Bank the Poor," AEA Papers and Proceedings, American Economic Association, vol. 108, pages 68-71, May.
    16. Scott Fay & Erik Hurst & Michelle J. White, 2002. "The Household Bankruptcy Decision," American Economic Review, American Economic Association, vol. 92(3), pages 706-718, June.
    17. Dumitrescu, Elena & Hué, Sullivan & Hurlin, Christophe & Tokpavi, Sessi, 2022. "Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects," European Journal of Operational Research, Elsevier, vol. 297(3), pages 1178-1192.
    18. Thomas, Lyn C., 2000. "A survey of credit and behavioural scoring: forecasting financial risk of lending to consumers," International Journal of Forecasting, Elsevier, vol. 16(2), pages 149-172.
    19. Gathergood, John, 2012. "Self-control, financial literacy and consumer over-indebtedness," Journal of Economic Psychology, Elsevier, vol. 33(3), pages 590-602.
    20. Niklas Bussmann & Paolo Giudici & Dimitri Marinelli & Jochen Papenbrock, 2021. "Explainable Machine Learning in Credit Risk Management," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 203-216, January.
    21. Lobna Abid & Afif Masmoudi & Sonia Zouari-Ghorbel, 2018. "The Consumer Loan’s Payment Default Predictive Model: an Application of the Logistic Regression and the Discriminant Analysis in a Tunisian Commercial Bank," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 9(3), pages 948-962, September.
    22. Maher Ala’raj & Maysam Abbod & Mohammed Radi, 2018. "The applicability of credit scoring models in emerging economies: an evidence from Jordan," International Journal of Islamic and Middle Eastern Finance and Management, Emerald Group Publishing Limited, vol. 11(4), pages 608-630, May.
    23. Asogbon Mojisola Grace & Samuel Oluwarotimi Williams, 2016. "Comparative Analysis of Neural Network and Fuzzy Logic Techniques in Credit Risk Evaluation," International Journal of Intelligent Information Technologies (IJIIT), IGI Global, vol. 12(1), pages 47-62, January.
    24. Ottaviani, Cristina & Vandone, Daniela, 2011. "Impulsivity and household indebtedness: Evidence from real life," Journal of Economic Psychology, Elsevier, vol. 32(5), pages 754-761.
    25. Hoffmann, F. & Baesens, B. & Mues, C. & Van Gestel, T. & Vanthienen, J., 2007. "Inferring descriptive and approximate fuzzy rules for credit scoring using evolutionary algorithms," European Journal of Operational Research, Elsevier, vol. 177(1), pages 540-555, February.
    26. Fatao Wang & Lihui Ding & Hongxin Yu & Yuanjun Zhao, 2020. "Big data analytics on enterprise credit risk evaluation of e-Business platform," Information Systems and e-Business Management, Springer, vol. 18(3), pages 311-350, September.
    27. Michael Bücker & Gero Szepannek & Alicja Gosiewska & Przemyslaw Biecek, 2022. "Transparency, auditability, and explainability of machine learning models in credit scoring," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 73(1), pages 70-90, January.
    28. Hussein A. Abdou & Shaair T. Alam & James Mulkeen, 2014. "Would credit scoring work for Islamic finance? A neural network approach," International Journal of Islamic and Middle Eastern Finance and Management, Emerald Group Publishing Limited, vol. 7(1), pages 112-125, April.
    29. Lee, Tian-Shyug & Chiu, Chih-Chou & Chou, Yu-Chao & Lu, Chi-Jie, 2006. "Mining the customer credit using classification and regression tree and multivariate adaptive regression splines," Computational Statistics & Data Analysis, Elsevier, vol. 50(4), pages 1113-1130, February.
    30. Shouhong Wang, 1995. "The Unpredictability of Standard Back Propagation Neural Networks in Classification Applications," Management Science, INFORMS, vol. 41(3), pages 555-559, March.
    31. Crone, Sven F. & Finlay, Steven, 2012. "Instance sampling in credit scoring: An empirical study of sample size and balancing," International Journal of Forecasting, Elsevier, vol. 28(1), pages 224-238.
    32. Paleologo, Giuseppe & Elisseeff, André & Antonini, Gianluca, 2010. "Subagging for credit scoring models," European Journal of Operational Research, Elsevier, vol. 201(2), pages 490-499, March.
    33. David Durand, 1941. "Risk Elements in Consumer Instalment Financing," NBER Books, National Bureau of Economic Research, Inc, number dura41-1.
    34. Lessmann, Stefan & Baesens, Bart & Seow, Hsin-Vonn & Thomas, Lyn C., 2015. "Benchmarking state-of-the-art classification algorithms for credit scoring: An update of research," European Journal of Operational Research, Elsevier, vol. 247(1), pages 124-136.
    35. Jie Sun & Zhiming Shang & Hui Li, 2014. "Imbalance-oriented SVM methods for financial distress prediction: a comparative study among the new SB-SVM-ensemble method and traditional methods," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 65(12), pages 1905-1919, December.
    36. Hussein A. Abdou & Shaair T. Alam & James Mulkeen, 2014. "Would credit scoring work for Islamic finance? A neural network approach," International Journal of Islamic and Middle Eastern Finance and Management, Emerald Group Publishing Limited, vol. 7(1), pages 112-125, April.
    37. Hussein A. Abdou, 2009. "An evaluation of alternative scoring models in private banking," Journal of Risk Finance, Emerald Group Publishing Limited, vol. 10(1), pages 38-53, January.
    38. David Durand, 1941. "Risk Elements in Consumer Instalment Financing, Technical Edition," NBER Books, National Bureau of Economic Research, Inc, number dura41-2.
    39. Zaiyong Tang & Paul A. Fishwick, 1993. "Feedforward Neural Nets as Models for Time Series Forecasting," INFORMS Journal on Computing, INFORMS, vol. 5(4), pages 374-385, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Elena Ivona DUMITRESCU & Sullivan HUE & Christophe HURLIN & Sessi TOKPAVI, 2020. "Machine Learning or Econometrics for Credit Scoring: Let’s Get the Best of Both Worlds," LEO Working Papers / DR LEO 2839, Orleans Economics Laboratory / Laboratoire d'Economie d'Orleans (LEO), University of Orleans.
    2. Chen, Dangxing & Ye, Jiahui & Ye, Weicheng, 2023. "Interpretable selective learning in credit risk," Research in International Business and Finance, Elsevier, vol. 65(C).
    3. Przemys{l}aw Biecek & Marcin Chlebus & Janusz Gajda & Alicja Gosiewska & Anna Kozak & Dominik Ogonowski & Jakub Sztachelski & Piotr Wojewnik, 2021. "Enabling Machine Learning Algorithms for Credit Scoring -- Explainable Artificial Intelligence (XAI) methods for clear understanding complex predictive models," Papers 2104.06735, arXiv.org.
    4. Linhui Wang & Jianping Zhu & Chenlu Zheng & Zhiyuan Zhang, 2024. "Incorporating Digital Footprints into Credit-Scoring Models through Model Averaging," Mathematics, MDPI, vol. 12(18), pages 1-15, September.
    5. Büşra Alma Çallı & Erman Coşkun, 2021. "A Longitudinal Systematic Review of Credit Risk Assessment and Credit Default Predictors," SAGE Open, , vol. 11(4), pages 21582440211, November.
    6. Huei-Wen Teng & Michael Lee, 2019. "Estimation Procedures of Using Five Alternative Machine Learning Methods for Predicting Credit Card Default," Review of Pacific Basin Financial Markets and Policies (RPBFMP), World Scientific Publishing Co. Pte. Ltd., vol. 22(03), pages 1-27, September.
    7. Dimitrios Nikolaidis & Michalis Doumpos, 2022. "Credit Scoring with Drift Adaptation Using Local Regions of Competence," SN Operations Research Forum, Springer, vol. 3(4), pages 1-28, December.
    8. Chen, Yujia & Calabrese, Raffaella & Martin-Barragan, Belen, 2024. "Interpretable machine learning for imbalanced credit scoring datasets," European Journal of Operational Research, Elsevier, vol. 312(1), pages 357-372.
    9. Akkoç, Soner, 2012. "An empirical comparison of conventional techniques, neural networks and the three stage hybrid Adaptive Neuro Fuzzy Inference System (ANFIS) model for credit scoring analysis: The case of Turkish cred," European Journal of Operational Research, Elsevier, vol. 222(1), pages 168-178.
    10. Tigges, Maximilian & Mestwerdt, Sönke & Tschirner, Sebastian & Mauer, René, 2024. "Who gets the money? A qualitative analysis of fintech lending and credit scoring through the adoption of AI and alternative data," Technological Forecasting and Social Change, Elsevier, vol. 205(C).
    11. Dangxing Chen & Weicheng Ye & Jiahui Ye, 2022. "Interpretable Selective Learning in Credit Risk," Papers 2209.10127, arXiv.org.
    12. Juan Laborda & Seyong Ryoo, 2021. "Feature Selection in a Credit Scoring Model," Mathematics, MDPI, vol. 9(7), pages 1-22, March.
    13. Hussein A. Abdou & John Pointon, 2011. "Credit Scoring, Statistical Techniques And Evaluation Criteria: A Review Of The Literature," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 18(2-3), pages 59-88, April.
    14. Rais Ahmad Itoo & A. Selvarasu & José António Filipe, 2015. "Loan Products and Credit Scoring by Commercial Banks (India)," International Journal of Finance, Insurance and Risk Management, International Journal of Finance, Insurance and Risk Management, vol. 5(1), pages 851-851.
    15. Hong Wang & Qingsong Xu & Lifeng Zhou, 2015. "Large Unbalanced Credit Scoring Using Lasso-Logistic Regression Ensemble," PLOS ONE, Public Library of Science, vol. 10(2), pages 1-20, February.
    16. Finlay, Steven, 2011. "Multiple classifier architectures and their application to credit risk assessment," European Journal of Operational Research, Elsevier, vol. 210(2), pages 368-378, April.
    17. Thomas Wainwright, 2011. "Elite Knowledges: Framing Risk and the Geographies of Credit," Environment and Planning A, , vol. 43(3), pages 650-665, March.
    18. Gunnarsson, Björn Rafn & vanden Broucke, Seppe & Baesens, Bart & Óskarsdóttir, María & Lemahieu, Wilfried, 2021. "Deep learning for credit scoring: Do or don’t?," European Journal of Operational Research, Elsevier, vol. 295(1), pages 292-305.
    19. Adnan Dželihodžić & Dženana Đonko & Jasmin Kevrić, 2018. "Improved Credit Scoring Model Based on Bagging Neural Network," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 17(06), pages 1725-1741, November.
    20. Crone, Sven F. & Finlay, Steven, 2012. "Instance sampling in credit scoring: An empirical study of sample size and balancing," International Journal of Forecasting, Elsevier, vol. 28(1), pages 224-238.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:64:y:2024:i:3:d:10.1007_s10614-023-10496-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.