IDEAS home Printed from https://ideas.repec.org/a/eee/joreco/v79y2024ics0969698924001504.html
   My bibliography  Save this article

Profit-driven fusion framework based on bagging and boosting classifiers for potential purchaser prediction

Author

Listed:
  • Liu, Zhenkun
  • Zhang, Ying
  • Abedin, Mohammad Zoynul
  • Wang, Jianzhou
  • Yang, Hufang
  • Gao, Yuyang
  • Chen, Yinghao

Abstract

Accurately identifying potential purchasers (PPers) is pivotal for enhancing an enterprise's core competitiveness in a competitive market. Although existing research focused on individual classifiers for PPer prediction, there is a notable gap in the integration of the bagging and boosting algorithms, resulting in suboptimal performance. This study introduces a novel fusion framework for profit-oriented PPer prediction that combines the strengths of the bagging (specifically, random forest, RF) and boosting (utilizing categorical boosting, CatBoost) algorithms. CatBoost replaces the original base learner in RF, leveraging the advantages of both classifiers to reduce the variance and bias. To optimize the proposed RF-CatBoost-based fusion framework for profit maximization, we employ a grid search to fine-tune hyperparameters. This approach aligns with enterprises' profit-driven objectives. The experimental results, statistical tests, and Bayesian A/B tests collectively demonstrate that the proposed framework outperforms all comparative classifiers, yielding the highest profits. Furthermore, an interpretability analysis reveals the significant factors influencing the prediction results, providing valuable insights for decision makers in identifying PPers within customer groups.

Suggested Citation

  • Liu, Zhenkun & Zhang, Ying & Abedin, Mohammad Zoynul & Wang, Jianzhou & Yang, Hufang & Gao, Yuyang & Chen, Yinghao, 2024. "Profit-driven fusion framework based on bagging and boosting classifiers for potential purchaser prediction," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
  • Handle: RePEc:eee:joreco:v:79:y:2024:i:c:s0969698924001504
    DOI: 10.1016/j.jretconser.2024.103854
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0969698924001504
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jretconser.2024.103854?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Trinh, Giang & Wright, Malcolm J., 2022. "Predicting future consumer purchases in grocery retailing with the condensed Poisson lognormal model," Journal of Retailing and Consumer Services, Elsevier, vol. 64(C).
    2. Risselada, Hans & Verhoef, Peter C. & Bijmolt, Tammo H.A., 2010. "Staying Power of Churn Prediction Models," Journal of Interactive Marketing, Elsevier, vol. 24(3), pages 198-208.
    3. Hossain, Md Shamim & Rahman, Mst Farjana, 2022. "Detection of potential customers’ empathy behavior towards customers' reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    4. Martínez, Andrés & Schmuck, Claudia & Pereverzyev, Sergiy & Pirker, Clemens & Haltmeier, Markus, 2020. "A machine learning framework for customer purchase prediction in the non-contractual setting," European Journal of Operational Research, Elsevier, vol. 281(3), pages 588-596.
    5. Jiang, Ping & Liu, Zhenkun & Abedin, Mohammad Zoynul & Wang, Jianzhou & Yang, Wendong & Dong, Qingli, 2024. "Profit-driven weighted classifier with interpretable ability for customer churn prediction," Omega, Elsevier, vol. 125(C).
    6. Nilashi, Mehrbakhsh & Ahmadi, Hossein & Arji, Goli & Alsalem, Khalaf Okab & Samad, Sarminah & Ghabban, Fahad & Alzahrani, Ahmed Omar & Ahani, Ali & Alarood, Ala Abdulsalam, 2021. "Big social data and customer decision making in vegetarian restaurants: A combined machine learning method," Journal of Retailing and Consumer Services, Elsevier, vol. 62(C).
    7. Zhenkun Liu & Ping Jiang & Koen W. de Bock & Jianzhou Wang & Lifang Zhang & Xinsong Niu, 2024. "Extreme gradient boosting trees with efficient Bayesian optimization for profit-driven customer churn prediction," Post-Print hal-04273578, HAL.
    8. Kim, Jina & Ji, HongGeun & Oh, Soyoung & Hwang, Syjung & Park, Eunil & del Pobil, Angel P., 2021. "A deep hybrid learning model for customer repurchase behavior," Journal of Retailing and Consumer Services, Elsevier, vol. 59(C).
    9. De Caigny, Arno & Coussement, Kristof & De Bock, Koen W. & Lessmann, Stefan, 2020. "Incorporating textual information in customer churn prediction models based on a convolutional neural network," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1563-1578.
    10. Liu, Chih-Hsing & Gan, Bernard & Ko, Wen-Hwa & Teng, Chih-Ching, 2022. "Comparison of localized and foreign restaurant brands for consumer behavior prediction," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    11. Van den Poel, Dirk & Lariviere, Bart, 2004. "Customer attrition analysis for financial services using proportional hazard models," European Journal of Operational Research, Elsevier, vol. 157(1), pages 196-217, August.
    12. Chou, Ping & Chuang, Howard Hao-Chun & Chou, Yen-Chun & Liang, Ting-Peng, 2022. "Predictive analytics for customer repurchase: Interdisciplinary integration of buy till you die modeling and machine learning," European Journal of Operational Research, Elsevier, vol. 296(2), pages 635-651.
    13. Maldonado, Sebastián & Domínguez, Gonzalo & Olaya, Diego & Verbeke, Wouter, 2021. "Profit-driven churn prediction for the mutual fund industry: A multisegment approach," Omega, Elsevier, vol. 100(C).
    14. Arno de Caigny & Kristof Coussement & Koen W. de Bock, 2018. "A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees," Post-Print hal-01741661, HAL.
    15. Maldonado, Sebastián & López, Julio & Vairetti, Carla, 2020. "Profit-based churn prediction based on Minimax Probability Machines," European Journal of Operational Research, Elsevier, vol. 284(1), pages 273-284.
    16. Rahim, Mussadiq Abdul & Mushafiq, Muhammad & Khan, Salabat & Arain, Zulfiqar Ali, 2021. "RFM-based repurchase behavior for customer classification and segmentation," Journal of Retailing and Consumer Services, Elsevier, vol. 61(C).
    17. Liu, Zhenkun & Jiang, Ping & De Bock, Koen W. & Wang, Jianzhou & Zhang, Lifang & Niu, Xinsong, 2024. "Extreme gradient boosting trees with efficient Bayesian optimization for profit-driven customer churn prediction," Technological Forecasting and Social Change, Elsevier, vol. 198(C).
    18. Chen, Shiuann-Shuoh & Choubey, Bhaskar & Singh, Vinay, 2021. "A neural network based price sensitive recommender model to predict customer choices based on price effect," Journal of Retailing and Consumer Services, Elsevier, vol. 61(C).
    19. Kristof Coussement & Paul Harrigan & Dries Benoit, 2015. "Improving direct mail targeting through customer response modeling," Post-Print hal-02990995, HAL.
    20. Verbraken, Thomas & Bravo, Cristián & Weber, Richard & Baesens, Bart, 2014. "Development and application of consumer credit scoring models using profit-based classification measures," European Journal of Operational Research, Elsevier, vol. 238(2), pages 505-513.
    21. Kristof Coussement & Stefan Lessmann & Geert Verstraeten, 2017. "A comparative analysis of data preparation algorithms for customer churn prediction: A case study in the telecommunication industry," Post-Print hal-01745261, HAL.
    22. Li, Bo & Liao, Mengjie & Yuan, Junjing & Zhang, Jian, 2023. "Green consumption behavior prediction based on fan-shaped search mechanism fruit fly algorithm optimized neural network," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).
    23. Pashchenko, Yana & Rahman, Mst Farjana & Hossain, Md Shamim & Uddin, Md Kutub & Islam, Tarannum, 2022. "Emotional and the normative aspects of customers’ reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    24. Esmeli, Ramazan & Bader-El-Den, Mohamed & Abdullahi, Hassana, 2022. "An analyses of the effect of using contextual and loyalty features on early purchase prediction of shoppers in e-commerce domain," Journal of Business Research, Elsevier, vol. 147(C), pages 420-434.
    25. De Caigny, Arno & Coussement, Kristof & De Bock, Koen W., 2018. "A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees," European Journal of Operational Research, Elsevier, vol. 269(2), pages 760-772.
    26. Höppner, Sebastiaan & Stripling, Eugen & Baesens, Bart & Broucke, Seppe vanden & Verdonck, Tim, 2020. "Profit driven decision trees for churn prediction," European Journal of Operational Research, Elsevier, vol. 284(3), pages 920-933.
    27. Fader, Peter S. & Hardie, Bruce G.S., 2009. "Probability Models for Customer-Base Analysis," Journal of Interactive Marketing, Elsevier, vol. 23(1), pages 61-69.
    28. Koen W. de Bock & Arno de Caigny, 2021. "Spline-rule ensemble classifiers with structured sparsity regularization for interpretable customer churn modeling," Post-Print hal-03391564, HAL.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Zhenkun & Jiang, Ping & De Bock, Koen W. & Wang, Jianzhou & Zhang, Lifang & Niu, Xinsong, 2024. "Extreme gradient boosting trees with efficient Bayesian optimization for profit-driven customer churn prediction," Technological Forecasting and Social Change, Elsevier, vol. 198(C).
    2. Lewlisa Saha & Hrudaya Kumar Tripathy & Tarek Gaber & Hatem El-Gohary & El-Sayed M. El-kenawy, 2023. "Deep Churn Prediction Method for Telecommunication Industry," Sustainability, MDPI, vol. 15(5), pages 1-21, March.
    3. De Bock, Koen W. & Coussement, Kristof & Caigny, Arno De & Słowiński, Roman & Baesens, Bart & Boute, Robert N. & Choi, Tsan-Ming & Delen, Dursun & Kraus, Mathias & Lessmann, Stefan & Maldonado, Sebast, 2024. "Explainable AI for Operational Research: A defining framework, methods, applications, and a research agenda," European Journal of Operational Research, Elsevier, vol. 317(2), pages 249-272.
    4. Arno de Caigny & Kristof Coussement & Koen W. de Bock & Stefan Lessmann, 2019. "Incorporating textual information in customer churn prediction models based on a convolutional neural network," Post-Print hal-02275958, HAL.
    5. De Caigny, Arno & Coussement, Kristof & De Bock, Koen W. & Lessmann, Stefan, 2020. "Incorporating textual information in customer churn prediction models based on a convolutional neural network," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1563-1578.
    6. Koen W. de Bock & Kristof Coussement & Arno De Caigny & Roman Slowiński & Bart Baesens & Robert N Boute & Tsan-Ming Choi & Dursun Delen & Mathias Kraus & Stefan Lessmann & Sebastián Maldonado & David , 2023. "Explainable AI for Operational Research: A Defining Framework, Methods, Applications, and a Research Agenda," Post-Print hal-04219546, HAL.
    7. Chou, Ping & Chuang, Howard Hao-Chun & Chou, Yen-Chun & Liang, Ting-Peng, 2022. "Predictive analytics for customer repurchase: Interdisciplinary integration of buy till you die modeling and machine learning," European Journal of Operational Research, Elsevier, vol. 296(2), pages 635-651.
    8. Matthias Bogaert & Lex Delaere, 2023. "Ensemble Methods in Customer Churn Prediction: A Comparative Analysis of the State-of-the-Art," Mathematics, MDPI, vol. 11(5), pages 1-28, February.
    9. Arno de Caigny & Kristof Coussement & Koen de Bock, 2020. "Leveraging fine-grained transaction data for customer life event predictions," Post-Print hal-02507998, HAL.
    10. Gattermann-Itschert, Theresa & Thonemann, Ulrich W., 2021. "How training on multiple time slices improves performance in churn prediction," European Journal of Operational Research, Elsevier, vol. 295(2), pages 664-674.
    11. Chandrasekhar Valluri & Sudhakar Raju & Vivek H. Patil, 2022. "Customer determinants of used auto loan churn: comparing predictive performance using machine learning techniques," Journal of Marketing Analytics, Palgrave Macmillan, vol. 10(3), pages 279-296, September.
    12. Louis Geiler & Séverine Affeldt & Mohamed Nadif, 2022. "A survey on machine learning methods for churn prediction," Post-Print hal-03824873, HAL.
    13. Chen, Yan & Zhang, Lei & Zhao, Yulu & Xu, Bing, 2022. "Implementation of penalized survival models in churn prediction of vehicle insurance," Journal of Business Research, Elsevier, vol. 153(C), pages 162-171.
    14. Dumitrescu, Elena & Hué, Sullivan & Hurlin, Christophe & Tokpavi, Sessi, 2022. "Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects," European Journal of Operational Research, Elsevier, vol. 297(3), pages 1178-1192.
    15. Narendra Singh & Pushpa Singh & Mukul Gupta, 2020. "An inclusive survey on machine learning for CRM: a paradigm shift," DECISION: Official Journal of the Indian Institute of Management Calcutta, Springer;Indian Institute of Management Calcutta, vol. 47(4), pages 447-457, December.
    16. Elena Ivona DUMITRESCU & Sullivan HUE & Christophe HURLIN & Sessi TOKPAVI, 2020. "Machine Learning or Econometrics for Credit Scoring: Let’s Get the Best of Both Worlds," LEO Working Papers / DR LEO 2839, Orleans Economics Laboratory / Laboratoire d'Economie d'Orleans (LEO), University of Orleans.
    17. Ebru Pekel Ozmen & Tuncay Ozcan, 2022. "A novel deep learning model based on convolutional neural networks for employee churn prediction," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(3), pages 539-550, April.
    18. Borchert, Philipp & Coussement, Kristof & De Caigny, Arno & De Weerdt, Jochen, 2023. "Extending business failure prediction models with textual website content using deep learning," European Journal of Operational Research, Elsevier, vol. 306(1), pages 348-357.
    19. Kraus, Mathias & Tschernutter, Daniel & Weinzierl, Sven & Zschech, Patrick, 2024. "Interpretable generalized additive neural networks," European Journal of Operational Research, Elsevier, vol. 317(2), pages 303-316.
    20. Lamrhari, Soumaya & Ghazi, Hamid El & Oubrich, Mourad & Faker, Abdellatif El, 2022. "A social CRM analytic framework for improving customer retention, acquisition, and conversion," Technological Forecasting and Social Change, Elsevier, vol. 174(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:joreco:v:79:y:2024:i:c:s0969698924001504. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/journal-of-retailing-and-consumer-services .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.