IDEAS home Printed from https://ideas.repec.org/a/sae/fbbsrw/v12y2023i4p386-402.html
   My bibliography  Save this article

Customer Sentiment Analysis and Prediction of Insurance Products’ Reviews Using Machine Learning Approaches

Author

Listed:
  • Md Shamim Hossain
  • Mst Farjana Rahman

Abstract

The study’s goal is to analyse and predict customer reviews of insurance products using various machine learning techniques. We gathered consumer rating data from the Yelp website and filtered the initial data set to only include insurance reviews. Following cleaning, the filtered summary texts were graded as positive, neutral or negative sentiments, and the AFINN and Valence Aware Dictionary for Sentiment Reasoning (VADER) sentiment algorithms were used to rate those sentiments. Furthermore, the current investigation employs five supervised machine learning approaches to divide customer ratings of insurance companies into three sentiment groups. The results of the current study revealed that the majority of customer reviews for the insurance products were negative, with the average number of words with negative sentiment being higher. In addition, current research discovered that while all of the approaches (decision tree, K Neighbours classifier, support vector machine (SVM), logistic regression and random forest classifier) can correctly classify review text into sentiment class, logistic regression outperforms in high accuracy. We analysed and predicted customer review messages using a variety of machine learning methods, which could help companies better understand how customers respond to their products and services. As a result, companies can learn how to use machine learning methods to better understand the behaviour of their customers.

Suggested Citation

  • Md Shamim Hossain & Mst Farjana Rahman, 2023. "Customer Sentiment Analysis and Prediction of Insurance Products’ Reviews Using Machine Learning Approaches," FIIB Business Review, , vol. 12(4), pages 386-402, December.
  • Handle: RePEc:sae:fbbsrw:v:12:y:2023:i:4:p:386-402
    DOI: 10.1177/23197145221115793
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/23197145221115793
    Download Restriction: no

    File URL: https://libkey.io/10.1177/23197145221115793?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hossain, Md Shamim & Rahman, Mst Farjana, 2022. "Detection of potential customers’ empathy behavior towards customers' reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    2. Geetha, M. & Singha, Pratap & Sinha, Sumedha, 2017. "Relationship between customer sentiment and online customer ratings for hotels - An empirical analysis," Tourism Management, Elsevier, vol. 61(C), pages 43-54.
    3. Thomas Renault, 2020. "Sentiment analysis and machine learning in finance: a comparison of methods and models on one million messages," Digital Finance, Springer, vol. 2(1), pages 1-13, September.
    4. Zeelenberg, M. & Pieters, R., 2004. "Beyond valence in customer dissatisfaction : A review and new findings on behavioral responses to regret and disappointment in failed services," Other publications TiSEM 7bfb4aa9-cba7-4786-850d-1, Tilburg University, School of Economics and Management.
    5. Wu, Jia-Jhou & Chang, Sue-Ting, 2020. "Exploring customer sentiment regarding online retail services: A topic-based approach," Journal of Retailing and Consumer Services, Elsevier, vol. 55(C).
    6. Ha, Young-Won & Hoch, Stephen J, 1989. "Ambiguity, Processing Strategy, and Advertising-Evidence Interactions," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 16(3), pages 354-360, December.
    7. Al-Natour, Sameh & Turetken, Ozgur, 2020. "A comparative assessment of sentiment analysis and star ratings for consumer reviews," International Journal of Information Management, Elsevier, vol. 54(C).
    8. Meek, Stephanie & Wilk, Violetta & Lambert, Claire, 2021. "A big data exploration of the informational and normative influences on the helpfulness of online restaurant reviews," Journal of Business Research, Elsevier, vol. 125(C), pages 354-367.
    9. Maraj Rahman Sofi & Iqbal Ahmad Hakim, 2018. "Customer Relationship Management as Tool to Enhance Competitive Effectiveness: Model Revisited," FIIB Business Review, , vol. 7(3), pages 201-215, September.
    10. Pashchenko, Yana & Rahman, Mst Farjana & Hossain, Md Shamim & Uddin, Md Kutub & Islam, Tarannum, 2022. "Emotional and the normative aspects of customers’ reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    11. Zeelenberg, Marcel & Pieters, Rik, 2004. "Beyond valence in customer dissatisfaction: A review and new findings on behavioral responses to regret and disappointment in failed services," Journal of Business Research, Elsevier, vol. 57(4), pages 445-455, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hossain, Md Shamim & Rahman, Mst Farjana, 2022. "Detection of potential customers’ empathy behavior towards customers' reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    2. Pashchenko, Yana & Rahman, Mst Farjana & Hossain, Md Shamim & Uddin, Md Kutub & Islam, Tarannum, 2022. "Emotional and the normative aspects of customers’ reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    3. Haase, Janina & Wiedmann, Klaus-Peter & Labenz, Franziska, 2022. "Brand hate, rage, anger & co.: Exploring the relevance and characteristics of negative consumer emotions toward brands," Journal of Business Research, Elsevier, vol. 152(C), pages 1-16.
    4. Cambra-Fierro, Jesus & Melero, Iguacel & Sese, F. Javier, 2015. "Managing Complaints to Improve Customer Profitability," Journal of Retailing, Elsevier, vol. 91(1), pages 109-124.
    5. Nur’Hidayah Che Ahmat Author_Email: nurhidayahcheahmat@gmail.com & Salleh Mohd Radzi & Mohd Salehuddin Mohd Zahari & Rosmaliza Muhammad, 2011. "The Effect Of Factors Influencing The Perception Of Price Fairness Towards Customer Response Behaviors," 2nd International Conference on Business and Economic Research (2nd ICBER 2011) Proceeding 2011-169, Conference Master Resources.
    6. Ivan Barreda-Tarrazona & Ainhoa Jaramillo-Gutierrez & Daniel Navarro-Martinez & Gerardo Sabater-Grande, 2014. "The role of forgone opportunities in decision making under risk," Journal of Risk and Uncertainty, Springer, vol. 49(2), pages 167-188, October.
    7. Lee, K.M.C. & Kraussl, R.G.W. & Paas, L.J., 2009. "The effect of anticipated and experienced regret and pride on investors' future selling decisions," Serie Research Memoranda 0057, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    8. McColl-Kennedy, Janet R. & Patterson, Paul G. & Smith, Amy K. & Brady, Michael K., 2009. "Customer Rage Episodes: Emotions, Expressions and Behaviors," Journal of Retailing, Elsevier, vol. 85(2), pages 222-237.
    9. Hasan Al-Banna & Izra Berakon, 2024. "From bank to P2P lending: switching intention of SME’s: evidence from Indonesia," Journal of Financial Services Marketing, Palgrave Macmillan, vol. 29(2), pages 568-581, June.
    10. Nan Yang & Nikolaos Korfiatis & Dimitris Zissis & Konstantina Spanaki, 2024. "Incorporating topic membership in review rating prediction from unstructured data: a gradient boosting approach," Annals of Operations Research, Springer, vol. 339(1), pages 631-662, August.
    11. Haithem Zourrig & Jean-Charles Chebat & Roy Toffoli & Alexandra Medina-Borja, 2014. "Customers’ coping with interpersonal conflicts in intra and inter-cultural service encounters," AMS Review, Springer;Academy of Marketing Science, vol. 4(1), pages 21-31, June.
    12. Liu, Zhenkun & Zhang, Ying & Abedin, Mohammad Zoynul & Wang, Jianzhou & Yang, Hufang & Gao, Yuyang & Chen, Yinghao, 2024. "Profit-driven fusion framework based on bagging and boosting classifiers for potential purchaser prediction," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    13. Anna Kukla-Gryz & Joanna Tyrowicz & Michał Krawczyk, 2021. "Digital piracy and the perception of price fairness: evidence from a field experiment," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 45(1), pages 105-131, March.
    14. Shahid Sameeni, Maleeha & Ahmad, Wasim & Filieri, Raffaele, 2022. "Brand betrayal, post-purchase regret, and consumer responses to hedonic versus utilitarian products: The moderating role of betrayal discovery mode," Journal of Business Research, Elsevier, vol. 141(C), pages 137-150.
    15. Wang, Saerom & Kirillova, Ksenia & Lehto, Xinran, 2017. "Reconciling unsatisfying tourism experiences: Message type effectiveness and the role of counterfactual thinking," Tourism Management, Elsevier, vol. 60(C), pages 233-243.
    16. Yi Feng & Yunqiang Yin & Dujuan Wang & Lalitha Dhamotharan & Joshua Ignatius & Ajay Kumar, 2023. "Diabetic patient review helpfulness: unpacking online drug treatment reviews by text analytics and design science approach," Annals of Operations Research, Springer, vol. 328(1), pages 387-418, September.
    17. Wedel, Michel & Bigné, Enrique & Zhang, Jie, 2020. "Virtual and augmented reality: Advancing research in consumer marketing," International Journal of Research in Marketing, Elsevier, vol. 37(3), pages 443-465.
    18. White, Allyn & Breazeale, Michael & Collier, Joel E., 2012. "The Effects of Perceived Fairness on Customer Responses to Retailer SST Push Policies," Journal of Retailing, Elsevier, vol. 88(2), pages 250-261.
    19. Tom Joonhwan Kim & Youjae Yi & Jongan Choi, 2020. "The boomerang effect of brand personality congruency in a product-harm crisis," Australian Journal of Management, Australian School of Business, vol. 45(4), pages 645-661, November.
    20. Hussain, Rahim & Al Nasser, Amjad & Hussain, Yomna K., 2015. "Service quality and customer satisfaction of a UAE-based airline: An empirical investigation," Journal of Air Transport Management, Elsevier, vol. 42(C), pages 167-175.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:fbbsrw:v:12:y:2023:i:4:p:386-402. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.