IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v145y2022icp552-568.html
   My bibliography  Save this article

Classifying and measuring the service quality of AI chatbot in frontline service

Author

Listed:
  • Chen, Qian
  • Gong, Yeming
  • Lu, Yaobin
  • Tang, Jing

Abstract

AI chatbots have been widely applied in the frontline to serve customers. Yet, the existing dimensions and scales of service quality can hardly fit the new AI environment. To address this gap, we define the dimensions of AI chatbot service quality (AICSQ) and develop the associated scales with a mixed-method approach. In the qualitative analysis, with the coding of the interviews from 55 global organizations in 17 countries and 47 customers, we develop new multi-level dimensions of AICSQ, including seven second-order and 18 first-order constructs. Then we follow a 10-step scale development method to establish the valid scales. The nomological test result shows that AICSQ positively influences customers’ satisfaction with, perceived value of, and intention of continuous use of AI chatbots. The innovative dimensions and scales of AI chatbot service quality provide conceptual classification and measurement instruments for the future study of chatbot service in the frontline.

Suggested Citation

  • Chen, Qian & Gong, Yeming & Lu, Yaobin & Tang, Jing, 2022. "Classifying and measuring the service quality of AI chatbot in frontline service," Journal of Business Research, Elsevier, vol. 145(C), pages 552-568.
    • Handle: RePEc:eee:jbrese:v:145:y:2022:i:c:p:552-568
    DOI: 10.1016/j.jbusres.2022.02.088
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148296322002272
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbusres.2022.02.088?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Loureiro, Sandra Maria Correia & Guerreiro, João & Tussyadiah, Iis, 2021. "Artificial intelligence in business: State of the art and future research agenda," Journal of Business Research, Elsevier, vol. 129(C), pages 911-926.
    2. Ronald T. Cenfetelli & Izak Benbasat & Sameh Al-Natour, 2008. "Addressing the What and How of Online Services: Positioning Supporting-Services Functionality and Service Quality for Business-to-Consumer Success," Information Systems Research, INFORMS, vol. 19(2), pages 161-181, June.
    3. Felipe Thomaz & Carolina Salge & Elena Karahanna & John Hulland, 2020. "Learning from the Dark Web: leveraging conversational agents in the era of hyper-privacy to enhance marketing," Journal of the Academy of Marketing Science, Springer, vol. 48(1), pages 43-63, January.
    4. Kar Yan Tam & Shuk Ying Ho, 2005. "Web Personalization as a Persuasion Strategy: An Elaboration Likelihood Model Perspective," Information Systems Research, INFORMS, vol. 16(3), pages 271-291, September.
    5. Xueming Luo & Siliang Tong & Zheng Fang & Zhe Qu, 2019. "Frontiers: Machines vs. Humans: The Impact of Artificial Intelligence Chatbot Disclosure on Customer Purchases," Marketing Science, INFORMS, vol. 38(6), pages 937-947, November.
    6. Jonathan W. Palmer, 2002. "Web Site Usability, Design, and Performance Metrics," Information Systems Research, INFORMS, vol. 13(2), pages 151-167, June.
    7. Barbara H. Wixom & Peter A. Todd, 2005. "A Theoretical Integration of User Satisfaction and Technology Acceptance," Information Systems Research, INFORMS, vol. 16(1), pages 85-102, March.
    8. Sulin Ba & Jan Stallaert & Zhongju Zhang, 2010. "Balancing IT with the Human Touch: Optimal Investment in IT-Based Customer Service," Information Systems Research, INFORMS, vol. 21(3), pages 423-442, September.
    9. Thomas P. Novak & Donna L. Hoffman, 2019. "Relationship journeys in the internet of things: a new framework for understanding interactions between consumers and smart objects," Journal of the Academy of Marketing Science, Springer, vol. 47(2), pages 216-237, March.
    10. James A. Mourey & Jenny G. Olson & Carolyn Yoon, 2017. "Products as Pals: Engaging with Anthropomorphic Products Mitigates the Effects of Social Exclusion," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 44(2), pages 414-431.
    11. Murtarelli, Grazia & Gregory, Anne & Romenti, Stefania, 2021. "A conversation-based perspective for shaping ethical human–machine interactions: The particular challenge of chatbots," Journal of Business Research, Elsevier, vol. 129(C), pages 927-935.
    12. William H. DeLone & Ephraim R. McLean, 1992. "Information Systems Success: The Quest for the Dependent Variable," Information Systems Research, INFORMS, vol. 3(1), pages 60-95, March.
    13. Sheehan, Ben & Jin, Hyun Seung & Gottlieb, Udo, 2020. "Customer service chatbots: Anthropomorphism and adoption," Journal of Business Research, Elsevier, vol. 115(C), pages 14-24.
    14. Zied Mani & Inès Chouk, 2018. "Consumer Resistance to Innovation in Services," Post-Print hal-03700875, HAL.
    15. Rijsdijk, S.A. & Hultink, E.J. & Diamantopoulos, A., 2007. "Product Intelligence: Its Conceptualization, Measurement and Impact on Consumer Satisfaction," ERIM Report Series Research in Management ERS-2007-006-ORG, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Akbari, Morteza & Foroudi, Pantea & Zaman Fashami, Rahime & Mahavarpour, Nasrin & Khodayari, Maryam, 2022. "Let us talk about something: The evolution of e-WOM from the past to the future," Journal of Business Research, Elsevier, vol. 149(C), pages 663-689.
    2. Souha Al-Geitany & Hasan Yousef Aljuhmani & Okechukwu Lawrence Emeagwali & Elsie Nasr, 2023. "Consumer Behavior in the Post-COVID-19 Era: The Impact of Perceived Interactivity on Behavioral Intention in the Context of Virtual Conferences," Sustainability, MDPI, vol. 15(11), pages 1-23, May.
    3. Guo, Wenshan & Luo, Qiangqiang, 2023. "Investigating the impact of intelligent personal assistants on the purchase intentions of Generation Z consumers: The moderating role of brand credibility," Journal of Retailing and Consumer Services, Elsevier, vol. 73(C).
    4. Shahzad, Muhammad Farrukh & Xu, Shuo & An, Xin & Javed, Iqra, 2024. "Assessing the impact of AI-chatbot service quality on user e-brand loyalty through chatbot user trust, experience and electronic word of mouth," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    5. Huang, Dongling & Markovitch, Dmitri G. & Stough, Rusty A., 2024. "Can chatbot customer service match human service agents on customer satisfaction? An investigation in the role of trust," Journal of Retailing and Consumer Services, Elsevier, vol. 76(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Justina Sidlauskiene & Yannick Joye & Vilte Auruskeviciene, 2023. "AI-based chatbots in conversational commerce and their effects on product and price perceptions," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-21, December.
    2. Mariani, Marcello M. & Hashemi, Novin & Wirtz, Jochen, 2023. "Artificial intelligence empowered conversational agents: A systematic literature review and research agenda," Journal of Business Research, Elsevier, vol. 161(C).
    3. Mark Anthony Camilleri & Ciro Troise, 2023. "Live support by chatbots with artificial intelligence: A future research agenda," Service Business, Springer;Pan-Pacific Business Association, vol. 17(1), pages 61-80, March.
    4. Baabdullah, Abdullah M. & Alalwan, Ali Abdallah & Algharabat, Raed S. & Metri, Bhimaraya & Rana, Nripendra P., 2022. "Virtual agents and flow experience: An empirical examination of AI-powered chatbots," Technological Forecasting and Social Change, Elsevier, vol. 181(C).
    5. Sriram Thirumalai & Kingshuk K. Sinha, 2013. "To Personalize or Not to Personalize Online Purchase Interactions: Implications of Self-Selection by Retailers," Information Systems Research, INFORMS, vol. 24(3), pages 683-708, September.
    6. Alabed, Amani & Javornik, Ana & Gregory-Smith, Diana, 2022. "AI anthropomorphism and its effect on users' self-congruence and self–AI integration: A theoretical framework and research agenda," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    7. Hwang, ShinYoung, 2018. "Would satisfaction with smart speakers transfer into loyalty towards the smart speaker provider?," 22nd ITS Biennial Conference, Seoul 2018. Beyond the boundaries: Challenges for business, policy and society 190336, International Telecommunications Society (ITS).
    8. Song, Jaeki & Baker, Jeff & Lee, Sangno & Wetherbe, James C., 2012. "Examining online consumers’ behavior: A service-oriented view," International Journal of Information Management, Elsevier, vol. 32(3), pages 221-231.
    9. Massilva Dekkal & Manon Arcand & Sandrine Prom Tep & Lova Rajaobelina & Line Ricard, 2024. "Factors affecting user trust and intention in adopting chatbots: the moderating role of technology anxiety in insurtech," Journal of Financial Services Marketing, Palgrave Macmillan, vol. 29(3), pages 699-728, September.
    10. Selamat, Moch Akbar & Windasari, Nila Armelia, 2021. "Chatbot for SMEs: Integrating customer and business owner perspectives," Technology in Society, Elsevier, vol. 66(C).
    11. Shengliang Zhang & Xinfeng Lin & Xiaodong Li & Ai Ren, 2022. "Service robots’ anthropomorphism: dimensions, factors and internal relationships," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(1), pages 277-295, March.
    12. Kull, Alexander J. & Romero, Marisabel & Monahan, Lisa, 2021. "How may I help you? Driving brand engagement through the warmth of an initial chatbot message," Journal of Business Research, Elsevier, vol. 135(C), pages 840-850.
    13. Darima Fotheringham & Michael A. Wiles, 2023. "The effect of implementing chatbot customer service on stock returns: an event study analysis," Journal of the Academy of Marketing Science, Springer, vol. 51(4), pages 802-822, July.
    14. Jin P. Gerlach & Ronald T. Cenfetelli, 2022. "Overcoming the Single-IS Paradigm in Individual-Level IS Research," Information Systems Research, INFORMS, vol. 33(2), pages 476-488, June.
    15. Turel, Ofir & Connelly, Catherine E., 2013. "Too busy to help: Antecedents and outcomes of interactional justice in web-based service encounters," International Journal of Information Management, Elsevier, vol. 33(4), pages 674-683.
    16. Aladwani, Adel M. & Dwivedi, Yogesh K., 2018. "Towards a theory of SocioCitizenry: Quality anticipation, trust configuration, and approved adaptation of governmental social media," International Journal of Information Management, Elsevier, vol. 43(C), pages 261-272.
    17. Thomas P. Novak & Donna L. Hoffman, 2019. "Relationship journeys in the internet of things: a new framework for understanding interactions between consumers and smart objects," Journal of the Academy of Marketing Science, Springer, vol. 47(2), pages 216-237, March.
    18. Yi Sun & Shihui Li & Lingling Yu, 2022. "The dark sides of AI personal assistant: effects of service failure on user continuance intention," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(1), pages 17-39, March.
    19. Ilham Hidayah Napitupulu, 2023. "Internal Control, Manager’s Competency, Management Accounting Information Systems and Good Corporate Governance: Evidence from Rural Banks in Indonesia," Global Business Review, International Management Institute, vol. 24(3), pages 563-585, June.
    20. Zhu, Yimin & Zhang, Jiemin & Wu, Jifei & Liu, Yingyue, 2022. "AI is better when I'm sure: The influence of certainty of needs on consumers' acceptance of AI chatbots," Journal of Business Research, Elsevier, vol. 150(C), pages 642-652.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:145:y:2022:i:c:p:552-568. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.