IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v35y2024i3p936-955.html
   My bibliography  Save this article

More Than a Bot? The Impact of Disclosing Human Involvement on Customer Interactions with Hybrid Service Agents

Author

Listed:
  • Ulrich Gnewuch

    (Karlsruhe Institute of Technology, 76133 Karlsruhe, Germany)

  • Stefan Morana

    (Saarland University, 66123 Saarbrücken, Germany)

  • Oliver Hinz

    (Goethe University Frankfurt, 60323 Frankfurt am Main, Germany)

  • Ralf Kellner

    (University of Passau, 94032 Passau, Germany)

  • Alexander Maedche

    (Karlsruhe Institute of Technology, 76133 Karlsruhe, Germany)

Abstract

The proliferation of hybrid service agents—combinations of artificial intelligence (AI) and human employees behind a single interface—further blurs the line between humans and technology in online service encounters. While much of the current debate focuses on disclosing the nonhuman identity of AI-based technologies (e.g., chatbots), the question of whether to also disclose the involvement of human employees working behind the scenes has received little attention. We address this gap by examining how such a disclosure affects customer interactions with a hybrid service agent consisting of an AI-based chatbot and human employees. Results from a randomized field experiment and a controlled online experiment show that disclosing human involvement before or during an interaction with the hybrid service agent leads customers to adopt a more human-oriented communication style. This effect is driven by impression management concerns that are activated when customers become aware of humans working in tandem with the chatbot. The more human-oriented communication style ultimately increases employee workload because fewer customer requests can be handled automatically by the chatbot and must be delegated to a human. These findings provide novel insights into how and why disclosing human involvement affects customer communication behavior, shed light on its negative consequences for employees working in tandem with a chatbot, and help managers understand the potential costs and benefits of providing transparency in customer–hybrid service agent interactions.

Suggested Citation

  • Ulrich Gnewuch & Stefan Morana & Oliver Hinz & Ralf Kellner & Alexander Maedche, 2024. "More Than a Bot? The Impact of Disclosing Human Involvement on Customer Interactions with Hybrid Service Agents," Information Systems Research, INFORMS, vol. 35(3), pages 936-955, September.
  • Handle: RePEc:inm:orisre:v:35:y:2024:i:3:p:936-955
    DOI: 10.1287/isre.2022.0152
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.2022.0152
    Download Restriction: no

    File URL: https://libkey.io/10.1287/isre.2022.0152?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Andreas Fügener & Jörn Grahl & Alok Gupta & Wolfgang Ketter, 2022. "Cognitive Challenges in Human–Artificial Intelligence Collaboration: Investigating the Path Toward Productive Delegation," Information Systems Research, INFORMS, vol. 33(2), pages 678-696, June.
    2. Huang, Yu-Shan (Sandy) & Dootson, Paula, 2022. "Chatbots and service failure: When does it lead to customer aggression," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    3. Anuj Kumar & Rahul Telang, 2012. "Does the Web Reduce Customer Service Cost? Empirical Evidence from a Call Center," Information Systems Research, INFORMS, vol. 23(3-part-1), pages 721-737, September.
    4. Ekaterina Jussupow & Kai Spohrer & Armin Heinzl & Joshua Gawlitza, 2021. "Augmenting Medical Diagnosis Decisions? An Investigation into Physicians’ Decision-Making Process with Artificial Intelligence," Information Systems Research, INFORMS, vol. 32(3), pages 713-735, September.
    5. Xueming Luo & Siliang Tong & Zheng Fang & Zhe Qu, 2019. "Frontiers: Machines vs. Humans: The Impact of Artificial Intelligence Chatbot Disclosure on Customer Purchases," Marketing Science, INFORMS, vol. 38(6), pages 937-947, November.
    6. Noah Castelo & Johannes Boegershausen & Christian Hildebrand & Alexander P Henkel & June Cotte & Klaus Wertenbroch, 2023. "Understanding and Improving Consumer Reactions to Service Bots," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 50(4), pages 848-863.
    7. Robinson, Stacey & Orsingher, Chiara & Alkire, Linda & De Keyser, Arne & Giebelhausen, Michael & Papamichail, K. Nadia & Shams, Poja & Temerak, Mohamed Sobhy, 2020. "Frontline encounters of the AI kind: An evolved service encounter framework," Journal of Business Research, Elsevier, vol. 116(C), pages 366-376.
    8. Xinshu Zhao & John G. Lynch & Qimei Chen, 2010. "Reconsidering Baron and Kenny: Myths and Truths about Mediation Analysis," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 37(2), pages 197-206, August.
    9. Jussupow, Ekaterina & Spohrer, Kai & Heinzl, Armin & Gawlitza, Joshua, 2021. "Augmenting Medical Diagnosis Decisions? An Investigation into Physicians’ Decision-Making Process with Artificial Intelligence," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 137446, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    10. Sulin Ba & Jan Stallaert & Zhongju Zhang, 2010. "Balancing IT with the Human Touch: Optimal Investment in IT-Based Customer Service," Information Systems Research, INFORMS, vol. 21(3), pages 423-442, September.
    11. Argo, Jennifer J. & Dahl, Darren W., 2020. "Social Influence in the Retail Context: A Contemporary Review of the Literature," Journal of Retailing, Elsevier, vol. 96(1), pages 25-39.
    12. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    13. Daniela Castillo & Ana Isabel Canhoto & Emanuel Said, 2021. "The dark side of AI-powered service interactions: exploring the process of co-destruction from the customer perspective," The Service Industries Journal, Taylor & Francis Journals, vol. 41(13-14), pages 900-925, October.
    14. Hemant Jain & Balaji Padmanabhan & Paul A. Pavlou & T. S. Raghu, 2021. "Editorial for the Special Section on Humans, Algorithms, and Augmented Intelligence: The Future of Work, Organizations, and Society," Information Systems Research, INFORMS, vol. 32(3), pages 675-687, September.
    15. Rosseel, Yves, 2012. "lavaan: An R Package for Structural Equation Modeling," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i02).
    16. Jingjun (David) Xu & Izak Benbasat & Ronald T. Cenfetelli, 2014. "Research Note ---The Influences of Online Service Technologies and Task Complexity on Efficiency and Personalization," Information Systems Research, INFORMS, vol. 25(2), pages 420-436, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dawei (David) Zhang & Gang Peng & Yuliang Yao & Tyson R. Browning, 2024. "Is a College Education Still Enough? The IT-Labor Relationship with Education Level, Task Routineness, and Artificial Intelligence," Information Systems Research, INFORMS, vol. 35(3), pages 992-1010, September.
    2. Li, Meichan & Wang, Rui, 2023. "Chatbots in e-commerce: The effect of chatbot language style on customers’ continuance usage intention and attitude toward brand," Journal of Retailing and Consumer Services, Elsevier, vol. 71(C).
    3. Sullivan, Yulia & Fosso Wamba, Samuel, 2024. "Artificial intelligence and adaptive response to market changes: A strategy to enhance firm performance and innovation," Journal of Business Research, Elsevier, vol. 174(C).
    4. Weiguang Wang & Guodong (Gordon) Gao & Ritu Agarwal, 2024. "Friend or Foe? Teaming Between Artificial Intelligence and Workers with Variation in Experience," Management Science, INFORMS, vol. 70(9), pages 5753-5775, September.
    5. Erdem Dogukan Yilmaz & Christian Peukert, 2024. "Who Benefits from AI? Project-Level Evidence on Labor Demand, Operations and Profitability," CESifo Working Paper Series 11321, CESifo.
    6. Zhou, Cheng & Chang, Qian, 2024. "Informational or emotional? Exploring the relative effects of chatbots’ self-recovery strategies on consumer satisfaction," Journal of Retailing and Consumer Services, Elsevier, vol. 78(C).
    7. Martin Adam & Konstantin Roethke & Alexander Benlian, 2023. "Human vs. Automated Sales Agents: How and Why Customer Responses Shift Across Sales Stages," Information Systems Research, INFORMS, vol. 34(3), pages 1148-1168, September.
    8. Tinglong Dai & Sridhar Tayur, 2022. "Designing AI‐augmented healthcare delivery systems for physician buy‐in and patient acceptance," Production and Operations Management, Production and Operations Management Society, vol. 31(12), pages 4443-4451, December.
    9. Christoph Riedl & Eric Bogert, 2024. "Effects of AI Feedback on Learning, the Skill Gap, and Intellectual Diversity," Papers 2409.18660, arXiv.org.
    10. Cloarec, Julien, 2022. "Privacy controls as an information source to reduce data poisoning in artificial intelligence-powered personalization," Journal of Business Research, Elsevier, vol. 152(C), pages 144-153.
    11. Wenigmann, Marc & Weiß, Julia & Heidelberg, Rahel, 2024. "Holding anti-feminist gender role beliefs mediate the relationship between family-related adverse childhood experiences and different forms of intimate partner violence perpetration in adulthood," Journal of Criminal Justice, Elsevier, vol. 93(C).
    12. Xitong Li & Jörn Grahl & Oliver Hinz, 2022. "How Do Recommender Systems Lead to Consumer Purchases? A Causal Mediation Analysis of a Field Experiment," Information Systems Research, INFORMS, vol. 33(2), pages 620-637, June.
    13. Kamoonpuri, Sana Zehra & Sengar, Anita, 2023. "Hi, May AI help you? An analysis of the barriers impeding the implementation and use of artificial intelligence-enabled virtual assistants in retail," Journal of Retailing and Consumer Services, Elsevier, vol. 72(C).
    14. Roggeveen, Anne L. & Grewal, Dhruv & Karsberg, John & Noble, Stephanie M. & Nordfält, Jens & Patrick, Vanessa M. & Schweiger, Elisa & Soysal, Gonca & Dillard, Annemarie & Cooper, Nora & Olson, Richard, 2021. "Forging meaningful consumer-brand relationships through creative merchandise offerings and innovative merchandising strategies," Journal of Retailing, Elsevier, vol. 97(1), pages 81-98.
    15. Kevin Bauer & Andrej Gill, 2024. "Mirror, Mirror on the Wall: Algorithmic Assessments, Transparency, and Self-Fulfilling Prophecies," Information Systems Research, INFORMS, vol. 35(1), pages 226-248, March.
    16. Mi, Yunlong & Wang, Zongrun & Quan, Pei & Shi, Yong, 2024. "A semi-supervised concept-cognitive computing system for dynamic classification decision making with limited feedback information," European Journal of Operational Research, Elsevier, vol. 315(3), pages 1123-1138.
    17. Ioannis Bellos & Stylianos Kavadias, 2019. "When Should Customers Control Service Delivery? Implications for Service Design," Production and Operations Management, Production and Operations Management Society, vol. 28(4), pages 890-907, April.
    18. Chen, Qian & Gong, Yeming & Lu, Yaobin & Tang, Jing, 2022. "Classifying and measuring the service quality of AI chatbot in frontline service," Journal of Business Research, Elsevier, vol. 145(C), pages 552-568.
    19. Angel M. Dzhambov & Peter Lercher & Drozdstoy Stoyanov & Nadezhda Petrova & Stoyan Novakov & Donka D. Dimitrova, 2021. "University Students’ Self-Rated Health in Relation to Perceived Acoustic Environment during the COVID-19 Home Quarantine," IJERPH, MDPI, vol. 18(5), pages 1-21, March.
    20. Sabrina Bonanati & Charlott Rubach, 2022. "Reciprocal Relationship between Parents’ School- and Home-Based Involvement and Children’s Reading Achievement during the First Year of Elementary School," Societies, MDPI, vol. 12(2), pages 1-15, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:35:y:2024:i:3:p:936-955. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.