IDEAS home Printed from https://ideas.repec.org/a/eee/teinso/v74y2023ics0160791x23001380.html
   My bibliography  Save this article

Houston, we have a problem!: The use of ChatGPT in responding to customer complaints

Author

Listed:
  • Koc, Erdogan
  • Hatipoglu, Sercan
  • Kivrak, Oguzhan
  • Celik, Cemal
  • Koc, Kaan

Abstract

This study aims to explore the use of ChatGPT-4 in generating management responses to customer reviews or complaints posted on Tripadvisor. Customer reviews and management responses are viewed as information sources for holidaymakers when they are making their decisions. A negative customer review about a hotel accommodation experience from TripAdvisor together with the response made by hotel management to this review, and the ChatGPT-4 generated management response to the same customer review were evaluated by 40 industry experts based on six dimensions of a service recovery model and three dimensions of justice that are frequently used by researchers. The findings suggest several practical implications mainly that the ChatGPT-4 generated management response satisfies the requirements of an efficient and effective management response. The quality of ChatGPT-4 generated management responses tends to be extremely high and they may be generated within seconds and with little effort. In addition to the several above practical implications, as ChatGPT-4 can measure the severity of service failures based on customer complaints the study has important implications for service failures and recovery literature.

Suggested Citation

  • Koc, Erdogan & Hatipoglu, Sercan & Kivrak, Oguzhan & Celik, Cemal & Koc, Kaan, 2023. "Houston, we have a problem!: The use of ChatGPT in responding to customer complaints," Technology in Society, Elsevier, vol. 74(C).
    • Handle: RePEc:eee:teinso:v:74:y:2023:i:c:s0160791x23001380
    DOI: 10.1016/j.techsoc.2023.102333
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160791X23001380
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.techsoc.2023.102333?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Al-Emran, Mostafa & Griffy-Brown, Charla, 2023. "The role of technology adoption in sustainable development: Overview, opportunities, challenges, and future research agendas," Technology in Society, Elsevier, vol. 73(C).
    2. Khogali, Hisham O. & Mekid, Samir, 2023. "The blended future of automation and AI: Examining some long-term societal and ethical impact features," Technology in Society, Elsevier, vol. 73(C).
    3. Sparks, Beverley A. & So, Kevin Kam Fung & Bradley, Graham L., 2016. "Responding to negative online reviews: The effects of hotel responses on customer inferences of trust and concern," Tourism Management, Elsevier, vol. 53(C), pages 74-85.
    4. Guan, Xinhua & Xie, Lishan & Shen, Wen-Guo & Huan, Tzung-Cheng, 2021. "Are you a tech-savvy person? Exploring factors influencing customers using self-service technology," Technology in Society, Elsevier, vol. 65(C).
    5. Honora, Andreawan & Chih, Wen-Hai & Wang, Kai-Yu, 2022. "Managing social media recovery: The important role of service recovery transparency in retaining customers," Journal of Retailing and Consumer Services, Elsevier, vol. 64(C).
    6. Weitzl, Wolfgang & Hutzinger, Clemens, 2017. "The effects of marketer- and advocate-initiated online service recovery responses on silent bystanders," Journal of Business Research, Elsevier, vol. 80(C), pages 164-175.
    7. Filieri, Raffaele & Alguezaui, Salma & McLeay, Fraser, 2015. "Why do travelers trust TripAdvisor? Antecedents of trust towards consumer-generated media and its influence on recommendation adoption and word of mouth," Tourism Management, Elsevier, vol. 51(C), pages 174-185.
    8. Tekic, Zeljko & Füller, Johann, 2023. "Managing innovation in the era of AI," Technology in Society, Elsevier, vol. 73(C).
    9. Davide Proserpio & Georgios Zervas, 2017. "Online Reputation Management: Estimating the Impact of Management Responses on Consumer Reviews," Marketing Science, INFORMS, vol. 36(5), pages 645-665, September.
    10. Harrison-Walker, L. Jean, 2019. "The critical role of customer forgiveness in successful service recovery," Journal of Business Research, Elsevier, vol. 95(C), pages 376-391.
    11. Li, Feng & Lu, Hui & Hou, Meiqian & Cui, Kangle & Darbandi, Mehdi, 2021. "Customer satisfaction with bank services: The role of cloud services, security, e-learning and service quality," Technology in Society, Elsevier, vol. 64(C).
    12. Liu, Dewen & Lv, Yiliang & Huang, Weidong, 2023. "How do consumers react to chatbots' humorous emojis in service failures," Technology in Society, Elsevier, vol. 73(C).
    13. Ioannis Assiouras & George Skourtis & Antonios Giannopoulos & Dimitrios Buhalis & Elif Karaosmanoglu, 2023. "Testing the relationship between value co-creation, perceived justice and guests’ enjoyment," Current Issues in Tourism, Taylor & Francis Journals, vol. 26(4), pages 587-602, February.
    14. Sony, Michael & Antony, Jiju & Mc Dermott, Olivia & Garza-Reyes, Jose Arturo, 2021. "An empirical examination of benefits, challenges, and critical success factors of industry 4.0 in manufacturing and service sector," Technology in Society, Elsevier, vol. 67(C).
    15. David Gligor & Siddik Bozkurt & Emma Welch, 2023. "Building theoretical sand castles: the case of customer brand engagement," Journal of Marketing Analytics, Palgrave Macmillan, vol. 11(3), pages 297-316, September.
    16. Sharma, Mahak & Antony, Rose & Sehrawat, Rajat & Cruz, Angel Contreras & Daim, Tugrul U., 2022. "Exploring post-adoption behaviors of e-service users: Evidence from the hospitality sector /online travel services," Technology in Society, Elsevier, vol. 68(C).
    17. Yukuan Xu & Zili Zhang & Rob Law & Ziqiong Zhang, 2020. "Effects of online reviews and managerial responses from a review manipulation perspective," Current Issues in Tourism, Taylor & Francis Journals, vol. 23(17), pages 2207-2222, September.
    18. Wei, Chuang & Liu, Maggie Wenjing & Keh, Hean Tat, 2020. "The road to consumer forgiveness is paved with money or apology? The roles of empathy and power in service recovery," Journal of Business Research, Elsevier, vol. 118(C), pages 321-334.
    19. Zhao, Yan & Wen, Lingling & Feng, Xiangnan & Li, Ran & Lin, Xiaolin, 2020. "How managerial responses to online reviews affect customer satisfaction: An empirical study based on additional reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 57(C).
    20. Chenyu Zhang & Junkyu Park & Mark A. Bonn & Meehee Cho, 2021. "Understanding Customer Responses to Service Failures during the COVID-19 Pandemic for Sustained Restaurant Businesses: Focusing on Guanxi," Sustainability, MDPI, vol. 13(6), pages 1-19, March.
    21. Jens Hogreve & Nicola Bilstein & Leonhard Mandl, 2017. "Unveiling the recovery time zone of tolerance: when time matters in service recovery," Journal of the Academy of Marketing Science, Springer, vol. 45(6), pages 866-883, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ullah, Rafid & Ismail, Hishamuddin Bin & Islam Khan, Mohammad Tariqul & Zeb, Ali, 2024. "Nexus between Chat GPT usage dimensions and investment decisions making in Pakistan: Moderating role of financial literacy," Technology in Society, Elsevier, vol. 76(C).
    2. Bin-Nashwan, Saeed Awadh & Sadallah, Mouad & Bouteraa, Mohamed, 2023. "Use of ChatGPT in academia: Academic integrity hangs in the balance," Technology in Society, Elsevier, vol. 75(C).
    3. Pham, Hong Chuong & Duong, Cong Doanh & Nguyen, Giang Khanh Huyen, 2024. "What drives tourists’ continuance intention to use ChatGPT for travel services? A stimulus-organism-response perspective," Journal of Retailing and Consumer Services, Elsevier, vol. 78(C).
    4. Nayoung Jeong & Jihwan Lee, 2024. "An Aspect-Based Review Analysis Using ChatGPT for the Exploration of Hotel Service Failures," Sustainability, MDPI, vol. 16(4), pages 1-25, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Surachartkumtonkun, Jiraporn (Nui) & Grace, Debra & Ross, Mitchell, 2021. "Unfair customer reviews: Third-party perceptions and managerial responses," Journal of Business Research, Elsevier, vol. 132(C), pages 631-640.
    2. Ku, Hsuan-Hsuan & Shang, Rong-An & Fu, Yi-Fan, 2021. "Social learning effects of complaint handling on social media: Self-construal as a moderator," Journal of Retailing and Consumer Services, Elsevier, vol. 59(C).
    3. Roppelt, Julia Stefanie & Kanbach, Dominik K. & Kraus, Sascha, 2024. "Artificial intelligence in healthcare institutions: A systematic literature review on influencing factors," Technology in Society, Elsevier, vol. 76(C).
    4. Zhu, John Jianjun & Chang, Yung-Chun & Ku, Chih-Hao & Li, Stella Yiyan & Chen, Chi-Jen, 2021. "Online critical review classification in response strategy and service provider rating: Algorithms from heuristic processing, sentiment analysis to deep learning," Journal of Business Research, Elsevier, vol. 129(C), pages 860-877.
    5. Zhao, Yan & Wen, Lingling & Feng, Xiangnan & Li, Ran & Lin, Xiaolin, 2020. "How managerial responses to online reviews affect customer satisfaction: An empirical study based on additional reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 57(C).
    6. Honora, Andreawan & Chih, Wen-Hai & Wang, Kai-Yu, 2022. "Managing social media recovery: The important role of service recovery transparency in retaining customers," Journal of Retailing and Consumer Services, Elsevier, vol. 64(C).
    7. Ao Shen & Peng Wang & Yongyuan Ma, 2022. "When crowding‐in and when crowding‐out? The boundary conditions on the relationship between negative online reviews and online sales," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 43(6), pages 2016-2032, September.
    8. Sheng, Jie, 2019. "Being Active in Online Communications: Firm Responsiveness and Customer Engagement Behaviour," Journal of Interactive Marketing, Elsevier, vol. 46(C), pages 40-51.
    9. T. Ravichandran & Chaoqun Deng, 2023. "Effects of Managerial Response to Negative Reviews on Future Review Valence and Complaints," Information Systems Research, INFORMS, vol. 34(1), pages 319-341, March.
    10. Liao, Junyun & Chen, Jiawen & Zhao, Haichuan & Li, Muhua, 2023. "Fanning the flames: Transmitting negative word of mouth of rival brands," Journal of Business Research, Elsevier, vol. 154(C).
    11. Xinxin Guo & Juho Pesonen & Raija Komppula, 2021. "Comparing online travel review platforms as destination image information agents," Information Technology & Tourism, Springer, vol. 23(2), pages 159-187, June.
    12. Ali, Omar & Murray, Peter A. & Momin, Mujtaba & Al-Anzi, Fawaz S., 2023. "The knowledge and innovation challenges of ChatGPT: A scoping review," Technology in Society, Elsevier, vol. 75(C).
    13. Zhou, Cheng & Chang, Qian, 2024. "Informational or emotional? Exploring the relative effects of chatbots’ self-recovery strategies on consumer satisfaction," Journal of Retailing and Consumer Services, Elsevier, vol. 78(C).
    14. Huang, Ran & Ha, Sejin, 2020. "The effects of warmth-oriented and competence-oriented service recovery messages on observers on online platforms," Journal of Business Research, Elsevier, vol. 121(C), pages 616-627.
    15. Li, Jinhua & Liu, Li & Qing, Qiankai, 2022. "Differentiated consumer forgiveness for different corporate social irresponsibility domains: The moderating role of corporate reputation and patriotism," Journal of Retailing and Consumer Services, Elsevier, vol. 69(C).
    16. Raffaele Filieri & Elisabetta Raguseo & Claudio Vitari, 2018. "When are extreme ratings more helpful? Empirical evidence on the moderating effects of review characteristics and product type," Grenoble Ecole de Management (Post-Print) halshs-01923243, HAL.
    17. Papadopoulou, Christina & Vardarsuyu, Merve & Oghazi, Pejvak, 2023. "Examining the relationships between brand authenticity, perceived value, and brand forgiveness: The role of cross-cultural happiness," Journal of Business Research, Elsevier, vol. 167(C).
    18. Nika Meyer (née Mozafari) & Melanie Schwede & Maik Hammerschmidt & Welf Hermann Weiger, 2022. "Users taking the blame? How service failure, recovery, and robot design affect user attributions and retention," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(4), pages 2491-2505, December.
    19. Marius Johnen & Oliver Schnittka, 2019. "When pushing back is good: the effectiveness of brand responses to social media complaints," Journal of the Academy of Marketing Science, Springer, vol. 47(5), pages 858-878, September.
    20. Yang, Luming & Xu, Min & Xing, Lin, 2022. "Exploring the core factors of online purchase decisions by building an E-Commerce network evolution model," Journal of Retailing and Consumer Services, Elsevier, vol. 64(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:teinso:v:74:y:2023:i:c:s0160791x23001380. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/technology-in-society .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.