IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v175y2024ics0148296324000778.html
   My bibliography  Save this article

The mind in the machine: Estimating mind perception's effect on user satisfaction with voice-based conversational agents

Author

Listed:
  • Yoganathan, Vignesh
  • Osburg, Victoria-Sophie

Abstract

Given the interest in imbuing voice-based conversational agents with humanlike features, understanding how this affects user satisfaction is ultimately important for business performance. Mind perception theory explains how ascribing the mental capacity for agency and experience to artificial intelligence shapes subsequent user attitudes. Hence, we estimate the effect of mind perception on satisfaction in users with high/low innovativeness using data from text-based online reviews, which better reflect actual usage than traditional surveys. Methodologically, where numerous controls affect the cause and outcome variables in a model, traditional machine learning methods produce biased estimates. We overcome this by deploying Double/Debiased Machine Learning (combined with text analytics). Results show that user satisfaction is increased by two forms of perceived experience: directed at moral agents, or moral patients. Perceived agency, however, has no significant influence. The increase in satisfaction from both types of perceived experience is stronger among users with high (vs. low) innovativeness.

Suggested Citation

  • Yoganathan, Vignesh & Osburg, Victoria-Sophie, 2024. "The mind in the machine: Estimating mind perception's effect on user satisfaction with voice-based conversational agents," Journal of Business Research, Elsevier, vol. 175(C).
    • Handle: RePEc:eee:jbrese:v:175:y:2024:i:c:s0148296324000778
    DOI: 10.1016/j.jbusres.2024.114573
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148296324000778
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbusres.2024.114573?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    2. Georges Casamatta & Sauveur Giannoni & Daniel Brunstein & Johan Jouve, 2022. "Host type and pricing on Airbnb: Seasonality and perceived market power," Post-Print hal-03250484, HAL.
    3. Vella, Francis & Verbeek, Marno, 1999. "Estimating and Interpreting Models with Endogenous Treatment Effects," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(4), pages 473-478, October.
    4. Jonah Berger & Grant Packard & Reihane Boghrati & Ming Hsu & Ashlee Humphreys & Andrea Luangrath & Sarah Moore & Gideon Nave & Christopher Olivola & Matthew Rocklage, 2022. "Marketing insights from text analysis," Marketing Letters, Springer, vol. 33(3), pages 365-377, September.
    5. Malodia, Suresh & Kaur, Puneet & Ractham, Peter & Sakashita, Mototaka & Dhir, Amandeep, 2022. "Why do people avoid and postpone the use of voice assistants for transactional purposes? A perspective from decision avoidance theory," Journal of Business Research, Elsevier, vol. 146(C), pages 605-618.
    6. Huber, Martin & Meier, Jonas & Wallimann, Hannes, 2022. "Business analytics meets artificial intelligence: Assessing the demand effects of discounts on Swiss train tickets," Transportation Research Part B: Methodological, Elsevier, vol. 163(C), pages 22-39.
    7. Stefano Guidi & Enrica Marchigiani & Sergio Roncato & Oronzo Parlangeli, 2021. "Human beings and robots: are there any differences in the attribution of punishments for the same crimes?," Behaviour and Information Technology, Taylor & Francis Journals, vol. 40(5), pages 445-453, April.
    8. Yucel, Ahmet & Dag, Ali & Oztekin, Asil & Carpenter, Mark, 2022. "A novel text analytic methodology for classification of product and service reviews," Journal of Business Research, Elsevier, vol. 151(C), pages 287-297.
    9. Garner, Benjamin & Thornton, Corliss & Luo Pawluk, Anita & Mora Cortez, Roberto & Johnston, Wesley & Ayala, Cesar, 2022. "Utilizing text-mining to explore consumer happiness within tourism destinations," Journal of Business Research, Elsevier, vol. 139(C), pages 1366-1377.
    10. Seo Young Kim & Bernd H. Schmitt & Nadia M. Thalmann, 2019. "Eliza in the uncanny valley: anthropomorphizing consumer robots increases their perceived warmth but decreases liking," Marketing Letters, Springer, vol. 30(1), pages 1-12, March.
    11. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "High-Dimensional Methods and Inference on Structural and Treatment Effects," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 29-50, Spring.
    12. Haenlein, Michael & Kaplan, Andreas, 2021. "Artificial intelligence and robotics: Shaking up the business world and society at large," Journal of Business Research, Elsevier, vol. 124(C), pages 405-407.
    13. McLean, Graeme & Osei-Frimpong, Kofi & Barhorst, Jennifer, 2021. "Alexa, do voice assistants influence consumer brand engagement? – Examining the role of AI powered voice assistants in influencing consumer brand engagement," Journal of Business Research, Elsevier, vol. 124(C), pages 312-328.
    14. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey, 2017. "Double/Debiased/Neyman Machine Learning of Treatment Effects," American Economic Review, American Economic Association, vol. 107(5), pages 261-265, May.
    15. Patel, Pankaj C. & Devaraj, Srikant & Quigley, Narda R. & Oghazi, Pejvak, 2020. "The influence of sunlight on taxi driver productivity," Journal of Business Research, Elsevier, vol. 115(C), pages 456-468.
    16. Fernandes, Teresa & Oliveira, Elisabete, 2021. "Understanding consumers’ acceptance of automated technologies in service encounters: Drivers of digital voice assistants adoption," Journal of Business Research, Elsevier, vol. 122(C), pages 180-191.
    17. Ma, Liye & Sun, Baohong, 2020. "Machine learning and AI in marketing – Connecting computing power to human insights," International Journal of Research in Marketing, Elsevier, vol. 37(3), pages 481-504.
    18. Francesca Greco & Ken Riopelle & Francesca Grippa & Andrea Fronzetti Colladon & Julia Gluesing, 2021. "Linguistic sleuthing for innovators," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(3), pages 1027-1045, June.
    19. Ertugrul Uysal & Sascha Alavi & Valéry Bezençon, 2022. "Trojan horse or useful helper? A relationship perspective on artificial intelligence assistants with humanlike features," Journal of the Academy of Marketing Science, Springer, vol. 50(6), pages 1153-1175, November.
    20. Lei Wang & Ram Gopal & Ramesh Shankar & Joseph Pancras, 2022. "Forecasting venue popularity on location‐based services using interpretable machine learning," Production and Operations Management, Production and Operations Management Society, vol. 31(7), pages 2773-2788, July.
    21. Li, Sixian & Peluso, Alessandro M. & Duan, Jinyun, 2023. "Why do we prefer humans to artificial intelligence in telemarketing? A mind perception explanation," Journal of Retailing and Consumer Services, Elsevier, vol. 70(C).
    22. Hasan, Rajibul & Shams, Riad & Rahman, Mizan, 2021. "Consumer trust and perceived risk for voice-controlled artificial intelligence: The case of Siri," Journal of Business Research, Elsevier, vol. 131(C), pages 591-597.
    23. Petrescu, Maria & Ajjan, Haya & Harrison, Dana L., 2023. "Man vs machine – Detecting deception in online reviews," Journal of Business Research, Elsevier, vol. 154(C).
    24. Fronzetti Colladon, Andrea & Toschi, Laura & Ughetto, Elisa & Greco, Francesca, 2023. "The language and social behavior of innovators," Journal of Business Research, Elsevier, vol. 154(C).
    25. Jau-er Chen & Chien-Hsun Huang & Jia-Jyun Tien, 2021. "Debiased/Double Machine Learning for Instrumental Variable Quantile Regressions," Econometrics, MDPI, vol. 9(2), pages 1-18, April.
    26. Patel, Pankaj C. & Pearce, John A. & Bachrach, Daniel G., 2018. "Psychological Distress is increasing among customer-facing retail employees: Evidence from 1997 to 2015," Journal of Business Research, Elsevier, vol. 89(C), pages 21-26.
    27. Hildebrand, Christian & Efthymiou, Fotis & Busquet, Francesc & Hampton, William H. & Hoffman, Donna L. & Novak, Thomas P., 2020. "Voice analytics in business research: Conceptual foundations, acoustic feature extraction, and applications," Journal of Business Research, Elsevier, vol. 121(C), pages 364-374.
    28. Chen, Yan & Zhang, Lei & Zhao, Yulu & Xu, Bing, 2022. "Implementation of penalized survival models in churn prediction of vehicle insurance," Journal of Business Research, Elsevier, vol. 153(C), pages 162-171.
    29. Robert P. Lieli & Yu-Chin Hsu & Ágoston Reguly, 2022. "The Use of Machine Learning in Treatment Effect Estimation," Advanced Studies in Theoretical and Applied Econometrics, in: Felix Chan & László Mátyás (ed.), Econometrics with Machine Learning, chapter 0, pages 79-109, Springer.
    30. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2016. "Double/Debiased Machine Learning for Treatment and Causal Parameters," Papers 1608.00060, arXiv.org, revised Nov 2024.
    31. Carlo Schwarz, 2018. "ldagibbs: A command for topic modeling in Stata using latent Dirichlet allocation," Stata Journal, StataCorp LP, vol. 18(1), pages 101-117, March.
    32. Beeler, Lisa & Zablah, Alex R. & Rapp, Adam, 2022. "Ability is in the eye of the beholder: How context and individual factors shape consumer perceptions of digital assistant ability," Journal of Business Research, Elsevier, vol. 148(C), pages 33-46.
    33. Jonah Berger & Grant Packard & Reihane Boghrati & Ming Hsu & Ashlee Humphreys & Andrea Luangrath & Sarah Moore & Gideon Nave & Christopher Olivola & Matthew Rocklage, 2022. "Correction to: Marketing insights from text analysis," Marketing Letters, Springer, vol. 33(3), pages 379-379, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rohit, Kumar & Shankar, Amit & Katiyar, Gagan & Mehrotra, Ankit & Alzeiby, Ebtesam Abdullah, 2024. "Consumer engagement in chatbots and voicebots. A multiple-experiment approach in online retailing context," Journal of Retailing and Consumer Services, Elsevier, vol. 78(C).
    2. Mariani, Marcello M. & Hashemi, Novin & Wirtz, Jochen, 2023. "Artificial intelligence empowered conversational agents: A systematic literature review and research agenda," Journal of Business Research, Elsevier, vol. 161(C).
    3. Helmut Wasserbacher & Martin Spindler, 2022. "Machine learning for financial forecasting, planning and analysis: recent developments and pitfalls," Digital Finance, Springer, vol. 4(1), pages 63-88, March.
    4. Su, Liangjun & Ura, Takuya & Zhang, Yichong, 2019. "Non-separable models with high-dimensional data," Journal of Econometrics, Elsevier, vol. 212(2), pages 646-677.
    5. Sander Gerritsen & Mark Kattenberg & Sonny Kuijpers, 2019. "The impact of age at arrival on education and mental health," CPB Discussion Paper 389.rdf, CPB Netherlands Bureau for Economic Policy Analysis.
    6. Sander Gerritsen & Mark Kattenberg & Sonny Kuijpers, 2019. "The impact of age at arrival on education and mental health," CPB Discussion Paper 389, CPB Netherlands Bureau for Economic Policy Analysis.
    7. Belloni, Alexandre & Hansen, Christian & Newey, Whitney, 2022. "High-dimensional linear models with many endogenous variables," Journal of Econometrics, Elsevier, vol. 228(1), pages 4-26.
    8. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    9. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    10. Songul Cinaroglu, 2020. "Modelling unbalanced catastrophic health expenditure data by using machine‐learning methods," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 27(4), pages 168-181, October.
    11. Mark Kattenberg & Bas Scheer & Jurre Thiel, 2023. "Causal forests with fixed effects for treatment effect heterogeneity in difference-in-differences," CPB Discussion Paper 452, CPB Netherlands Bureau for Economic Policy Analysis.
    12. Yuya Sasaki & Takuya Ura & Yichong Zhang, 2022. "Unconditional quantile regression with high‐dimensional data," Quantitative Economics, Econometric Society, vol. 13(3), pages 955-978, July.
    13. Victor Chernozhukov & Carlos Cinelli & Whitney Newey & Amit Sharma & Vasilis Syrgkanis, 2021. "Long Story Short: Omitted Variable Bias in Causal Machine Learning," Papers 2112.13398, arXiv.org, revised May 2024.
    14. Esfandiar Maasoumi & Jianqiu Wang & Zhuo Wang & Ke Wu, 2024. "Identifying factors via automatic debiased machine learning," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(3), pages 438-461, April.
    15. Guido W. Imbens, 2020. "Potential Outcome and Directed Acyclic Graph Approaches to Causality: Relevance for Empirical Practice in Economics," Journal of Economic Literature, American Economic Association, vol. 58(4), pages 1129-1179, December.
    16. Jushan Bai & Sung Hoon Choi & Yuan Liao, 2021. "Feasible generalized least squares for panel data with cross-sectional and serial correlations," Empirical Economics, Springer, vol. 60(1), pages 309-326, January.
    17. Xing, Lu & Han, DongHao & Hui, Xie, 2023. "The impact of carbon policy on corporate risk-taking with a double/debiased machine learning based difference-in-differences approach," Finance Research Letters, Elsevier, vol. 58(PC).
    18. Yong Bian & Xiqian Wang & Qin Zhang, 2023. "How Does China's Household Portfolio Selection Vary with Financial Inclusion?," Papers 2311.01206, arXiv.org.
    19. Henrika Langen & Martin Huber, 2022. "How causal machine learning can leverage marketing strategies: Assessing and improving the performance of a coupon campaign," Papers 2204.10820, arXiv.org, revised Jun 2022.
    20. Paolo Libenzio Brignoli & Alessandro Varacca & Cornelis Gardebroek & Paolo Sckokai, 2024. "Machine learning to predict grains futures prices," Agricultural Economics, International Association of Agricultural Economists, vol. 55(3), pages 479-497, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:175:y:2024:i:c:s0148296324000778. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.