IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v121y2020icp364-374.html
   My bibliography  Save this article

Voice analytics in business research: Conceptual foundations, acoustic feature extraction, and applications

Author

Listed:
  • Hildebrand, Christian
  • Efthymiou, Fotis
  • Busquet, Francesc
  • Hampton, William H.
  • Hoffman, Donna L.
  • Novak, Thomas P.

Abstract

Recent advances in artificial intelligence and natural language processing are gradually transforming how humans search, shop, and express their preferences. Leveraging the new affordances and modalities of human–machine interaction through voice-controlled interfaces will require a nuanced understanding of the physics and psychology of speech formation as well as the systematic extraction and analysis of vocal features from the human voice. In this paper, we first develop a conceptual framework linking vocal features in the human voice to experiential outcomes and emotional states. We then illustrate the effective processing, editing, analysis, and visualization of voice data based on an Amazon Alexa user interaction, utilizing state-of-the-art signal-processing packages in R. Finally, we offer novel insight into the ways in which business research might employ voice and sound analytics moving forward, including a discussion of the ethical implications of building multi-modal databases for business and society.

Suggested Citation

  • Hildebrand, Christian & Efthymiou, Fotis & Busquet, Francesc & Hampton, William H. & Hoffman, Donna L. & Novak, Thomas P., 2020. "Voice analytics in business research: Conceptual foundations, acoustic feature extraction, and applications," Journal of Business Research, Elsevier, vol. 121(C), pages 364-374.
    • Handle: RePEc:eee:jbrese:v:121:y:2020:i:c:p:364-374
    DOI: 10.1016/j.jbusres.2020.09.020
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148296320306044
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbusres.2020.09.020?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Donna L Hoffman & Thomas P Novak & Eileen FischerEditor & Robert KozinetsAssociate Editor, 2018. "Consumer and Object Experience in the Internet of Things: An Assemblage Theory Approach," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 44(6), pages 1178-1204.
    2. Shiri Melumad & Rhonda Hadi & Christian Hildebrand & Adrian F. Ward, 2020. "Technology-Augmented Choice: How Digital Innovations Are Transforming Consumer Decision Processes," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 7(3), pages 90-101, October.
    3. Thomas P. Novak & Donna L. Hoffman, 2019. "Relationship journeys in the internet of things: a new framework for understanding interactions between consumers and smart objects," Journal of the Academy of Marketing Science, Springer, vol. 47(2), pages 216-237, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Naim Zierau & Christian Hildebrand & Anouk Bergner & Francesc Busquet & Anuschka Schmitt & Jan Marco Leimeister, 2023. "Voice bots on the frontline: Voice-based interfaces enhance flow-like consumer experiences & boost service outcomes," Journal of the Academy of Marketing Science, Springer, vol. 51(4), pages 823-842, July.
    2. Haenlein, Michael & Kaplan, Andreas, 2021. "Artificial intelligence and robotics: Shaking up the business world and society at large," Journal of Business Research, Elsevier, vol. 124(C), pages 405-407.
    3. Hye-jin Kim & Yi Wang & Min Ding, 2021. "Brand Voiceprint," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 8(4), pages 123-136, December.
    4. Schwenzow, Jasper & Hartmann, Jochen & Schikowsky, Amos & Heitmann, Mark, 2021. "Understanding videos at scale: How to extract insights for business research," Journal of Business Research, Elsevier, vol. 123(C), pages 367-379.
    5. Yoganathan, Vignesh & Osburg, Victoria-Sophie, 2024. "The mind in the machine: Estimating mind perception's effect on user satisfaction with voice-based conversational agents," Journal of Business Research, Elsevier, vol. 175(C).
    6. Volkmar, Gioia & Fischer, Peter M. & Reinecke, Sven, 2022. "Artificial Intelligence and Machine Learning: Exploring drivers, barriers, and future developments in marketing management," Journal of Business Research, Elsevier, vol. 149(C), pages 599-614.
    7. Christian Hildebrand & Anouk Bergner, 2021. "Conversational robo advisors as surrogates of trust: onboarding experience, firm perception, and consumer financial decision making," Journal of the Academy of Marketing Science, Springer, vol. 49(4), pages 659-676, July.
    8. Beeler, Lisa & Zablah, Alex R. & Rapp, Adam, 2022. "Ability is in the eye of the beholder: How context and individual factors shape consumer perceptions of digital assistant ability," Journal of Business Research, Elsevier, vol. 148(C), pages 33-46.
    9. Zhu, Jingjie & Cheng, Mingming, 2024. "Automatic video analytics in tourism: A methodological review," Annals of Tourism Research, Elsevier, vol. 108(C).
    10. Ngai, Eric W.T. & Wu, Yuanyuan, 2022. "Machine learning in marketing: A literature review, conceptual framework, and research agenda," Journal of Business Research, Elsevier, vol. 145(C), pages 35-48.
    11. Allison, Thomas H. & Warnick, Benjamin J. & Davis, Blakley C. & Cardon, Melissa S., 2022. "Can you hear me now? Engendering passion and preparedness perceptions with vocal expressions in crowdfunding pitches," Journal of Business Venturing, Elsevier, vol. 37(3).
    12. Shiri Melumad & Rhonda Hadi & Christian Hildebrand & Adrian F. Ward, 2020. "Technology-Augmented Choice: How Digital Innovations Are Transforming Consumer Decision Processes," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 7(3), pages 90-101, October.
    13. Grewal, Dhruv & Herhausen, Dennis & Ludwig, Stephan & Villarroel Ordenes, Francisco, 2022. "The Future of Digital Communication Research: Considering Dynamics and Multimodality," Journal of Retailing, Elsevier, vol. 98(2), pages 224-240.
    14. Shiri Melumad & Rhonda Hadi & Christian Hildebrand & Adrian F. Ward, 2021. "Technology-Augmented Choice: How Digital Innovations Are Transforming Consumer Decision Processes," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 7(3), pages 90-101, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. László SEER, 2020. "Toward A Threshold Model Of Consumer Autonomy For Human-Smart System Interactions: A Qualitative Study," Network Intelligence Studies, Romanian Foundation for Business Intelligence, Editorial Department, issue 15, pages 57-69, June.
    2. Attié, Elodie & Meyer-Waarden, Lars, 2022. "The acceptance and usage of smart connected objects according to adoption stages: an enhanced technology acceptance model integrating the diffusion of innovation, uses and gratification and privacy ca," Technological Forecasting and Social Change, Elsevier, vol. 176(C).
    3. Lucia-Palacios, Laura & Pérez-López, Raúl, 2021. "Effects of Home Voice Assistants' Autonomy on Instrusiveness and Usefulness: Direct, Indirect, and Moderating Effects of Interactivity," Journal of Interactive Marketing, Elsevier, vol. 56(C), pages 41-54.
    4. Querci, Ilaria & Monsurrò, Luigi & Peverini, Paolo, 2024. "When anthropomorphism backfires: Anticipation of negative social roles as a source of resistance to smart object adoption," Technovation, Elsevier, vol. 132(C).
    5. Volkmar, Gioia & Fischer, Peter M. & Reinecke, Sven, 2022. "Artificial Intelligence and Machine Learning: Exploring drivers, barriers, and future developments in marketing management," Journal of Business Research, Elsevier, vol. 149(C), pages 599-614.
    6. Lane Peterson Fronczek & Martin Mende & Maura L. Scott & Gergana Y. Nenkov & Anders Gustafsson, 2023. "Friend or foe? Can anthropomorphizing self-tracking devices backfire on marketers and consumers?," Journal of the Academy of Marketing Science, Springer, vol. 51(5), pages 1075-1097, September.
    7. Paolo Franco, 2023. "Older consumers and technology: A critical systematic literature review," AMS Review, Springer;Academy of Marketing Science, vol. 13(1), pages 92-121, June.
    8. Rust, Roland T., 2020. "The future of marketing," International Journal of Research in Marketing, Elsevier, vol. 37(1), pages 15-26.
    9. Ming-Hui Huang & Roland T. Rust, 2021. "A strategic framework for artificial intelligence in marketing," Journal of the Academy of Marketing Science, Springer, vol. 49(1), pages 30-50, January.
    10. Anne-Sophie Billet & Claire Papaix & Mathias Reymond, 2024. "Connected objects: Economic modelling of time arbitrage," Economics Bulletin, AccessEcon, vol. 44(2), pages 662-671.
    11. Rokonuzzaman, Md & Kim, Kyoungmi (Kate) & Dugar, Kranti Kumar & Fox, Jennine, 2022. "What makes an object smart? Conceptualization, development, and validation of a scale to measure the Smartness of a Thing (SoT)," Journal of Business Research, Elsevier, vol. 141(C), pages 337-354.
    12. Wang, Ping & Li, Kunyang & Du, Qinglong & Wang, Jianqiong, 2024. "Customer experience in AI-enabled products: Scale development and validation," Journal of Retailing and Consumer Services, Elsevier, vol. 76(C).
    13. Riegger, Anne-Sophie & Merfeld, Katrin & Klein, Jan F. & Henkel, Sven, 2022. "Technology-enabled personalization: Impact of smart technology choice on consumer shopping behavior," Technological Forecasting and Social Change, Elsevier, vol. 181(C).
    14. Elodie Attié & Lars Meyer-Waarden, 2022. "The acceptance and usage of smart connected objects according to adoption stages: an enhanced technology acceptance model integrating the diffusion of innovation, uses and gratification and privacy ca," Post-Print hal-04065165, HAL.
    15. Kumar, V. & Ramachandran, Divya, 2021. "Developing firms' growth approaches as a multidimensional decision to enhance key stakeholders' wellbeing," International Journal of Research in Marketing, Elsevier, vol. 38(2), pages 402-424.
    16. Navid Bahmani & Amit Bhatnagar & Dinesh Gauri, 2022. "Hey, Alexa! What attributes of Skills affect firm value?," Journal of the Academy of Marketing Science, Springer, vol. 50(6), pages 1219-1235, November.
    17. de Bellis, Emanuel & Venkataramani Johar, Gita, 2020. "Autonomous Shopping Systems: Identifying and Overcoming Barriers to Consumer Adoption," Journal of Retailing, Elsevier, vol. 96(1), pages 74-87.
    18. Christian Hildebrand & Anouk Bergner, 2021. "Conversational robo advisors as surrogates of trust: onboarding experience, firm perception, and consumer financial decision making," Journal of the Academy of Marketing Science, Springer, vol. 49(4), pages 659-676, July.
    19. Chiara Bartoli, 2022. "Consumer self-concept and digitalization: what does this mean for brands?," Italian Journal of Marketing, Springer, vol. 2022(4), pages 419-437, December.
    20. Guerreiro, João & Loureiro, Sandra Maria Correia, 2023. "I am attracted to my Cool Smart Assistant! Analyzing Attachment-Aversion in AI-Human Relationships," Journal of Business Research, Elsevier, vol. 161(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:121:y:2020:i:c:p:364-374. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.