IDEAS home Printed from https://ideas.repec.org/a/eee/joreco/v81y2024ics0969698924003011.html
   My bibliography  Save this article

The effectiveness of human vs. AI voice-over in short video advertisements: A cognitive load theory perspective

Author

Listed:
  • Wang, Xinmeng
  • Zhang, Zhe
  • Jiang, Qingyun

Abstract

In the fast-paced modern life, short video advertising has become the focus of digital marketing due to its convenience and efficiency. However, with the intensification of competition, how to optimize the effectiveness of short video advertising has become an urgent issue for the industry. This study focuses on artificial intelligence (AI)-generated voice in short video advertising, exploring consumers' preferences for AI voice-over and human voice-over, as well as the interaction between voice-over and subtitle availability. Through four studies, it is found that compared with AI voice-over, human voice-over in short video advertising can better reduce consumers' cognitive load, thereby enhancing their purchase intention. At the same time, subtitle types moderate the voice-over effect, with human voice performing better in the absence of subtitles, while the difference is attuned when subtitles are present. This series of studies not only deepens our understanding of the characteristics of short video advertising but also provides strategic suggestions for the video advertising. Advertisers and designers can optimize the production and dissemination strategies of short video advertising based on these findings, enhance advertising effectiveness, meet consumer needs, and achieve better marketing goals.

Suggested Citation

  • Wang, Xinmeng & Zhang, Zhe & Jiang, Qingyun, 2024. "The effectiveness of human vs. AI voice-over in short video advertisements: A cognitive load theory perspective," Journal of Retailing and Consumer Services, Elsevier, vol. 81(C).
    • Handle: RePEc:eee:joreco:v:81:y:2024:i:c:s0969698924003011
    DOI: 10.1016/j.jretconser.2024.104005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0969698924003011
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jretconser.2024.104005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Deng, Fengyi & Tuo, Muyuan & Chen, Si & Zhang, Zichen, 2024. "Born for marketing? The effects of virtual versus human influencers on brand endorsement effectiveness: The role of advertising recognition," Journal of Retailing and Consumer Services, Elsevier, vol. 80(C).
    2. Emna Chérif & Jean-François Lemoine, 2019. "Anthropomorphic virtual assistants and the reactions of Internet users: An experiment on the assistant’s voice," Post-Print hal-03806669, HAL.
    3. Zhang, Cong & Pan, Siyu & Zhao, Yanhui, 2024. "More is not always better: Examining the drivers of livestream sales from an information overload perspective," Journal of Retailing and Consumer Services, Elsevier, vol. 77(C).
    4. Song, Mengmeng & Xing, Xinyu & Duan, Yucong & Cohen, Jason & Mou, Jian, 2022. "Will artificial intelligence replace human customer service? The impact of communication quality and privacy risks on adoption intention," Journal of Retailing and Consumer Services, Elsevier, vol. 66(C).
    5. Nace Pušnik & Klementina Možina & Anja Podlesek, 2016. "Effect of typeface, letter case and position on recognition of short words presented on-screen," Behaviour and Information Technology, Taylor & Francis Journals, vol. 35(6), pages 442-451, June.
    6. Hwang, Angel Hsing-Chi & Oh, Jeeyun, 2020. "Interacting with background music engages E-Customers more: The impact of interactive music on consumer perception and behavioral intention," Journal of Retailing and Consumer Services, Elsevier, vol. 54(C).
    7. Doucé, Lieve & Adams, Carmen, 2020. "Sensory overload in a shopping environment: Not every sensory modality leads to too much stimulation," Journal of Retailing and Consumer Services, Elsevier, vol. 57(C).
    8. Hu, Peng & Gong, Yeming & Lu, Yaobin & Ding, Amy Wenxuan, 2023. "Speaking vs. listening? Balance conversation attributes of voice assistants for better voice marketing," International Journal of Research in Marketing, Elsevier, vol. 40(1), pages 109-127.
    9. Wayne D Hoyer & Echo Wen Wan & Keith Wilcox, 2024. "Practical Relevance in Consumer Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 51(2), pages 428-438.
    10. Poushneh, Atieh, 2021. "Humanizing voice assistant: The impact of voice assistant personality on consumers’ attitudes and behaviors," Journal of Retailing and Consumer Services, Elsevier, vol. 58(C).
    11. Guerreiro, João & Loureiro, Sandra Maria Correia, 2023. "I am attracted to my Cool Smart Assistant! Analyzing Attachment-Aversion in AI-Human Relationships," Journal of Business Research, Elsevier, vol. 161(C).
    12. Hélène Deval & Susan P. Mantel & Frank R. Kardes & Steven S. Posavac, 2013. "How Naive Theories Drive Opposing Inferences from the Same Information," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 39(6), pages 1185-1201.
    13. Li, Sixian & Peluso, Alessandro M. & Duan, Jinyun, 2023. "Why do we prefer humans to artificial intelligence in telemarketing? A mind perception explanation," Journal of Retailing and Consumer Services, Elsevier, vol. 70(C).
    14. Xiao, Lin & Li, Xiaofeng & Zhang, Yucheng, 2023. "Exploring the factors influencing consumer engagement behavior regarding short-form video advertising: A big data perspective," Journal of Retailing and Consumer Services, Elsevier, vol. 70(C).
    15. Xun (Irene) Huang & Ping Dong & Anirban Mukhopadhyay, 2014. "Proud to Belong or Proudly Different? Lay Theories Determine Contrasting Effects of Incidental Pride on Uniqueness Seeking," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 41(3), pages 697-712.
    16. Poushneh, Atieh & Vasquez-Parraga, Arturo & Gearhart, Richard S., 2024. "The effect of empathetic response and consumers’ narcissism in voice-based artificial intelligence," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    17. Li, Chenxi & Xia, Xinyue & Lin, Yixun & Wen, Hanlin, 2024. "Polluted cognition: The effect of air pollution on online purchasing behavior," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    18. Anirban Mukhopadhyay & Gita Venkataramani Johar, 2007. "Tempted or Not? The Effect of Recent Purchase History on Responses to Affective Advertising," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 33(4), pages 445-453, December.
    19. Michael L Lowe & Katherine E Loveland & Aradhna Krishna & Eileen FischerEditor & Amna KirmaniEditor & Andrea C MoralesAssociate Editor, 2019. "A Quiet Disquiet: Anxiety and Risk Avoidance due to Nonconscious Auditory Priming," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 46(1), pages 159-179.
    20. Xu, Ying & Niu, Nan & Zhao, Zixiang, 2023. "Dissecting the mixed effects of human-customer service chatbot interaction on customer satisfaction: An explanation from temporal and conversational cues," Journal of Retailing and Consumer Services, Elsevier, vol. 74(C).
    21. Michael Braun & Bart de Langhe & Stefano Puntoni & Eric M Schwartz, 2024. "Leveraging Digital Advertising Platforms for Consumer Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 51(1), pages 119-128.
    22. Laroche, Michel & Li, Rong & Richard, Marie-Odile & Zhou, Mi, 2022. "An investigation into online atmospherics: The effect of animated images on emotions, cognition, and purchase intentions," Journal of Retailing and Consumer Services, Elsevier, vol. 64(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rohit, Kumar & Shankar, Amit & Katiyar, Gagan & Mehrotra, Ankit & Alzeiby, Ebtesam Abdullah, 2024. "Consumer engagement in chatbots and voicebots. A multiple-experiment approach in online retailing context," Journal of Retailing and Consumer Services, Elsevier, vol. 78(C).
    2. Poushneh, Atieh & Vasquez-Parraga, Arturo & Gearhart, Richard S., 2024. "The effect of empathetic response and consumers’ narcissism in voice-based artificial intelligence," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    3. Sajid, Muhammed & Zakkariya, K.A. & Suki, Norazah Mohd & Islam, Jamid Ul, 2024. "When going green goes wrong: The effects of greenwashing on brand avoidance and negative word-of-mouth," Journal of Retailing and Consumer Services, Elsevier, vol. 78(C).
    4. Park, Junsung & Yoo, Joon Woo & Cho, Youngju & Park, Heejun, 2023. "Examining the impact of service robot communication styles on customer intimacy following service failure," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).
    5. Wang, Yawei & Kang, Qi & Zhou, Shoujiang & Dong, Yuanyuan & Liu, Junqi, 2022. "The impact of service robots in retail: Exploring the effect of novelty priming on consumer behavior," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    6. Cheng, Zhendong & Fan, Wenfang & Shao, Bingjia & Jia, Wenli & Zhang, Yong, 2024. "The impact of intelligent customer service agents’ initial response on consumers’ continuous interaction intention," Journal of Retailing and Consumer Services, Elsevier, vol. 76(C).
    7. Kumar, Anand & Bala, Pradip Kumar & Chakraborty, Shibashish & Behera, Rajat Kumar, 2024. "Exploring antecedents impacting user satisfaction with voice assistant app: A text mining-based analysis on Alexa services," Journal of Retailing and Consumer Services, Elsevier, vol. 76(C).
    8. Maria Vernuccio & Michela Patrizi & Maja Šerić & Alberto Pastore, 2023. "The perceptual antecedents of brand anthropomorphism in the name-brand voice assistant context," Journal of Brand Management, Palgrave Macmillan, vol. 30(4), pages 302-317, July.
    9. Badghish, Saeed & Shaik, Aqueeb Sohail & Sahore, Nidhi & Srivastava, Shalini & Masood, Ayesha, 2024. "Can transactional use of AI-controlled voice assistants for service delivery pickup pace in the near future? A social learning theory (SLT) perspective," Technological Forecasting and Social Change, Elsevier, vol. 198(C).
    10. Pei Li & Chunmao Wu & Charles Spence, 2023. "Comparing the influence of visual information and the perceived intelligence of voice assistants when shopping for sustainable clothing online," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-12, December.
    11. Septianto, Felix & An, Jake & Chiew, Tung Moi & Paramita, Widya & Tanudharma, Istiharini, 2019. "The similar versus divergent effects of pride and happiness on the effectiveness of loyalty programs," Journal of Business Research, Elsevier, vol. 99(C), pages 12-22.
    12. Zhou, Chi & Yu, Jing & Qian, Yong, 2024. "Should live-streaming platforms nonexclusively promote brands from traditional retail platforms?," Journal of Retailing and Consumer Services, Elsevier, vol. 80(C).
    13. Yoganathan, Vignesh & Osburg, Victoria-Sophie, 2024. "The mind in the machine: Estimating mind perception's effect on user satisfaction with voice-based conversational agents," Journal of Business Research, Elsevier, vol. 175(C).
    14. Karoline Gamma & Robert Mai & Moritz Loock, 2020. "The Double-Edged Sword of Ethical Nudges: Does Inducing Hypocrisy Help or Hinder the Adoption of Pro-environmental Behaviors?," Journal of Business Ethics, Springer, vol. 161(2), pages 351-373, January.
    15. Japutra, Arnold & Septianto, Felix & Can, Ali Selcuk, 2022. "Feeling grateful versus happy? The effects of emotional appeals in advertisements on self-made products," Journal of Retailing and Consumer Services, Elsevier, vol. 69(C).
    16. Joerß, Tom & Hoffmann, Stefan & Mai, Robert & Akbar, Payam, 2021. "Digitalization as solution to environmental problems? When users rely on augmented reality-recommendation agents," Journal of Business Research, Elsevier, vol. 128(C), pages 510-523.
    17. Li, Meichan & Wang, Rui, 2023. "Chatbots in e-commerce: The effect of chatbot language style on customers’ continuance usage intention and attitude toward brand," Journal of Retailing and Consumer Services, Elsevier, vol. 71(C).
    18. Agag, Gomaa & Eid, Riyad & Chaib Lababdi, Houyem & Abdelwahab, Mohamed & Aboul-Dahab, Sameh & Abdo, Said Shabban, 2024. "Understanding the impact of national culture differences on customers’ online social shopping behaviours," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    19. Lieve Doucé, 2022. "The Effect of High, Partial, and Low Multisensory Congruity between Light and Scent on Consumer Evaluations and Approach Behavior," Sustainability, MDPI, vol. 14(9), pages 1-25, May.
    20. Simoni F. Rohden & Lélis Balestrin Espartel, 2024. "Consumer reactions to technology in retail: choice uncertainty and reduced perceived control in decisions assisted by recommendation agents," Electronic Commerce Research, Springer, vol. 24(2), pages 901-923, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:joreco:v:81:y:2024:i:c:s0969698924003011. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/journal-of-retailing-and-consumer-services .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.