IDEAS home Printed from https://ideas.repec.org/a/pal/jmarka/v12y2024i4d10.1057_s41270-023-00255-1.html
   My bibliography  Save this article

AI technologies in the analysis of visual advertising messages: survey and application

Author

Listed:
  • Larisa Sharakhina

    (Saint Petersburg Electrotechnical University “LETI”)

  • Irina Ilyina

    (Saint Petersburg Electrotechnical University “LETI”)

  • Dmitrii Kaplun

    (Saint Petersburg Electrotechnical University “LETI”)

  • Tatiana Teor

    (Saint Petersburg Electrotechnical University “LETI”)

  • Valeria Kulibanova

    (RANEPA St. Petersburg (The Branch of the Presidential Academy of National Economy and Public Administration)
    St. Petersburg State University of Economics)

Abstract

Artificial intelligence technologies are improving the marketing toolkit, making it possible to process large amounts of data faster and more efficiently than ever before. Machine learning, a subset of AI, uses algorithms that can predict which ads will be most effective in specific situations, allowing for optimized ad targeting. This research explores the issues of coevolution and distribution of machine and human intelligence in various social practices, including marketing and advertising. The authors describe the key approaches to studying the visual component of advertising and suggest revising traditional methods of analyzing advertising messages. The tracking of biometric data combined with AI-based methods that capture human emotions while viewing video content is proposed as a promising direction for such analysis. This paper presents the results of a pilot study based on analytical face-tracking technology using AI, where the subject of the experiment was the analysis of video fragments that may have an impact on the emotional state of the viewer. The AI software platform used was Amazon Rekognition, and the results show that AI analytics provide the ability to track the level of audience engagement in perceiving video content, which helps to improve communication effectiveness. This allows the use of AI to make recommendations for the development of more directed and engaging advertising messages.

Suggested Citation

  • Larisa Sharakhina & Irina Ilyina & Dmitrii Kaplun & Tatiana Teor & Valeria Kulibanova, 2024. "AI technologies in the analysis of visual advertising messages: survey and application," Journal of Marketing Analytics, Palgrave Macmillan, vol. 12(4), pages 1066-1089, December.
    • Handle: RePEc:pal:jmarka:v:12:y:2024:i:4:d:10.1057_s41270-023-00255-1
    DOI: 10.1057/s41270-023-00255-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41270-023-00255-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1057/s41270-023-00255-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Miluska Murillo-Zegarra & Carla Ruiz-Mafe & Silvia Sanz-Blas, 2020. "The Effects of Mobile Advertising Alerts and Perceived Value on Continuance Intention for Branded Mobile Apps," Sustainability, MDPI, vol. 12(17), pages 1-20, August.
    2. Xiaojing Yang & Robert E. Smith, 2009. "Beyond Attention Effects: Modeling the Persuasive and Emotional Effects of Advertising Creativity," Marketing Science, INFORMS, vol. 28(5), pages 935-949, 09-10.
    3. Zecong Ma & Sergio Palacios, 2021. "Image-mining: exploring the impact of video content on the success of crowdfunding," Journal of Marketing Analytics, Palgrave Macmillan, vol. 9(4), pages 265-285, December.
    4. Loureiro, Sandra Maria Correia & Guerreiro, João & Tussyadiah, Iis, 2021. "Artificial intelligence in business: State of the art and future research agenda," Journal of Business Research, Elsevier, vol. 129(C), pages 911-926.
    5. Anthony F. Branda & Vishal Lala & Pradeep Gopalakrishna, 2018. "The marketing analytics orientation (MAO) of firms: identifying factors that create highly analytical marketing practices," Journal of Marketing Analytics, Palgrave Macmillan, vol. 6(3), pages 84-94, September.
    6. Li Xiao & Min Ding, 2014. "Just the Faces: Exploring the Effects of Facial Features in Print Advertising," Marketing Science, INFORMS, vol. 33(3), pages 338-352, May.
    7. Ashlee Humphreys & Rebecca Jen-Hui Wang & Eileen FischerEditor & Linda PriceAssociate Editor, 2018. "Automated Text Analysis for Consumer Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 44(6), pages 1274-1306.
    8. Saeideh Bakhshi & Eric Gilbert, 2015. "Red, Purple and Pink: The Colors of Diffusion on Pinterest," PLOS ONE, Public Library of Science, vol. 10(2), pages 1-20, February.
    9. Matthew D. Vollrath & Salvador G. Villegas, 2022. "Avoiding digital marketing analytics myopia: revisiting the customer decision journey as a strategic marketing framework," Journal of Marketing Analytics, Palgrave Macmillan, vol. 10(2), pages 106-113, June.
    10. Amitai Etzioni, 2011. "Behavioural Economics: Next Steps," Journal of Consumer Policy, Springer, vol. 34(3), pages 277-287, September.
    11. Nanne, Annemarie J. & Antheunis, Marjolijn L. & van der Lee, Chris G. & Postma, Eric O. & Wubben, Sander & van Noort, Guda, 2020. "The Use of Computer Vision to Analyze Brand-Related User Generated Image Content," Journal of Interactive Marketing, Elsevier, vol. 50(C), pages 156-167.
    12. Fatma Patlar Akbulut, 2022. "Hybrid deep convolutional model-based emotion recognition using multiple physiological signals," Computer Methods in Biomechanics and Biomedical Engineering, Taylor & Francis Journals, vol. 25(15), pages 1678-1690, October.
    13. Sreejesh, S. & Ghosh, Tathagata & Dwivedi, Yogesh K., 2021. "Moving beyond the content: The role of contextual cues in the effectiveness of gamification of advertising," Journal of Business Research, Elsevier, vol. 132(C), pages 88-101.
    14. Qiang Zhang & Wenbo Wang & Yuxin Chen, 2020. "Frontiers: In-Consumption Social Listening with Moment-to-Moment Unstructured Data: The Case of Movie Appreciation and Live Comments," Marketing Science, INFORMS, vol. 39(2), pages 285-295, March.
    15. Richard H. Thaler, 2000. "From Homo Economicus to Homo Sapiens," Journal of Economic Perspectives, American Economic Association, vol. 14(1), pages 133-141, Winter.
    16. Tversky, Amos & Kahneman, Daniel, 1986. "Rational Choice and the Framing of Decisions," The Journal of Business, University of Chicago Press, vol. 59(4), pages 251-278, October.
    17. Helmefalk, Miralem & Hultén, Bertil, 2017. "Multi-sensory congruent cues in designing retail store atmosphere: Effects on shoppers’ emotions and purchase behavior," Journal of Retailing and Consumer Services, Elsevier, vol. 38(C), pages 1-11.
    18. Liu Liu & Daria Dzyabura & Natalie Mizik, 2020. "Visual Listening In: Extracting Brand Image Portrayed on Social Media," Marketing Science, INFORMS, vol. 39(4), pages 669-686, July.
    19. Ida Merete Enholm & Emmanouil Papagiannidis & Patrick Mikalef & John Krogstie, 2022. "Artificial Intelligence and Business Value: a Literature Review," Information Systems Frontiers, Springer, vol. 24(5), pages 1709-1734, October.
    20. Laith T. Khrais, 2020. "Role of Artificial Intelligence in Shaping Consumer Demand in E-Commerce," Future Internet, MDPI, vol. 12(12), pages 1-14, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zecong Ma & Sergio Palacios, 2021. "Image-mining: exploring the impact of video content on the success of crowdfunding," Journal of Marketing Analytics, Palgrave Macmillan, vol. 9(4), pages 265-285, December.
    2. Giuseppe Pernagallo & Benedetto Torrisi, 2020. "A theory of information overload applied to perfectly efficient financial markets," Review of Behavioral Finance, Emerald Group Publishing Limited, vol. 14(2), pages 223-236, October.
    3. Xin (Shane) Wang & Neil Bendle & Yinjie Pan, 2024. "Beyond text: Marketing strategy in a world turned upside down," Journal of the Academy of Marketing Science, Springer, vol. 52(4), pages 939-954, July.
    4. Villarroel Ordenes, Francisco & Silipo, Rosaria, 2021. "Machine learning for marketing on the KNIME Hub: The development of a live repository for marketing applications," Journal of Business Research, Elsevier, vol. 137(C), pages 393-410.
    5. Abdelhamid Zaidi & Samuel-Soma M. Ajibade & Majd Musa & Festus Victor Bekun, 2023. "New Insights into the Research Landscape on the Application of Artificial Intelligence in Sustainable Smart Cities: A Bibliometric Mapping and Network Analysis Approach," International Journal of Energy Economics and Policy, Econjournals, vol. 13(4), pages 287-299, July.
    6. Zhu, Jingjie & Cheng, Mingming, 2024. "Automatic video analytics in tourism: A methodological review," Annals of Tourism Research, Elsevier, vol. 108(C).
    7. Li, Xi & Shi, Mengze & Wang, Xin (Shane), 2019. "Video mining: Measuring visual information using automatic methods," International Journal of Research in Marketing, Elsevier, vol. 36(2), pages 216-231.
    8. Pessali, Huascar & Berger, Bruno, 2010. "A teoria da perspectiva e as mudanças de preferência no mainstream: um prospecto lakatoseano [Prospect theory and preference change in the mainstream of economics: a Lakatosian prospect]," MPRA Paper 26104, University Library of Munich, Germany.
    9. Eduardo Wiesner, 2008. "The Political Economy of Macroeconomic Policy Reform in Latin America," Books, Edward Elgar Publishing, number 12913, March.
    10. Erika GRABOCKA & Ervisa NDOKA, 2025. "AI-driven innovation within the ICT sector," Smart Cities and Regional Development (SCRD) Journal, Smart-EDU Hub, Faculty of Public Administration, National University of Political Studies & Public Administration, vol. 9(1), pages 77-97, January.
    11. Mariano Rojas, 2012. "Do People in Income Poverty Use Their Income Efficiently?: a Subjective Well-Being Approach," WIDER Working Paper Series wp-2012-110, World Institute for Development Economic Research (UNU-WIDER).
    12. Rojas, Mariano, 2012. "Do People in Income Poverty Use Their Income Efficiently? A Subjective Well-Being Approach," WIDER Working Paper Series 110, World Institute for Development Economic Research (UNU-WIDER).
    13. Shimi Naurin Ahmad & Michel Laroche, 2023. "Extracting marketing information from product reviews: a comparative study of latent semantic analysis and probabilistic latent semantic analysis," Journal of Marketing Analytics, Palgrave Macmillan, vol. 11(4), pages 662-676, December.
    14. wael AL-khatib, Ayman, 2023. "Drivers of generative artificial intelligence to fostering exploitative and exploratory innovation: A TOE framework," Technology in Society, Elsevier, vol. 75(C).
    15. Alireza Aghasi & Arun Rai & Yusen Xia, 2024. "A Deep Learning and Image Processing Pipeline for Object Characterization in Firm Operations," INFORMS Journal on Computing, INFORMS, vol. 36(2), pages 616-634, March.
    16. Bitty Balducci & Detelina Marinova, 2018. "Unstructured data in marketing," Journal of the Academy of Marketing Science, Springer, vol. 46(4), pages 557-590, July.
    17. Justyna Brzezicka & Radosław Wisniewski, 2014. "Homo Oeconomicus and Behavioral Economics," Contemporary Economics, University of Economics and Human Sciences in Warsaw., vol. 8(4), December.
    18. Floris Heukelom, 2007. "Who are the Behavioral Economists and what do they say?," Tinbergen Institute Discussion Papers 07-020/1, Tinbergen Institute.
    19. Geiger, Niels, 2014. "The rise of behavioural economics: A quantitative assessment," Violette Reihe: Schriftenreihe des Promotionsschwerpunkts "Globalisierung und Beschäftigung" 44/2015, University of Hohenheim, Carl von Ossietzky University Oldenburg, Evangelisches Studienwerk.
    20. Philp, Matthew & Jacobson, Jenna & Pancer, Ethan, 2022. "Predicting social media engagement with computer vision: An examination of food marketing on Instagram," Journal of Business Research, Elsevier, vol. 149(C), pages 736-747.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:jmarka:v:12:y:2024:i:4:d:10.1057_s41270-023-00255-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave-journals.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.