IDEAS home Printed from https://ideas.repec.org/a/eee/joinma/v50y2020icp156-167.html
   My bibliography  Save this article

The Use of Computer Vision to Analyze Brand-Related User Generated Image Content

Author

Listed:
  • Nanne, Annemarie J.
  • Antheunis, Marjolijn L.
  • van der Lee, Chris G.
  • Postma, Eric O.
  • Wubben, Sander
  • van Noort, Guda

Abstract

With the increasing popularity of visual-oriented social media platforms, the prevalence of visual brand-related User Generated Content (UGC) have increased. Monitoring such content is important as this visual brand-related UGC can have a large influence on a brand's image and hence provides useful opportunities to observe brand performance (e.g., monitoring trends and consumer segments). The current research discusses the application of computer vision for marketing practitioners and researchers and examines the usability of three different pre-trained ready-to-use computer vision models (i.e., YOLOV2, Google Cloud Vision, and Clarifai) to analyze visual brand-related UGC automatically. A 3-step approach was adopted in which 1) a database of 21,738 Instagram pictures related to 24 different brands was constructed, 2) the images were processed by the three different computer vision models, and 3) a label evaluation procedure was conducted with a sample of the labels (object names) outputted by the models. The results of the label evaluation procedure are quantitatively assessed and complemented with four concrete examples of how the output of computer vision can be used to analyze visual brand-related UGC. Results show that computer vision can yield various marketing insights. Moreover, we found that the three tested computer vision models differ in applicability. Google Cloud Vision is more accurate in object detection, whereas Clarifai provides more useful labels to interpret the portrayal of a brand. YOLOV2 did not prove to be useful to analyze visual brand-related UGC. Results and implications of the findings for marketers and marketing scholars will be discussed.

Suggested Citation

  • Nanne, Annemarie J. & Antheunis, Marjolijn L. & van der Lee, Chris G. & Postma, Eric O. & Wubben, Sander & van Noort, Guda, 2020. "The Use of Computer Vision to Analyze Brand-Related User Generated Image Content," Journal of Interactive Marketing, Elsevier, vol. 50(C), pages 156-167.
    • Handle: RePEc:eee:joinma:v:50:y:2020:i:c:p:156-167
    DOI: 10.1016/j.intmar.2019.09.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1094996819300994
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.intmar.2019.09.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yann LeCun & Yoshua Bengio & Geoffrey Hinton, 2015. "Deep learning," Nature, Nature, vol. 521(7553), pages 436-444, May.
    2. Olivier Droulers & Adil Safaa, 2015. "Could Face Presence In Print Ads Influence Memorization?," Post-Print halshs-01242593, HAL.
    3. Saeideh Bakhshi & Eric Gilbert, 2015. "Red, Purple and Pink: The Colors of Diffusion on Pinterest," PLOS ONE, Public Library of Science, vol. 10(2), pages 1-20, February.
    4. Bates, Douglas & Mächler, Martin & Bolker, Ben & Walker, Steve, 2015. "Fitting Linear Mixed-Effects Models Using lme4," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 67(i01).
    5. Vilnai-Yavetz, Iris & Tifferet, Sigal, 2015. "A Picture Is Worth a Thousand Words: Segmenting Consumers by Facebook Profile Images," Journal of Interactive Marketing, Elsevier, vol. 32(C), pages 53-69.
    6. Hollenbeck, Candice R. & Kaikati, Andrew M., 2012. "Consumers' use of brands to reflect their actual and ideal selves on Facebook," International Journal of Research in Marketing, Elsevier, vol. 29(4), pages 395-405.
    7. Kaplan, Andreas M. & Haenlein, Michael, 2010. "Users of the world, unite! The challenges and opportunities of Social Media," Business Horizons, Elsevier, vol. 53(1), pages 59-68, January.
    8. Gensler, Sonja & Völckner, Franziska & Liu-Thompkins, Yuping & Wiertz, Caroline, 2013. "Managing Brands in the Social Media Environment," Journal of Interactive Marketing, Elsevier, vol. 27(4), pages 242-256.
    9. de Vries, Lisette & Gensler, Sonja & Leeflang, Peter S.H., 2012. "Popularity of Brand Posts on Brand Fan Pages: An Investigation of the Effects of Social Media Marketing," Journal of Interactive Marketing, Elsevier, vol. 26(2), pages 83-91.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Azer, Jaylan & Anker, Thomas & Taheri, Babak & Tinsley, Ross, 2023. "Consumer-Driven racial stigmatization: The moderating role of race in online consumer-to-consumer reviews," Journal of Business Research, Elsevier, vol. 157(C).
    2. Larisa Sharakhina & Irina Ilyina & Dmitrii Kaplun & Tatiana Teor & Valeria Kulibanova, 2024. "AI technologies in the analysis of visual advertising messages: survey and application," Journal of Marketing Analytics, Palgrave Macmillan, vol. 12(4), pages 1066-1089, December.
    3. Jiaqi Wang & Peng Zou & Bo Yu, 2024. "How online exposure to nature affects customer engagement: Evidence from Sina Weibo," Electronic Markets, Springer;IIM University of St. Gallen, vol. 34(1), pages 1-17, December.
    4. Zecong Ma & Sergio Palacios, 2021. "Image-mining: exploring the impact of video content on the success of crowdfunding," Journal of Marketing Analytics, Palgrave Macmillan, vol. 9(4), pages 265-285, December.
    5. Villarroel Ordenes, Francisco & Silipo, Rosaria, 2021. "Machine learning for marketing on the KNIME Hub: The development of a live repository for marketing applications," Journal of Business Research, Elsevier, vol. 137(C), pages 393-410.
    6. Wang, Xia & Ding, Ying, 2022. "The impact of monetary rewards on product sales in referral programs: The role of product image aesthetics," Journal of Business Research, Elsevier, vol. 145(C), pages 828-842.
    7. Philp, Matthew & Jacobson, Jenna & Pancer, Ethan, 2022. "Predicting social media engagement with computer vision: An examination of food marketing on Instagram," Journal of Business Research, Elsevier, vol. 149(C), pages 736-747.
    8. Shugang Li & Fang Liu & Yuqi Zhang & Boyi Zhu & He Zhu & Zhaoxu Yu, 2022. "Text Mining of User-Generated Content (UGC) for Business Applications in E-Commerce: A Systematic Review," Mathematics, MDPI, vol. 10(19), pages 1-26, September.
    9. Pedro Cuesta-Valiño & Sergey Kazakov & Pablo Gutiérrez-Rodríguez & Orlando Lima Rua, 2023. "The effects of the aesthetics and composition of hotels’ digital photo images on online booking decisions," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-11, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roma, Paolo & Aloini, Davide, 2019. "How does brand-related user-generated content differ across social media? Evidence reloaded," Journal of Business Research, Elsevier, vol. 96(C), pages 322-339.
    2. Salim L Azar & Joana César Machado & Leonor Vacas-de-Carvalho & Ana Mendes, 2016. "Motivations to interact with brands on Facebook – Towards a typology of consumer–brand interactions," Journal of Brand Management, Palgrave Macmillan, vol. 23(2), pages 153-178, March.
    3. Tajvidi, Mina & Richard, Marie-Odile & Wang, YiChuan & Hajli, Nick, 2020. "Brand co-creation through social commerce information sharing: The role of social media," Journal of Business Research, Elsevier, vol. 121(C), pages 476-486.
    4. Sheng, Jie, 2019. "Being Active in Online Communications: Firm Responsiveness and Customer Engagement Behaviour," Journal of Interactive Marketing, Elsevier, vol. 46(C), pages 40-51.
    5. Mohammad Zulfeequar Alam, 2017. "Exploring Shopper Insights of Social Media Use in Saudi Arabia," International Review of Management and Marketing, Econjournals, vol. 7(2), pages 326-333.
    6. Patria Laksamana, 2018. "Impact of Social Media Marketing on Purchase Intention and Brand Loyalty: Evidence from Indonesia’s Banking Industry," International Review of Management and Marketing, Econjournals, vol. 8(1), pages 13-18.
    7. Peters, Kay & Chen, Yubo & Kaplan, Andreas M. & Ognibeni, Björn & Pauwels, Koen, 2013. "Social Media Metrics — A Framework and Guidelines for Managing Social Media," Journal of Interactive Marketing, Elsevier, vol. 27(4), pages 281-298.
    8. Giuseppe Crapa & Maria Elena Latino & Paolo Roma, 2024. "The performance of green communication across social media: Evidence from large‐scale retail industry in Italy," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 31(1), pages 493-513, January.
    9. Marchand, André & Hennig-Thurau, Thorsten & Flemming, Jan, 2021. "Social media resources and capabilities as strategic determinants of social media performance," International Journal of Research in Marketing, Elsevier, vol. 38(3), pages 549-571.
    10. Malthouse, Edward C. & Haenlein, Michael & Skiera, Bernd & Wege, Egbert & Zhang, Michael, 2013. "Managing Customer Relationships in the Social Media Era: Introducing the Social CRM House," Journal of Interactive Marketing, Elsevier, vol. 27(4), pages 270-280.
    11. Kick, Markus, 2015. "Social Media Research: A Narrative Review," EconStor Preprints 182506, ZBW - Leibniz Information Centre for Economics.
    12. Felicitas M. Brech & Uwe Messer & Brian A. Vander Schee & Philipp A. Rauschnabel & Bjoern S. Ivens, 2017. "Engaging fans and the community in social media: interaction with institutions of higher education on Facebook," Journal of Marketing for Higher Education, Taylor & Francis Journals, vol. 27(1), pages 112-130, January.
    13. Kick, Markus, 2015. "Post ≠ Post: An Experimental Study on Corporate Brand Posts on Facebook," EconStor Preprints 182507, ZBW - Leibniz Information Centre for Economics.
    14. Olaf Maecker & Christian Barrot & Jan U. Becker, 2016. "The effect of social media interactions on customer relationship management," Business Research, Springer;German Academic Association for Business Research, vol. 9(1), pages 133-155, April.
    15. Wondwesen Tafesse & Anders Wien, 2017. "A framework for categorizing social media posts," Cogent Business & Management, Taylor & Francis Journals, vol. 4(1), pages 1284390-128, January.
    16. Tony Cooper & Constantino Stavros & Angela R. Dobele, 2019. "The levers of engagement: an exploration of governance in an online brand community," Journal of Brand Management, Palgrave Macmillan, vol. 26(3), pages 240-254, May.
    17. Giannis Milolidakis & Demosthenes Akoumianakis & Chris Kimble, 2013. "Digital traces for business intelligence: A case study of mobile telecoms service brands in Greece," Post-Print halshs-00954440, HAL.
    18. Xu, Jia & Wei, Jiuchang & Zhao, Dingtao, 2016. "Influence of social media on operational efficiency of national scenic spots in china based on three-stage DEA model," International Journal of Information Management, Elsevier, vol. 36(3), pages 374-388.
    19. Raed S. Algharabat & Nripendra P. Rana, 0. "Social Commerce in Emerging Markets and its Impact on Online Community Engagement," Information Systems Frontiers, Springer, vol. 0, pages 1-22.
    20. Waqas, Muhammad & Salleh, Noor Akma Mohd & Hamzah, Zalfa Laili, 2021. "Branded Content Experience in Social Media: Conceptualization, Scale Development, and Validation," Journal of Interactive Marketing, Elsevier, vol. 56(C), pages 106-120.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:joinma:v:50:y:2020:i:c:p:156-167. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/journal-of-interactive-marketing/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.