IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v149y2022icp736-747.html
   My bibliography  Save this article

Predicting social media engagement with computer vision: An examination of food marketing on Instagram

Author

Listed:
  • Philp, Matthew
  • Jacobson, Jenna
  • Pancer, Ethan

Abstract

In a crowded social media marketplace, restaurants often try to stand out by showcasing elaborate “Instagrammable” foods. Using an image classification machine learning algorithm (Google Vision AI) on restaurants’ Instagram posts, this study analyzes how the visual characteristics of product offerings (i.e., their food) relate to social media engagement. Results demonstrate that food images that are more confidently evaluated by Google Vision AI (a proxy for food typicality) are positively associated with engagement (likes and comments). A follow-up experiment shows that exposure to typical-appearing foods elevates positive affect, suggesting they are easier to mentally process, which drives engagement. Therefore, contrary to conventional social media practices and food industry trends, the more typical a food appears, the more social media engagement it receives. Using Google Vision AI to identify what product offerings receive engagement presents an accessible method for marketers to understand their industry and inform their social media marketing strategies.

Suggested Citation

  • Philp, Matthew & Jacobson, Jenna & Pancer, Ethan, 2022. "Predicting social media engagement with computer vision: An examination of food marketing on Instagram," Journal of Business Research, Elsevier, vol. 149(C), pages 736-747.
    • Handle: RePEc:eee:jbrese:v:149:y:2022:i:c:p:736-747
    DOI: 10.1016/j.jbusres.2022.05.078
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148296322005239
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbusres.2022.05.078?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. So, Kevin Kam Fung & Wei, Wei & Martin, Drew, 2021. "Understanding customer engagement and social media activities in tourism: A latent profile analysis and cross-validation," Journal of Business Research, Elsevier, vol. 129(C), pages 474-483.
    2. Eigenraam, Anniek W. & Eelen, Jiska & van Lin, Arjen & Verlegh, Peeter W.J., 2018. "A Consumer-based Taxonomy of Digital Customer Engagement Practices," Journal of Interactive Marketing, Elsevier, vol. 44(C), pages 102-121.
    3. Matthew Philp & Martin A. Pyle & Laurence Ashworth, 2018. "Risking the self: the impact of self-esteem on negative word-of-mouth behavior," Marketing Letters, Springer, vol. 29(1), pages 101-113, March.
    4. Theodore J. Noseworthy & Fabrizio Di Muro & Kyle B. Murray, 2014. "The Role of Arousal in Congruity-Based Product Evaluation," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 41(4), pages 1108-1126.
    5. Kong, Hyun Min & Witmaier, Alexander & Ko, Eunju, 2021. "Sustainability and social media communication: How consumers respond to marketing efforts of luxury and non-luxury fashion brands," Journal of Business Research, Elsevier, vol. 131(C), pages 640-651.
    6. Kaiser, Carolin & Ahuvia, Aaron & Rauschnabel, Philipp A. & Wimble, Matt, 2020. "Social media monitoring: What can marketers learn from Facebook brand photos?," Journal of Business Research, Elsevier, vol. 117(C), pages 707-717.
    7. Jonah Berger & Raghuram Iyengar, 2013. "Communication Channels and Word of Mouth: How the Medium Shapes the Message," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 40(3), pages 567-579.
    8. Swani, Kunal & Milne, George R., 2017. "Evaluating Facebook brand content popularity for service versus goods offerings," Journal of Business Research, Elsevier, vol. 79(C), pages 123-133.
    9. Philp, Matthew & Ashworth, Laurence, 2020. "I should have known better!: When firm-caused failure leads to self-image concerns and reduces negative word-of-mouth," Journal of Business Research, Elsevier, vol. 116(C), pages 283-293.
    10. Rietveld, Robert & van Dolen, Willemijn & Mazloom, Masoud & Worring, Marcel, 2020. "What You Feel, Is What You Like Influence of Message Appeals on Customer Engagement on Instagram," Journal of Interactive Marketing, Elsevier, vol. 49(C), pages 20-53.
    11. de Vries, Lisette & Gensler, Sonja & Leeflang, Peter S.H., 2012. "Popularity of Brand Posts on Brand Fan Pages: An Investigation of the Effects of Social Media Marketing," Journal of Interactive Marketing, Elsevier, vol. 26(2), pages 83-91.
    12. Simonson, Itamar & Nowlis, Stephen M, 2000. "The Role of Explanations and Need for Uniqueness in Consumer Decision Making: Unconventional Choices Based on Reasons," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 27(1), pages 49-68, June.
    13. Janiszewski, Chris & Meyvis, Tom, 2001. "Effects of Brand Logo Complexity, Repetition, and Spacing on Processing Fluency and Judgment," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(1), pages 18-32, June.
    14. Theodore J. Noseworthy & Fabrizio Di Muro & Kyle B. Murray, 2014. "The Role of Arousal in Congruity-Based Product Evaluation," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 41(4), pages 1108-1126.
    15. Belk, Russell W, 1988. "Possessions and the Extended Self," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 15(2), pages 139-168, September.
    16. Luigi M. De Luca & Dennis Herhausen & Gabriele Troilo & Andrea Rossi, 2021. "How and when do big data investments pay off? The role of marketing affordances and service innovation," Journal of the Academy of Marketing Science, Springer, vol. 49(4), pages 790-810, July.
    17. Bernritter, Stefan F. & Verlegh, Peeter W.J. & Smit, Edith G., 2016. "Why Nonprofits Are Easier to Endorse on Social Media: The Roles of Warmth and Brand Symbolism," Journal of Interactive Marketing, Elsevier, vol. 33(C), pages 27-42.
    18. Nanne, Annemarie J. & Antheunis, Marjolijn L. & van der Lee, Chris G. & Postma, Eric O. & Wubben, Sander & van Noort, Guda, 2020. "The Use of Computer Vision to Analyze Brand-Related User Generated Image Content," Journal of Interactive Marketing, Elsevier, vol. 50(C), pages 156-167.
    19. Simonson, Itamar & Nowlis, Stephen M., 2000. "The Role of Explanations and Need for Uniqueness in Consumer Decision Making: Unconventional Choices Based on Reasons," Research Papers 1610, Stanford University, Graduate School of Business.
    20. Liu, Xia & Shin, Hyunju & Burns, Alvin C., 2021. "Examining the impact of luxury brand's social media marketing on customer engagement​: Using big data analytics and natural language processing," Journal of Business Research, Elsevier, vol. 125(C), pages 815-826.
    21. Moldovan, Sarit & Goldenberg, Jacob & Chattopadhyay, Amitava, 2011. "The different roles of product originality and usefulness in generating word-of-mouth," International Journal of Research in Marketing, Elsevier, vol. 28(2), pages 109-119.
    22. Jonah Berger & Chip Heath, 2007. "Where Consumers Diverge from Others: Identity Signaling and Product Domains," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 34(2), pages 121-134, June.
    23. Liu Liu & Daria Dzyabura & Natalie Mizik, 2020. "Visual Listening In: Extracting Brand Image Portrayed on Social Media," Marketing Science, INFORMS, vol. 39(4), pages 669-686, July.
    24. Pradeep K. Chintagunta & Shyam Gopinath & Sriram Venkataraman, 2010. "The Effects of Online User Reviews on Movie Box Office Performance: Accounting for Sequential Rollout and Aggregation Across Local Markets," Marketing Science, INFORMS, vol. 29(5), pages 944-957, 09-10.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Herhausen, Dennis & Bernritter, Stefan F. & Ngai, Eric W.T. & Kumar, Ajay & Delen, Dursun, 2024. "Machine learning in marketing: Recent progress and future research directions," Journal of Business Research, Elsevier, vol. 170(C).
    2. Alireza Aghasi & Arun Rai & Yusen Xia, 2024. "A Deep Learning and Image Processing Pipeline for Object Characterization in Firm Operations," INFORMS Journal on Computing, INFORMS, vol. 36(2), pages 616-634, March.
    3. Philp, Matthew & Nepomuceno, Marcelo Vinhal, 2024. "How reviews influence product usage post-purchase: An examination of video game playtime," Journal of Business Research, Elsevier, vol. 172(C).
    4. Paweł Bryła & Shuvam Chatterjee & Beata Ciabiada-Bryła, 2022. "The Impact of Social Media Marketing on Consumer Engagement in Sustainable Consumption: A Systematic Literature Review," IJERPH, MDPI, vol. 19(24), pages 1-16, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xingyu Chen & Xing Li & Dai Yao & Zhimin Zhou, 2019. "Seeking the support of the silent majority: are lurking users valuable to UGC platforms?," Journal of the Academy of Marketing Science, Springer, vol. 47(6), pages 986-1004, November.
    2. Kim, Aekyoung & Briley, Donnel, 2020. "Finding the self in chance events," International Journal of Research in Marketing, Elsevier, vol. 37(4), pages 853-867.
    3. Wang, Feng & Liu, Xuefeng & Fang, Eric (Er), 2015. "User Reviews Variance, Critic Reviews Variance, and Product Sales: An Exploration of Customer Breadth and Depth Effects," Journal of Retailing, Elsevier, vol. 91(3), pages 372-389.
    4. Federico Mangiò & Giuseppe Pedeliento & Daniela Andreini & Lia Zarantonello, 2024. "How persuasive is woke brand communication on social media? Evidence from a consumer engagement analysis on Facebook," Journal of Brand Management, Palgrave Macmillan, vol. 31(4), pages 345-381, July.
    5. Eigenraam, Anniek W. & Eelen, Jiska & Verlegh, Peeter W.J., 2021. "Let Me Entertain You? The Importance of Authenticity in Online Customer Engagement," Journal of Interactive Marketing, Elsevier, vol. 54(C), pages 53-68.
    6. Dörnyei, Krisztina Rita & Lunardo, Renaud, 2021. "When limited edition packages backfire: The role of emotional value, typicality and need for uniqueness," Journal of Business Research, Elsevier, vol. 137(C), pages 233-243.
    7. He, Yi & You, Ya & Chen, Qimei, 2020. "Our conditional love for the underdog: The effect of brand positioning and the lay theory of achievement on WOM," Journal of Business Research, Elsevier, vol. 118(C), pages 210-222.
    8. Sharma, Amalesh & Soni, Mauli & Borah, Sourav Bikash & Haque, Tanjum, 2022. "From silos to synergies: A systematic review of luxury in marketing research," Journal of Business Research, Elsevier, vol. 139(C), pages 893-907.
    9. Agnieszka Zablocki & Bodo Schlegelmilch & Michael J. Houston, 2019. "How valence, volume and variance of online reviews influence brand attitudes," AMS Review, Springer;Academy of Marketing Science, vol. 9(1), pages 61-77, June.
    10. Christian Hildebrand & Gerald Häubl & Andreas Herrmann & Jan R. Landwehr, 2013. "When Social Media Can Be Bad for You: Community Feedback Stifles Consumer Creativity and Reduces Satisfaction with Self-Designed Products," Information Systems Research, INFORMS, vol. 24(1), pages 14-29, March.
    11. Gierl, Heribert & Huettl, Verena, 2010. "Are scarce products always more attractive? The interaction of different types of scarcity signals with products' suitability for conspicuous consumption," International Journal of Research in Marketing, Elsevier, vol. 27(3), pages 225-235.
    12. Jiaqi Wang & Peng Zou & Bo Yu, 2024. "How online exposure to nature affects customer engagement: Evidence from Sina Weibo," Electronic Markets, Springer;IIM University of St. Gallen, vol. 34(1), pages 1-17, December.
    13. Henkel, Laura & Jahn, Steffen & Toporowski, Waldemar, 2022. "Short and sweet: Effects of pop-up stores’ ephemerality on store sales," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    14. Kim, Jungkeun & Spence, Mark T. & Marshall, Roger, 2018. "The Color of Choice: The Influence of Presenting Product Information in Color on the Compromise Effect," Journal of Retailing, Elsevier, vol. 94(2), pages 167-185.
    15. Philp, Matthew & Nepomuceno, Marcelo Vinhal, 2024. "How reviews influence product usage post-purchase: An examination of video game playtime," Journal of Business Research, Elsevier, vol. 172(C).
    16. Syrdal, Holly A. & Myers, Susan & Sen, Sandipan & Woodroof, Parker J. & McDowell, William C., 2023. "Influencer marketing and the growth of affiliates: The effects of language features on engagement behavior," Journal of Business Research, Elsevier, vol. 163(C).
    17. Ngai, Eric W.T. & Wu, Yuanyuan, 2022. "Machine learning in marketing: A literature review, conceptual framework, and research agenda," Journal of Business Research, Elsevier, vol. 145(C), pages 35-48.
    18. Hsuan-Hsuan Ku & Chien-Chih Kuo & Wei-Luen Fang & Ya-Wen Yu, 2014. "The impact of retail out-of-stock options on preferences: The role of consumers’ desire for assimilation versus differentiation," Marketing Letters, Springer, vol. 25(1), pages 53-66, March.
    19. Curina, Ilaria & Francioni, Barbara & Hegner, Sabrina M. & Cioppi, Marco, 2020. "Brand hate and non-repurchase intention: A service context perspective in a cross-channel setting," Journal of Retailing and Consumer Services, Elsevier, vol. 54(C).
    20. Overgoor, Gijs & Rand, William & van Dolen, Willemijn & Mazloom, Masoud, 2022. "Simplicity is not key: Understanding firm-generated social media images and consumer liking," International Journal of Research in Marketing, Elsevier, vol. 39(3), pages 639-655.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:149:y:2022:i:c:p:736-747. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.