IDEAS home Printed from https://ideas.repec.org/a/eee/jouret/v100y2024i1p130-147.html
   My bibliography  Save this article

Unlocking the Potential of Web Data for Retailing Research

Author

Listed:
  • Guyt, Jonne Y.
  • Datta, Hannes
  • Boegershausen, Johannes

Abstract

Web data collected via web scraping and application programming interfaces (APIs) has opened many new avenues for retail innovations and research opportunities. Yet, despite the abundance of online data on retailers, brands, products, and consumers, its use in retailing research remains limited. To spur the increased use of web data, we aim to achieve three goals. First, we review existing retailing applications using web data. Second, we demystify the use of web data by discussing its value in the context of existing retail data sets and to-be-constructed primary web datasets. Third, we provide a hands-on guide to help retailing researchers incorporate web data collection into their research routines. Our paper is accompanied by a mock-up digital retail store (music-to-scrape.org) that researchers and students can use to learn to collect web data using web scraping and APIs.

Suggested Citation

  • Guyt, Jonne Y. & Datta, Hannes & Boegershausen, Johannes, 2024. "Unlocking the Potential of Web Data for Retailing Research," Journal of Retailing, Elsevier, vol. 100(1), pages 130-147.
    • Handle: RePEc:eee:jouret:v:100:y:2024:i:1:p:130-147
    DOI: 10.1016/j.jretai.2024.02.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0022435924000046
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jretai.2024.02.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hannes Datta & George Knox & Bart J. Bronnenberg, 2018. "Changing Their Tune: How Consumers’ Adoption of Online Streaming Affects Music Consumption and Discovery," Marketing Science, INFORMS, vol. 37(1), pages 5-21, January.
    2. Sarah G. Moore, 2012. "Some Things Are Better Left Unsaid: How Word of Mouth Influences the Storyteller," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 38(6), pages 1140-1154.
    3. Gong, Jing & Smith, Michael D. & Telang, Rahul, 2015. "Substitution or Promotion? The Impact of Price Discounts on Cross-Channel Sales of Digital Movies," Journal of Retailing, Elsevier, vol. 91(2), pages 343-357.
    4. Aggarwal, Praveen & Vaidyanathan, Rajiv & Venkatesh, Alladi, 2009. "Using Lexical Semantic Analysis to Derive Online Brand Positions: An Application to Retail Marketing Research," Journal of Retailing, Elsevier, vol. 85(2), pages 145-158.
    5. Nejad, Mohammad G. & Amini, Mehdi & Babakus, Emin, 2015. "Success Factors in Product Seeding: The Role of Homophily," Journal of Retailing, Elsevier, vol. 91(1), pages 68-88.
    6. Gu, Yangjie & Wu, Yuechen, 2023. "Highlighting supply-abundance increases attraction to small-assortment retailers," Journal of Retailing, Elsevier, vol. 99(3), pages 420-439.
    7. Greta Hsu & Özgecan Koçak & Balázs Kovács, 2018. "Co-Opt or Coexist? A Study of Medical Cannabis Dispensaries’ Identity-Based Responses to Recreational-Use Legalization in Colorado and Washington," Organization Science, INFORMS, vol. 29(1), pages 172-190, February.
    8. Wang, Feng & Liu, Xuefeng & Fang, Eric (Er), 2015. "User Reviews Variance, Critic Reviews Variance, and Product Sales: An Exploration of Customer Breadth and Depth Effects," Journal of Retailing, Elsevier, vol. 91(3), pages 372-389.
    9. Duan, Wenjing & Gu, Bin & Whinston, Andrew B., 2008. "The dynamics of online word-of-mouth and product sales—An empirical investigation of the movie industry," Journal of Retailing, Elsevier, vol. 84(2), pages 233-242.
    10. Fay, Scott & Xie, Jinhong & Feng, Cong, 2015. "The Effect of Probabilistic Selling on the Optimal Product Mix," Journal of Retailing, Elsevier, vol. 91(3), pages 451-467.
    11. Guyt, Jonne & Gijsbrechts, Els, 2018. "On consumer choice patterns and the net impact of feature promotions," International Journal of Research in Marketing, Elsevier, vol. 35(3), pages 490-508.
    12. Kübler, Raoul V. & Lobschat, Lara & Welke, Lina & van der Meij, Hugo, 2024. "The effect of review images on review helpfulness: A contingency approach," Journal of Retailing, Elsevier, vol. 100(1), pages 5-23.
    13. Popkowski Leszczyc, Peter T.L. & Qiu, Chun & He, Yongfu, 2009. "Empirical Testing of the Reference-Price Effect of Buy-Now Prices in Internet Auctions," Journal of Retailing, Elsevier, vol. 85(2), pages 211-221.
    14. Grewal, Dhruv & Herhausen, Dennis & Ludwig, Stephan & Villarroel Ordenes, Francisco, 2022. "The Future of Digital Communication Research: Considering Dynamics and Multimodality," Journal of Retailing, Elsevier, vol. 98(2), pages 224-240.
    15. Ravula, Prashanth & Jha, Subhash & Biswas, Abhijit, 2022. "Relative persuasiveness of repurchase intentions versus recommendations in online reviews," Journal of Retailing, Elsevier, vol. 98(4), pages 724-740.
    16. Ratchford, Brian & Soysal, Gonca & Zentner, Alejandro & Gauri, Dinesh K., 2022. "Online and offline retailing: What we know and directions for future research," Journal of Retailing, Elsevier, vol. 98(1), pages 152-177.
    17. Marchand, André & Marx, Paul, 2020. "Automated Product Recommendations with Preference-Based Explanations," Journal of Retailing, Elsevier, vol. 96(3), pages 328-343.
    18. Verma, Swati & Guha, Abhijit & Biswas, Abhijit & Grewal, Dhruv, 2019. "Are Low Price and Price Matching Guarantees Equivalent? The Effects of Different Price Guarantees on Consumers’ Evaluations," Journal of Retailing, Elsevier, vol. 95(3), pages 99-108.
    19. Sarath Balachandran & Exequiel Hernandez, 2021. "Mi Casa Es Tu Casa: Immigrant Entrepreneurs as Pathways to Foreign Venture Capital Investments," Strategic Management Journal, Wiley Blackwell, vol. 42(11), pages 2047-2083, November.
    20. Zoey Chen & Jonah Berger, 2013. "When, Why, and How Controversy Causes Conversation," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 40(3), pages 580-593.
    21. Feng, Cong & Fay, Scott, 2022. "An empirical investigation of forward-looking retailer performance using parking lot traffic data derived from satellite imagery," Journal of Retailing, Elsevier, vol. 98(4), pages 633-646.
    22. Muller, Eitan, 2020. "Delimiting disruption: Why Uber is disruptive, but Airbnb is not," International Journal of Research in Marketing, Elsevier, vol. 37(1), pages 43-55.
    23. Figueiredo, Bernardo & Larsen, Hanne Pico & Bean, Jonathan, 2021. "The Cosmopolitan Servicescape," Journal of Retailing, Elsevier, vol. 97(2), pages 267-287.
    24. Fuchs, Christoph & Kaiser, Ulrike & Schreier, Martin & van Osselaer, Stijn M.J., 2022. "The value of making producers personal," Journal of Retailing, Elsevier, vol. 98(3), pages 486-495.
    25. Pan, Yue & Zhang, Jason Q., 2011. "Born Unequal: A Study of the Helpfulness of User-Generated Product Reviews," Journal of Retailing, Elsevier, vol. 87(4), pages 598-612.
    26. Alberto Cavallo & Roberto Rigobon, 2016. "The Billion Prices Project: Using Online Prices for Measurement and Research," Journal of Economic Perspectives, American Economic Association, vol. 30(2), pages 151-178, Spring.
    27. Lu, Huidi & van der Lans, Ralf & Helsen, Kristiaan & Gauri, Dinesh K., 2023. "DEPART: Decomposing prices using atheoretical regression trees," International Journal of Research in Marketing, Elsevier, vol. 40(4), pages 781-800.
    28. Wu, Laurie & Lee, Christopher, 2016. "Limited Edition for Me and Best Seller for You: The Impact of Scarcity versus Popularity Cues on Self versus Other-Purchase Behavior," Journal of Retailing, Elsevier, vol. 92(4), pages 486-499.
    29. Zhao, Kexin & Zhao, Xia & Deng, Jing, 2016. "An Empirical Investigation of Online Gray Markets," Journal of Retailing, Elsevier, vol. 92(4), pages 397-410.
    30. Joo, Mingyu & Mazumdar, Tridib & Raj, S.P., 2012. "Bidding Strategies and Consumer Savings in NYOP Auctions," Journal of Retailing, Elsevier, vol. 88(1), pages 180-188.
    31. Joseph Henrich & Steve J. Heine & Ara Norenzayan, 2010. "The Weirdest People in the World?," RatSWD Working Papers 139, German Data Forum (RatSWD).
    32. Michael Trusov & Liye Ma & Zainab Jamal, 2016. "Crumbs of the Cookie: User Profiling in Customer-Base Analysis and Behavioral Targeting," Marketing Science, INFORMS, vol. 35(3), pages 405-426, May.
    33. Verhoef, Peter C. & Broekhuizen, Thijs & Bart, Yakov & Bhattacharya, Abhi & Qi Dong, John & Fabian, Nicolai & Haenlein, Michael, 2021. "Digital transformation: A multidisciplinary reflection and research agenda," Journal of Business Research, Elsevier, vol. 122(C), pages 889-901.
    34. Joy, Annamma & Wang, Jeff Jianfeng & Orazi, Davide C. & Yoon, Seyee & LaTour, Kathryn & Peña, Camilo, 2023. "Co-creating affective atmospheres in retail experience," Journal of Retailing, Elsevier, vol. 99(2), pages 297-317.
    35. Boegershausen, Johannes & Datta, Hannes & Borah, Abhishek & Stephen, Andrew, 2022. "Fields of Gold: Web Scraping and APIs for Impactful Marketing Insights," Other publications TiSEM 5f1ed70a-48c3-422c-bc10-0, Tilburg University, School of Economics and Management.
    36. Meiseberg, Brinja, 2016. "The Effectiveness of E-tailers’ Communication Practices in Stimulating Sales of Niche versus Popular Products," Journal of Retailing, Elsevier, vol. 92(3), pages 319-332.
    37. Moon, Sangkil & Song, Reo, 2015. "The Roles of Cultural Elements in International Retailing of Cultural Products: An Application to the Motion Picture Industry," Journal of Retailing, Elsevier, vol. 91(1), pages 154-170.
    38. Arjen van Lin & Aylin Aydinli & Marco Bertini & Erica van Herpen & Julia von Schuckmann & Bernd H Schmitt & Manoj Thomas, 2023. "Does Cash Really Mean Trash? An Empirical Investigation into the Effect of Retailer Price Promotions on Household Food Waste," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 50(4), pages 663-682.
    39. Cui, Xuebin & Zhu, Ting & Chen, Yubo, 2024. "Where you live matters: The impact of offline retail density on mobile shopping app usage," Journal of Retailing, Elsevier, vol. 100(1), pages 41-55.
    40. Kovacheva, Aleksandra & Nikolova, Hristina & Lamberton, Cait, 2022. "Will he buy a surprise? Gender differences in the purchase of surprise offerings," Journal of Retailing, Elsevier, vol. 98(4), pages 667-684.
    41. Joseph Henrich & Steven J. Heine & Ara Norenzayan, 2010. "Most people are not WEIRD," Nature, Nature, vol. 466(7302), pages 29-29, July.
    42. Gielens, Katrijn & Steenkamp, Jan-Benedict E.M., 2019. "Branding in the era of digital (dis)intermediation," International Journal of Research in Marketing, Elsevier, vol. 36(3), pages 367-384.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Moon, Sangkil & Kim, Seung-Wook & Iacobucci, Dawn, 2024. "Dynamic relationship changes between reviewers and consumers in online product reviews," Journal of Retailing, Elsevier, vol. 100(1), pages 70-84.
    2. Ravula, Prashanth & Bhatnagar, Amit & Gauri, Dinesh K, 2023. "Role of gender in the creation and persuasiveness of online reviews," Journal of Business Research, Elsevier, vol. 154(C).
    3. Brown, James R. & Dant, Rajiv P., 2009. "The Theoretical Domains of Retailing Research: A Retrospective," Journal of Retailing, Elsevier, vol. 85(2), pages 113-128.
    4. Wang, Xin (Shane) & Ryoo, Jun Hyun (Joseph) & Bendle, Neil & Kopalle, Praveen K., 2021. "The role of machine learning analytics and metrics in retailing research," Journal of Retailing, Elsevier, vol. 97(4), pages 658-675.
    5. John A. List, 2024. "Optimally generate policy-based evidence before scaling," Nature, Nature, vol. 626(7999), pages 491-499, February.
    6. Duan, Yongrui & Liu, Tonghui & Mao, Zhixin, 2022. "How online reviews and coupons affect sales and pricing: An empirical study based on e-commerce platform," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    7. Cornand, Camille & Hubert, Paul, 2020. "On the external validity of experimental inflation forecasts: A comparison with five categories of field expectations," Journal of Economic Dynamics and Control, Elsevier, vol. 110(C).
    8. Wang, Feng & Liu, Xuefeng & Fang, Eric (Er), 2015. "User Reviews Variance, Critic Reviews Variance, and Product Sales: An Exploration of Customer Breadth and Depth Effects," Journal of Retailing, Elsevier, vol. 91(3), pages 372-389.
    9. Michael Muthukrishna & Joseph Henrich & Wataru Toyokawa & Takeshi Hamamura & Tatsuya Kameda & Steven J Heine, 2018. "Overconfidence is universal? Elicitation of Genuine Overconfidence (EGO) procedure reveals systematic differences across domain, task knowledge, and incentives in four populations," PLOS ONE, Public Library of Science, vol. 13(8), pages 1-30, August.
    10. Renaud Foucart & Jonathan H. W. Tan, 2024. "A test of loyalty," Theory and Decision, Springer, vol. 97(1), pages 109-137, August.
    11. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    12. Agnieszka Zablocki & Bodo Schlegelmilch & Michael J. Houston, 2019. "How valence, volume and variance of online reviews influence brand attitudes," AMS Review, Springer;Academy of Marketing Science, vol. 9(1), pages 61-77, June.
    13. Dominik Gutt, 2018. "In the Eye of the Beholder? Empirically Decomposing Different Economic Implications of the Online Rating Variance," Working Papers Dissertations 40, Paderborn University, Faculty of Business Administration and Economics.
    14. Haris Krijestorac & Rajiv Garg & Vijay Mahajan, 2020. "Cross-Platform Spillover Effects in Consumption of Viral Content: A Quasi-Experimental Analysis Using Synthetic Controls," Information Systems Research, INFORMS, vol. 31(2), pages 449-472, June.
    15. Wang, Jiaxin & Huang, Hongyan & Huang, Xiang & Sun, Di & Song, Zilong, 2024. "Returning from overseas: STEMs migration and corporate digitalization," International Review of Financial Analysis, Elsevier, vol. 91(C).
    16. Filipe Sengo Furtado & Thomas Reutterer & Nadine Schröder, 2022. "The carrot and the stick in online reviews: determinants of un-/helpfulness voting choices," Journal of Business Economics, Springer, vol. 92(4), pages 565-590, May.
    17. Maier, Erik & Wieringa, Jaap, 2021. "Acquiring customers through online marketplaces? The effect of marketplace sales on sales in a retailer's own channels," International Journal of Research in Marketing, Elsevier, vol. 38(2), pages 311-328.
    18. Jin Li & Yulan Zhang & Jianping Li & Jiangze Du, 2023. "The Role of Sentiment Tendency in Affecting Review Helpfulness for Durable Products: Nonlinearity and Complementarity," Information Systems Frontiers, Springer, vol. 25(4), pages 1459-1477, August.
    19. Sangjae Lee & Joon Yeon Choeh, 2020. "Using the Social Influence of Electronic Word-of-Mouth for Predicting Product Sales: The Moderating Effect of Review or Reviewer Helpfulness and Product Type," Sustainability, MDPI, vol. 12(19), pages 1-18, September.
    20. Xie, Guangming & Lü, Kevin & Gupta, Suraksha & Jiang, Yushi & Shi, Li, 2021. "How Dispersive Opinions Affect Consumer Decisions: Endowment Effect Guides Attributional Inferences," Journal of Retailing, Elsevier, vol. 97(4), pages 621-638.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jouret:v:100:y:2024:i:1:p:130-147. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/journal-of-retailing .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.