IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v35y2024i3p1403-1421.html
   My bibliography  Save this article

Retargeted vs. Generic Product Recommendations: When is it Valuable to Present Retargeted Recommendations?

Author

Listed:
  • Xiang (Shawn) Wan

    (Leavey School of Business, Santa Clara University, Santa Clara, California 95053)

  • Anuj Kumar

    (Warrington College of Business, University of Florida, Gainesville, Florida 32611)

  • Xitong Li

    (Department of Information Systems and Operations Management, HEC Paris, 78351 Jouy-en-Josas, France)

Abstract

Although the effects of algorithmic product recommendations on product sales are understood, the differential effects of retargeted recommendations (recommended products a user has previously viewed) versus generic recommendations (recommended products a user has not previously viewed) are unclear. We conduct a field experiment to empirically examine the relative effect of retargeted versus generic recommendations on product sales at different stages of users’ purchase funnel. The product recommendations can affect sales by influencing the number of product impressions and their conversion rates (purchase probability conditional on impression). We separately estimate the effect of retargeted and generic recommendations on product impressions and conversion rates. We find that (i) generic recommendations increase conversion rates only in the early purchase funnel stage, but retargeted recommendations do not affect conversion rates, and (ii) both recommendations result in a higher number of impressions of recommended products. Overall, retargeted (generic) recommendations result in higher recommended and total product sales in the late (early) purchase funnel stage. We also conducted a controlled experiment on Amazon MTurk to unveil that retargeting (showing previously viewed products to users) drives the effect of retargeted recommendations. Our counterfactual simulations show that the retailer can obtain up to three percent higher product sales by applying our findings to the existing recommendation systems. Our research has implications for online retailers and the design of algorithmic product recommendation systems.

Suggested Citation

  • Xiang (Shawn) Wan & Anuj Kumar & Xitong Li, 2024. "Retargeted vs. Generic Product Recommendations: When is it Valuable to Present Retargeted Recommendations?," Information Systems Research, INFORMS, vol. 35(3), pages 1403-1421, September.
    • Handle: RePEc:inm:orisre:v:35:y:2024:i:3:p:1403-1421
    DOI: 10.1287/isre.2020.0560
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.2020.0560
    Download Restriction: no
    File URL: https://libkey.io/10.1287/isre.2020.0560?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Prabuddha De & Yu (Jeffrey) Hu & Mohammad S. Rahman, 2010. "Technology Usage and Online Sales: An Empirical Study," Management Science, INFORMS, vol. 56(11), pages 1930-1945, November.
    2. Dokyun Lee & Kartik Hosanagar, 2019. "How Do Recommender Systems Affect Sales Diversity? A Cross-Category Investigation via Randomized Field Experiment," Service Science, INFORMS, vol. 30(1), pages 239-259, March.
    3. Gediminas Adomavicius & Jingjing Zhang, 2016. "Classification, Ranking, and Top-K Stability of Recommendation Algorithms," INFORMS Journal on Computing, INFORMS, vol. 28(1), pages 129-147, February.
    4. Xitong Li & Jörn Grahl & Oliver Hinz, 2022. "How Do Recommender Systems Lead to Consumer Purchases? A Causal Mediation Analysis of a Field Experiment," Information Systems Research, INFORMS, vol. 33(2), pages 620-637, June.
    5. Anuj Kumar & Yinliang (Ricky) Tan, 2015. "The Demand Effects of Joint Product Advertising in Online Videos," Management Science, INFORMS, vol. 61(8), pages 1921-1937, August.
    6. Qiaowei Shen & J. Miguel Villas-Boas, 2018. "Behavior-Based Advertising," Management Science, INFORMS, vol. 64(5), pages 2047-2064, May.
    7. Gediminas Adomavicius & Jesse C. Bockstedt & Shawn P. Curley & Jingjing Zhangc, 2018. "Effects of Online Recommendations on Consumers’ Willingness to Pay," Information Systems Research, INFORMS, vol. 29(1), pages 84-102, March.
    8. Anuj Kumar & Kartik Hosanagar, 2019. "Measuring the Value of Recommendation Links on Product Demand," Information Systems Research, INFORMS, vol. 30(3), pages 819-838, September.
    9. Alexander Bleier & Maik Eisenbeiss, 2015. "Personalized Online Advertising Effectiveness: The Interplay of What, When, and Where," Marketing Science, INFORMS, vol. 34(5), pages 669-688, September.
    10. Chenshuo Sun & Panagiotis Adamopoulos & Anindya Ghose & Xueming Luo, 2022. "Predicting Stages in Omnichannel Path to Purchase: A Deep Learning Model," Information Systems Research, INFORMS, vol. 33(2), pages 429-445, June.
    11. Marios Kokkodis, 2021. "Dynamic, Multidimensional, and Skillset-Specific Reputation Systems for Online Work," Information Systems Research, INFORMS, vol. 32(3), pages 688-712, September.
    12. Vilma Todri & Anindya Ghose & Param Vir Singh, 2020. "Trade-Offs in Online Advertising: Advertising Effectiveness and Annoyance Dynamics Across the Purchase Funnel," Information Systems Research, INFORMS, vol. 31(1), pages 102-125, March.
    13. Yingjie Zhang & Beibei Li & Xueming Luo & Xiaoyi Wang, 2019. "Personalized Mobile Targeting with User Engagement Stages: Combining a Structural Hidden Markov Model and Field Experiment," Information Systems Research, INFORMS, vol. 30(3), pages 787-804, September.
    14. Marios Kokkodis & Panagiotis G. Ipeirotis, 2021. "Demand-Aware Career Path Recommendations: A Reinforcement Learning Approach," Management Science, INFORMS, vol. 67(7), pages 4362-4383, July.
    15. Dokyun Lee & Kartik Hosanagar, 2021. "How Do Product Attributes and Reviews Moderate the Impact of Recommender Systems Through Purchase Stages?," Management Science, INFORMS, vol. 67(1), pages 524-546, January.
    16. Gerald Häubl & Valerie Trifts, 2000. "Consumer Decision Making in Online Shopping Environments: The Effects of Interactive Decision Aids," Marketing Science, INFORMS, vol. 19(1), pages 4-21, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xitong Li & Jörn Grahl & Oliver Hinz, 2022. "How Do Recommender Systems Lead to Consumer Purchases? A Causal Mediation Analysis of a Field Experiment," Information Systems Research, INFORMS, vol. 33(2), pages 620-637, June.
    2. Dokyun Lee & Kartik Hosanagar, 2021. "How Do Product Attributes and Reviews Moderate the Impact of Recommender Systems Through Purchase Stages?," Management Science, INFORMS, vol. 67(1), pages 524-546, January.
    3. Anuj Kumar & Kartik Hosanagar, 2019. "Measuring the Value of Recommendation Links on Product Demand," Information Systems Research, INFORMS, vol. 30(3), pages 819-838, September.
    4. Jing Peng, 2023. "Identification of Causal Mechanisms from Randomized Experiments: A Framework for Endogenous Mediation Analysis," Information Systems Research, INFORMS, vol. 34(1), pages 67-84, March.
    5. Qiang Wei & Yao Mu & Xunhua Guo & Weijie Jiang & Guoqing Chen, 2024. "Dynamic Bayesian Network–Based Product Recommendation Considering Consumers’ Multistage Shopping Journeys: A Marketing Funnel Perspective," Information Systems Research, INFORMS, vol. 35(3), pages 1382-1402, September.
    6. Dongwon Lee & Anandasivam Gopal & Sung-Hyuk Park, 2020. "Different but Equal? A Field Experiment on the Impact of Recommendation Systems on Mobile and Personal Computer Channels in Retail," Information Systems Research, INFORMS, vol. 31(3), pages 892-912, September.
    7. Hsing Kenneth Cheng & D. Daniel Sokol & Xinyu Zang, 2024. "The rise of empirical online platform research in the new millennium," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 33(2), pages 416-451, March.
    8. Ruiqi Rich Zhu & Cheng He & Yu Jeffrey Hu, 2023. "The Effect of Product Recommendations on Online Investor Behaviors," Papers 2303.14263, arXiv.org, revised Nov 2023.
    9. Ni Huang & Probal Mojumder & Tianshu Sun & Jinchi Lv & Joseph M. Golden, 2021. "Not Registered? Please Sign Up First: A Randomized Field Experiment on the Ex Ante Registration Request," Information Systems Research, INFORMS, vol. 32(3), pages 914-931, September.
    10. Chenshuo Sun & Panagiotis Adamopoulos & Anindya Ghose & Xueming Luo, 2022. "Predicting Stages in Omnichannel Path to Purchase: A Deep Learning Model," Information Systems Research, INFORMS, vol. 33(2), pages 429-445, June.
    11. Yi, Sangyoon & Kim, Dongyeon & Ju, Jaehyeon, 2022. "Recommendation technologies and consumption diversity: An experimental study on product recommendations, consumer search, and sales diversity," Technological Forecasting and Social Change, Elsevier, vol. 178(C).
    12. Miguel Godinho de Matos & Pedro Ferreira, 2020. "The Effect of Binge-Watching on the Subscription of Video on Demand: Results from Randomized Experiments," Information Systems Research, INFORMS, vol. 31(4), pages 1337-1360, December.
    13. Kevin Bauer & Andrej Gill, 2024. "Mirror, Mirror on the Wall: Algorithmic Assessments, Transparency, and Self-Fulfilling Prophecies," Information Systems Research, INFORMS, vol. 35(1), pages 226-248, March.
    14. Xuan Bi & Gediminas Adomavicius & William Li & Annie Qu, 2022. "Improving Sales Forecasting Accuracy: A Tensor Factorization Approach with Demand Awareness," INFORMS Journal on Computing, INFORMS, vol. 34(3), pages 1644-1660, May.
    15. Park, YoungSoo & Sim, Jeongeun & Kim, Bosung, 2022. "Online retail operations with “Try-Before-You-Buy”," European Journal of Operational Research, Elsevier, vol. 299(3), pages 987-1002.
    16. Dokyun Lee & Kartik Hosanagar, 2019. "How Do Recommender Systems Affect Sales Diversity? A Cross-Category Investigation via Randomized Field Experiment," Service Science, INFORMS, vol. 30(1), pages 239-259, March.
    17. Marios Kokkodis, 2023. "Adjusting Skillset Cohesion in Online Labor Markets: Reputation Gains and Opportunity Losses," Information Systems Research, INFORMS, vol. 34(3), pages 1245-1258, September.
    18. Lütjens, Henk & Eisenbeiss, Maik & Fiedler, Maximilian & Bijmolt, Tammo, 2022. "Determinants of consumers’ attitudes towards digital advertising – A meta-analytic comparison across time and touchpoints," Journal of Business Research, Elsevier, vol. 153(C), pages 445-466.
    19. Molaie, Mir Majid & Lee, Wonjae, 2022. "Economic corollaries of personalized recommendations," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    20. Zhang, Junhui & Balaji, M.S. & Luo, Jun & Jha, Subhash, 2022. "Effectiveness of product recommendation framing on online retail platforms," Journal of Business Research, Elsevier, vol. 153(C), pages 185-197.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:35:y:2024:i:3:p:1403-1421. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.