IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v67y2021i1p524-546.html
   My bibliography  Save this article

How Do Product Attributes and Reviews Moderate the Impact of Recommender Systems Through Purchase Stages?

Author

Listed:
  • Dokyun Lee

    (Carnegie Mellon University, Pittsburgh, Pennsylvania 15213;)

  • Kartik Hosanagar

    (he Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania 19104)

Abstract

We investigate the moderating effect of product attributes and review ratings on views, conversion|views (conversion conditional on views), and final conversion of a purchase-based collaborative filtering recommender system on an e-commerce site. We run a randomized field experiment on a top retailer with 184,375 users split into a recommender-treated group and a control group. We tag theory-driven attributes of 37,125 unique products via Amazon Mechanical Turk to augment the usual product data (e.g., review ratings, descriptions). By examining the recommender’s impact through different stages—awareness (views), salience ( conversion|views ), and final conversion—and across product types, we provide nuanced insights. The study confirms that the recommender increases views, conversion|views , and final conversion rates by 15.3%, 21.6%, and 7.5%, respectively, but this lift is moderated by product attributes and review ratings. We find that the lift on product views is greater for utilitarian products compared with hedonic products as well as for experience products compared with search products. In contrast, the lift on conversion|views rate is greater for hedonic products compared with utilitarian products. Furthermore, the lift on views rate is greater for products with higher average review ratings, which suggests that a recommender acts as a complement to review ratings, whereas the opposite is true for conversion|views , where recommender and review ratings are substitutes. Additionally, a recommender’s awareness lift is greater than its saliency impact. We discuss the potential mechanisms behind our results as well as their managerial implications.

Suggested Citation

  • Dokyun Lee & Kartik Hosanagar, 2021. "How Do Product Attributes and Reviews Moderate the Impact of Recommender Systems Through Purchase Stages?," Management Science, INFORMS, vol. 67(1), pages 524-546, January.
    • Handle: RePEc:inm:ormnsc:v:67:y:2021:i:1:p:524-546
    DOI: 10.1287/mnsc.2019.3546
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/mnsc.2019.3546
    Download Restriction: no
    File URL: https://libkey.io/10.1287/mnsc.2019.3546?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Prabuddha De & Yu (Jeffrey) Hu & Mohammad S. Rahman, 2010. "Technology Usage and Online Sales: An Empirical Study," Management Science, INFORMS, vol. 56(11), pages 1930-1945, November.
    2. Weitzman, Martin L, 1979. "Optimal Search for the Best Alternative," Econometrica, Econometric Society, vol. 47(3), pages 641-654, May.
    3. Dokyun Lee & Kartik Hosanagar, 2019. "How Do Recommender Systems Affect Sales Diversity? A Cross-Category Investigation via Randomized Field Experiment," Service Science, INFORMS, vol. 30(1), pages 239-259, March.
    4. Anuj Kumar & Yinliang (Ricky) Tan, 2015. "The Demand Effects of Joint Product Advertising in Online Videos," Management Science, INFORMS, vol. 61(8), pages 1921-1937, August.
    5. Girard, Tulay & Dion, Paul, 2010. "Validating the search, experience, and credence product classification framework," Journal of Business Research, Elsevier, vol. 63(9-10), pages 1079-1087, September.
    6. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, September.
    7. Maddala,G. S., 1986. "Limited-Dependent and Qualitative Variables in Econometrics," Cambridge Books, Cambridge University Press, number 9780521338257, October.
    8. Avi Goldfarb & Catherine Tucker, 2011. "Online Display Advertising: Targeting and Obtrusiveness," Marketing Science, INFORMS, vol. 30(3), pages 389-404, 05-06.
    9. Gerd Gigerenzer & Reinhard Selten (ed.), 2002. "Bounded Rationality: The Adaptive Toolbox," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262571641, April.
    10. Daniel Fleder & Kartik Hosanagar, 2009. "Blockbuster Culture's Next Rise or Fall: The Impact of Recommender Systems on Sales Diversity," Management Science, INFORMS, vol. 55(5), pages 697-712, May.
    11. Babin, Barry J & Darden, William R & Griffin, Mitch, 1994. "Work and/or Fun: Measuring Hedonic and Utilitarian Shopping Value," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 20(4), pages 644-656, March.
    12. Yili (Kevin) Hong & Paul A. Pavlou, 2014. "Product Fit Uncertainty in Online Markets: Nature, Effects, and Antecedents," Information Systems Research, INFORMS, vol. 25(2), pages 328-344, June.
    13. Monic Sun, 2012. "How Does the Variance of Product Ratings Matter?," Management Science, INFORMS, vol. 58(4), pages 696-707, April.
    14. Anuj Kumar & Kartik Hosanagar, 2019. "Measuring the Value of Recommendation Links on Product Demand," Information Systems Research, INFORMS, vol. 30(3), pages 819-838, September.
    15. Nelson, Philip, 1974. "Advertising as Information," Journal of Political Economy, University of Chicago Press, vol. 82(4), pages 729-754, July/Aug..
    16. Ai, Chunrong & Norton, Edward C., 2003. "Interaction terms in logit and probit models," Economics Letters, Elsevier, vol. 80(1), pages 123-129, July.
    17. Catherine Tucker & Juanjuan Zhang, 2011. "How Does Popularity Information Affect Choices? A Field Experiment," Management Science, INFORMS, vol. 57(5), pages 828-842, May.
    18. Oliver Hinz & Jochen Eckert, 2010. "The Impact of Search and Recommendation Systems on Sales in Electronic Commerce," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 2(2), pages 67-77, April.
    19. Strahilevitz, Michal & Myers, John G, 1998. "Donations to Charity as Purchase Incentives: How Well They Work May Depend on What You Are Trying to Sell," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 24(4), pages 434-446, March.
    20. Caudill, Steven B, 1988. "An Advantage of the Linear Probability Model over Probit or Logit," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 50(4), pages 425-427, November.
    21. Mark Armstrong & Robert Porter (ed.), 2007. "Handbook of Industrial Organization," Handbook of Industrial Organization, Elsevier, edition 1, volume 3, number 1.
    22. Avi Goldfarb & Catherine Tucker, 2011. "Rejoinder--Implications of "Online Display Advertising: Targeting and Obtrusiveness"," Marketing Science, INFORMS, vol. 30(3), pages 413-415, 05-06.
    23. Animesh Animesh & Vandana Ramachandran & Siva Viswanathan, 2010. "Research Note ---Quality Uncertainty and the Performance of Online Sponsored Search Markets: An Empirical Investigation," Information Systems Research, INFORMS, vol. 21(1), pages 190-201, March.
    24. Yubo Chen & Jinhong Xie, 2008. "Online Consumer Review: Word-of-Mouth as a New Element of Marketing Communication Mix," Management Science, INFORMS, vol. 54(3), pages 477-491, March.
    25. Il-Horn Hann & Christian Terwiesch, 2003. "Measuring the Frictional Costs of Online Transactions: The Case of a Name-Your-Own-Price Channel," Management Science, INFORMS, vol. 49(11), pages 1563-1579, November.
    26. Asher Wolinsky, 1983. "Prices as Signals of Product Quality," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 50(4), pages 647-658.
    27. Greevy, Robert & Silber, Jeffrey H. & Cnaan, Avital & Rosenbaum, Paul R., 2004. "Randomization Inference With Imperfect Compliance in the ACE-Inhibitor After Anthracycline Randomized Trial," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 7-15, January.
    28. Bin Gu & Jaehong Park & Prabhudev Konana, 2012. "Research Note ---The Impact of External Word-of-Mouth Sources on Retailer Sales of High-Involvement Products," Information Systems Research, INFORMS, vol. 23(1), pages 182-196, March.
    29. Prabuddha De & Yu (Jeffrey) Hu & Mohammad S. Rahman, 2013. "Product-Oriented Web Technologies and Product Returns: An Exploratory Study," Information Systems Research, INFORMS, vol. 24(4), pages 998-1010, December.
    30. Nelson, Phillip, 1970. "Information and Consumer Behavior," Journal of Political Economy, University of Chicago Press, vol. 78(2), pages 311-329, March-Apr.
    31. Klein, Lisa R., 1998. "Evaluating the Potential of Interactive Media through a New Lens: Search versus Experience Goods," Journal of Business Research, Elsevier, vol. 41(3), pages 195-203, March.
    32. Gerard R. Butters, 1977. "Equilibrium Distributions of Sales and Advertising Prices," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 44(3), pages 465-491.
    33. Chong Ju Choi & Carla C. J. M. Millar & Caroline Y. L. Wong, 2005. "Knowledge and the State," Palgrave Macmillan Books, in: Knowledge Entanglements, chapter 0, pages 19-38, Palgrave Macmillan.
    34. Bagwell, Kyle, 2007. "The Economic Analysis of Advertising," Handbook of Industrial Organization, in: Mark Armstrong & Robert Porter (ed.), Handbook of Industrial Organization, edition 1, volume 3, chapter 28, pages 1701-1844, Elsevier.
    35. Gerald Häubl & Valerie Trifts, 2000. "Consumer Decision Making in Online Shopping Environments: The Effects of Interactive Decision Aids," Marketing Science, INFORMS, vol. 19(1), pages 4-21, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ruan, Yanya & Mezei, József, 2022. "When do AI chatbots lead to higher customer satisfaction than human frontline employees in online shopping assistance? Considering product attribute type," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    2. Ransome Epie Bawack & Samuel Fosso Wamba & Kevin Daniel André Carillo & Shahriar Akter, 2022. "Artificial intelligence in E-Commerce: a bibliometric study and literature review," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(1), pages 297-338, March.
    3. Xitong Li & Jörn Grahl & Oliver Hinz, 2022. "How Do Recommender Systems Lead to Consumer Purchases? A Causal Mediation Analysis of a Field Experiment," Information Systems Research, INFORMS, vol. 33(2), pages 620-637, June.
    4. Qin, Chang-Xiong & Liu, Zhao, 2022. "Reference price effect of partially similar online products in the consideration stage," Journal of Business Research, Elsevier, vol. 152(C), pages 70-81.
    5. Jing Peng, 2023. "Identification of Causal Mechanisms from Randomized Experiments: A Framework for Endogenous Mediation Analysis," Information Systems Research, INFORMS, vol. 34(1), pages 67-84, March.
    6. Yun Young Hur & Fujie Jin & Xitong Li & Yuan Cheng & Yu Jeffrey Hu, 2023. "Does Social Influence Change with Other Information Sources? A Large-Scale Randomized Experiment in Medical Crowdfunding," Information Systems Research, INFORMS, vol. 34(4), pages 1476-1492, December.
    7. Song, Yongming & Li, Yanhong & Zhu, Hongli & Li, Guangxu, 2023. "A decision support model for buying battery electric vehicles considering consumer learning and psychological behavior," Journal of Retailing and Consumer Services, Elsevier, vol. 73(C).
    8. Janina Seutter & Kristin Kutzner & Maren Stadtländer & Dennis Kundisch & Ralf Knackstedt, 2023. "“Sorry, too much information”—Designing online review systems that support information search and processing," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-19, December.
    9. Chenshuo Sun & Panagiotis Adamopoulos & Anindya Ghose & Xueming Luo, 2022. "Predicting Stages in Omnichannel Path to Purchase: A Deep Learning Model," Information Systems Research, INFORMS, vol. 33(2), pages 429-445, June.
    10. Xiong, Yingqiu & Liu, Yezheng & Qian, Yang & Jiang, Yuanchun & Chai, Yidong & Ling, Haifeng, 2024. "Review-based recommendation under preference uncertainty: An asymmetric deep learning framework," European Journal of Operational Research, Elsevier, vol. 316(3), pages 1044-1057.
    11. Ruiqi Rich Zhu & Cheng He & Yu Jeffrey Hu, 2023. "The Effect of Product Recommendations on Online Investor Behaviors," Papers 2303.14263, arXiv.org, revised Nov 2023.
    12. Amelia Fletcher & Peter L Ormosi & Rahul Savani, 2023. "Recommender Systems and Supplier Competition on Platforms," Journal of Competition Law and Economics, Oxford University Press, vol. 19(3), pages 397-426.
    13. Park, YoungSoo & Sim, Jeongeun & Kim, Bosung, 2022. "Online retail operations with “Try-Before-You-Buy”," European Journal of Operational Research, Elsevier, vol. 299(3), pages 987-1002.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xitong Li & Jörn Grahl & Oliver Hinz, 2022. "How Do Recommender Systems Lead to Consumer Purchases? A Causal Mediation Analysis of a Field Experiment," Information Systems Research, INFORMS, vol. 33(2), pages 620-637, June.
    2. Nathan M. Fong, 2017. "How Targeting Affects Customer Search: A Field Experiment," Management Science, INFORMS, vol. 63(7), pages 2353-2364, July.
    3. Brett Hollenbeck & Sridhar Moorthy & Davide Proserpio, 2019. "Advertising Strategy in the Presence of Reviews: An Empirical Analysis," Marketing Science, INFORMS, vol. 38(5), pages 793-811, September.
    4. Peitz, Martin & Reisinger, Markus, 2014. "The Economics of Internet Media," Working Papers 14-23, University of Mannheim, Department of Economics.
    5. Yili (Kevin) Hong & Paul A. Pavlou, 2014. "Product Fit Uncertainty in Online Markets: Nature, Effects, and Antecedents," Information Systems Research, INFORMS, vol. 25(2), pages 328-344, June.
    6. Tibert Verhagen & Daniel Bloemers, 2018. "Exploring the cognitive and affective bases of online purchase intentions: a hierarchical test across product types," Electronic Commerce Research, Springer, vol. 18(3), pages 537-561, September.
    7. Salvatore Piccolo & Piero Tedeschi & Giovanni Ursino, 2018. "Deceptive Advertising with Rational Buyers," Management Science, INFORMS, vol. 64(3), pages 1291-1310, March.
    8. Simon P. Anderson & Régis Renault, 2006. "Advertising Content," American Economic Review, American Economic Association, vol. 96(1), pages 93-113, March.
    9. Vilma Todri & Anindya Ghose & Param Vir Singh, 2020. "Trade-Offs in Online Advertising: Advertising Effectiveness and Annoyance Dynamics Across the Purchase Funnel," Information Systems Research, INFORMS, vol. 31(1), pages 102-125, March.
    10. Simon P. Anderson & Régis Renault, 2013. "The Advertising Mix for a Search Good," Management Science, INFORMS, vol. 59(1), pages 69-83, April.
    11. Dokyun Lee & Kartik Hosanagar, 2019. "How Do Recommender Systems Affect Sales Diversity? A Cross-Category Investigation via Randomized Field Experiment," Service Science, INFORMS, vol. 30(1), pages 239-259, March.
    12. Christian Matt & Thomas Hess, 2016. "Product fit uncertainty and its effects on vendor choice: an experimental study," Electronic Markets, Springer;IIM University of St. Gallen, vol. 26(1), pages 83-93, February.
    13. Yogesh V. Joshi & Andres Musalem, 2021. "When Consumers Learn, Money Burns: Signaling Quality via Advertising with Observational Learning and Word of Mouth," Marketing Science, INFORMS, vol. 40(1), pages 168-188, January.
    14. Meiseberg, Brinja, 2016. "The Effectiveness of E-tailers’ Communication Practices in Stimulating Sales of Niche versus Popular Products," Journal of Retailing, Elsevier, vol. 92(3), pages 319-332.
    15. Pedro Gomis‐Porqueras & Benoit Julien & Chengsi Wang, 2017. "Strategic Advertising And Directed Search," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 58(3), pages 783-806, August.
    16. Dongpu Fu & Yili Hong & Kanliang Wang & Weiguo Fan, 2018. "Effects of membership tier on user content generation behaviors: evidence from online reviews," Electronic Commerce Research, Springer, vol. 18(3), pages 457-483, September.
    17. Belleflamme,Paul & Peitz,Martin, 2015. "Industrial Organization," Cambridge Books, Cambridge University Press, number 9781107687899, September.
    18. Peiyu Chen & Lorin M. Hitt & Yili Hong & Shinyi Wu, 2021. "Measuring Product Type and Purchase Uncertainty with Online Product Ratings: A Theoretical Model and Empirical Application," Information Systems Research, INFORMS, vol. 32(4), pages 1470-1489, December.
    19. Dina Mayzlin & Jiwoong Shin, 2011. "Uninformative Advertising as an Invitation to Search," Marketing Science, INFORMS, vol. 30(4), pages 666-685, July.
    20. Yi, Sangyoon & Kim, Dongyeon & Ju, Jaehyeon, 2022. "Recommendation technologies and consumption diversity: An experimental study on product recommendations, consumer search, and sales diversity," Technological Forecasting and Social Change, Elsevier, vol. 178(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:67:y:2021:i:1:p:524-546. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.