IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v34y2023i2p676-697.html
   My bibliography  Save this article

Text Performance on the Vine Stage? The Effect of Incentive on Product Review Text Quality

Author

Listed:
  • Dandan Qiao

    (NUS School of Computing, National University of Singapore, Singapore 117417)

  • Huaxia Rui

    (Simon Business School, University of Rochester, Rochester, New York 14627)

Abstract

Incentivized reviews have become increasingly prevalent on product review sites such as Amazon. Whereas outright fake reviews are clearly unacceptable and should be removed from review platforms, reviews by incentivized consumers with otherwise authentic product experiences fall into a gray area. On the one hand, many critics and researchers have warned of their harm by pointing out their biased ratings. On the other hand, these reviews might complement organic reviews with review text of higher quality. The current paper studies whether incentivized reviews on Amazon are more coherent and offer richer detail. We use Amazon’s platform-incentivized reviews, known as Vine reviews, for our primary sample and use seller-incentivized reviews for checking robustness. Estimations from a two-way fixed-effect model consistently show that incentivized reviews do compensate for their reduced impartiality through better text quality, measured by discourse coherence and level of relevant detail. This finding is further supported by a randomized experiment using Amazon Mechanical Turk. Hence, current literature findings on the poor quality of text of incentivized reviews, based on review length and lexical complexity, portray only an incomplete picture of incentivized reviews. Given that numerical ratings for products via incentivized reviews are likely biased whereas their text content is of high quality, a natural way to embrace incentivized reviews is to keep their text content, suppress their numerical ratings, and always highlight the label of “incentivized reviews.”

Suggested Citation

  • Dandan Qiao & Huaxia Rui, 2023. "Text Performance on the Vine Stage? The Effect of Incentive on Product Review Text Quality," Information Systems Research, INFORMS, vol. 34(2), pages 676-697, June.
    • Handle: RePEc:inm:orisre:v:34:y:2023:i:2:p:676-697
    DOI: 10.1287/isre.2022.1146
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.2022.1146
    Download Restriction: no
    File URL: https://libkey.io/10.1287/isre.2022.1146?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hainmueller, Jens, 2012. "Entropy Balancing for Causal Effects: A Multivariate Reweighting Method to Produce Balanced Samples in Observational Studies," Political Analysis, Cambridge University Press, vol. 20(1), pages 25-46, January.
    2. Luís Cabral & Lingfang (Ivy) Li, 2015. "A Dollar for Your Thoughts: Feedback-Conditional Rebates on eBay," Management Science, INFORMS, vol. 61(9), pages 2052-2063, September.
    3. Gordon Burtch & Yili Hong & Ravi Bapna & Vladas Griskevicius, 2018. "Stimulating Online Reviews by Combining Financial Incentives and Social Norms," Management Science, INFORMS, vol. 64(5), pages 2065-2082, May.
    4. Zhijie Lin & Ying Zhang & Yong Tan, 2019. "An Empirical Study of Free Product Sampling and Rating Bias," Service Science, INFORMS, vol. 30(1), pages 260-275, March.
    5. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    6. Dandan Qiao & Shun-Yang Lee & Andrew B. Whinston & Qiang Wei, 2020. "Financial Incentives Dampen Altruism in Online Prosocial Contributions: A Study of Online Reviews," Information Systems Research, INFORMS, vol. 31(4), pages 1361-1375, December.
    7. Monic Sun & Feng Zhu, 2013. "Ad Revenue and Content Commercialization: Evidence from Blogs," Management Science, INFORMS, vol. 59(10), pages 2314-2331, October.
    8. Yuewen Liu & Juan Feng, 2021. "Does Money Talk? The Impact of Monetary Incentives on User-Generated Content Contributions," Information Systems Research, INFORMS, vol. 32(2), pages 394-409, June.
    9. Yacheng Sun & Xiaojing Dong & Shelby McIntyre, 2017. "Motivation of User-Generated Content: Social Connectedness Moderates the Effects of Monetary Rewards," Marketing Science, INFORMS, vol. 36(3), pages 329-337, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xueyu Liu & Shue Mei & Weijun Zhong, 2023. "Video‐sharing platform's optimal monetary incentive decisions considering motivation crowding‐out effect," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 44(1), pages 371-387, January.
    2. Lena Abou El-Komboz & Anna Kerkhof & Johannes Loh, 2023. "Platform Partnership Programs and Content Supply: Evidence from the YouTube “Adpocalypse”," CESifo Working Paper Series 10363, CESifo.
    3. Yonghong Sun, 2023. "An economic analysis of different types of subsidies by UGC platforms," Information Technology and Management, Springer, vol. 24(3), pages 221-231, September.
    4. Marchenko, Maria & Sonnabend, Hendrik, 2022. "The Never Ending Book: The role of external stimuli and peer feedback in user-generated content production," Department of Economics Working Paper Series 320, WU Vienna University of Economics and Business.
    5. Xiang Hui & Meng Liu & Tat Chan, 2023. "Targeted incentives, broad impacts: Evidence from an E-commerce platform," Quantitative Marketing and Economics (QME), Springer, vol. 21(4), pages 493-517, December.
    6. Chen, Ruolan & Yuan, Ruizhi & Huang, Bo & Liu, Martin J., 2023. "Feeling warm or skeptical? An investigation into the effects of incentivized eWOM programs on customers’ eWOM sharing intentions," Journal of Business Research, Elsevier, vol. 167(C).
    7. Xiang Hui & Meng Liu & Tat Chan, 2022. "Targeted Incentives, Broad Impacts: Evidence from an E-commerce Platform," CESifo Working Paper Series 9894, CESifo.
    8. Dirk van Straaten, 2021. "Incentive Schemes in Customer Rating Systems - Comparing the Effects of Unconditional and Conditional Rebates on Intrinsic Motivation," Working Papers Dissertations 71, Paderborn University, Faculty of Business Administration and Economics.
    9. Jing Wang & Gen Li & Kai-Lung Hui, 2022. "Monetary Incentives and Knowledge Spillover: Evidence from a Natural Experiment," Management Science, INFORMS, vol. 68(5), pages 3549-3572, May.
    10. Chadi, Adrian & Hetschko, Clemens, 2025. "Income or leisure? On the hidden benefits of (un)employment," European Economic Review, Elsevier, vol. 171(C).
    11. Mazumder, Sharif & Rao, Ramesh, 2023. "Social trust and the choice between bank debt and public debt: Evidence from international data," Journal of Multinational Financial Management, Elsevier, vol. 67(C).
    12. Everding, Jakob & Marcus, Jan, 2020. "The effect of unemployment on the smoking behavior of couples," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 29(2), pages 154-170.
    13. Qili Wang & Liangfei Qiu & Wei Xu, 2024. "Informal Payments and Doctor Engagement in an Online Health Community: An Empirical Investigation Using Generalized Synthetic Control," Information Systems Research, INFORMS, vol. 35(2), pages 706-726, June.
    14. Ehrenfried, Felix & Holzner, Christian, 2019. "Dynamics and endogeneity of firms’ recruitment behaviour," Labour Economics, Elsevier, vol. 57(C), pages 63-84.
    15. Junaid Ahmed & Mazhar Mughal & Stephan Klasen, 2018. "Great Expectations? Remittances and Asset Accumulation in Pakistan," Journal of International Development, John Wiley & Sons, Ltd., vol. 30(3), pages 507-532, April.
    16. Turati, Riccardo, 2024. "Network Abroad and Culture: Global Individual-Level Evidence," GLO Discussion Paper Series 1488, Global Labor Organization (GLO).
    17. Gudibande, Rohan Ravindra & Jacob, Arun, 2020. "Minimum wages for domestic workers: impact evaluation of the Indian experience," World Development, Elsevier, vol. 130(C).
    18. Marcus, Jan, 2013. "The Effect of Unemployment on the Mental Health of Spouses – Evidence from plant closures in Germany," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 32(3), pages 546-558.
    19. Florian Neumeier, 2018. "Do Businessmen Make Good Governors?," Economic Inquiry, Western Economic Association International, vol. 56(4), pages 2116-2136, October.
    20. Hippolyte Balima, Wenéyam, 2017. "Do domestic bond markets participation help reduce financial dollarization in developing countries?," Economic Modelling, Elsevier, vol. 66(C), pages 146-155.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:34:y:2023:i:2:p:676-697. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.