IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v25y2014i2p222-238.html
   My bibliography  Save this article

“Popularity Effect” in User-Generated Content: Evidence from Online Product Reviews

Author

Listed:
  • Paulo B. Goes

    (Eller College of Management, University of Arizona, Tucson, Arizona 85721)

  • Mingfeng Lin

    (Eller College of Management, University of Arizona, Tucson, Arizona 85721)

  • Ching-man Au Yeung

    (Axon Labs Ltd., Hong Kong)

Abstract

Online product reviews are increasingly important for consumer decisions, yet we still know little about how reviews are generated in the first place. In an effort to gather more reviews, many websites encourage user interactions such as allowing one user to subscribe to another. Do these interactions actually facilitate the generation of product reviews? More importantly, what kind of reviews do such interactions induce? We study these questions using data from one of the largest product review websites where users can subscribe to one another. By applying both panel data and a flexible matching method, we find that as users become more popular, they produce more reviews and more objective reviews; however, their numeric ratings also systematically change and become more negative and more varied. Such trade-off has not been previously documented and has important implications for both product review and other user-generated content websites.

Suggested Citation

  • Paulo B. Goes & Mingfeng Lin & Ching-man Au Yeung, 2014. "“Popularity Effect” in User-Generated Content: Evidence from Online Product Reviews," Information Systems Research, INFORMS, vol. 25(2), pages 222-238, June.
    • Handle: RePEc:inm:orisre:v:25:y:2014:i:2:p:222-238
    DOI: 10.1287/isre.2013.0512
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.2013.0512
    Download Restriction: no
    File URL: https://libkey.io/10.1287/isre.2013.0512?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Raghuram Iyengar & Christophe Van den Bulte & Thomas W. Valente, 2011. "Opinion Leadership and Social Contagion in New Product Diffusion," Marketing Science, INFORMS, vol. 30(2), pages 195-212, 03-04.
    2. Gary E. Bolton & Elena Katok & Axel Ockenfels, 2004. "How Effective Are Electronic Reputation Mechanisms? An Experimental Investigation," Management Science, INFORMS, vol. 50(11), pages 1587-1602, November.
    3. Jonah Berger & Alan T. Sorensen & Scott J. Rasmussen, 2010. "Positive Effects of Negative Publicity: When Negative Reviews Increase Sales," Marketing Science, INFORMS, vol. 29(5), pages 815-827, 09-10.
    4. Brian S. Butler & Xiaoqing Wang, 2012. "The Cross-Purposes of Cross-Posting: Boundary Reshaping Behavior in Online Discussion Communities," Information Systems Research, INFORMS, vol. 23(3-part-2), pages 993-1010, September.
    5. Sam Ransbotham & Gerald C. Kane & Nicholas H. Lurie, 2012. "Network Characteristics and the Value of Collaborative User-Generated Content," Marketing Science, INFORMS, vol. 31(3), pages 387-405, May.
    6. Rohit Aggarwal & Ram Gopal & Alok Gupta & Harpreet Singh, 2012. "Putting Money Where the Mouths Are: The Relation Between Venture Financing and Electronic Word-of-Mouth," Information Systems Research, INFORMS, vol. 23(3-part-2), pages 976-992, September.
    7. Xinxin Li & Lorin M. Hitt, 2008. "Self-Selection and Information Role of Online Product Reviews," Information Systems Research, INFORMS, vol. 19(4), pages 456-474, December.
    8. anonymous, 1967. "Free for All," Management Science, INFORMS, vol. 13(8), pages 533-539, April.
    9. Samer Faraj & Steven L. Johnson, 2011. "Network Exchange Patterns in Online Communities," Organization Science, INFORMS, vol. 22(6), pages 1464-1480, December.
    10. Yingda Lu & Kinshuk Jerath & Param Vir Singh, 2013. "The Emergence of Opinion Leaders in a Networked Online Community: A Dyadic Model with Time Dynamics and a Heuristic for Fast Estimation," Management Science, INFORMS, vol. 59(8), pages 1783-1799, August.
    11. Dellarocas, Chrysanthos, 2003. "The Digitization of Word-of-mouth: Promise and Challenges of Online Feedback Mechanisms," Working papers 4296-03, Massachusetts Institute of Technology (MIT), Sloan School of Management.
    12. David M. Drukker, 2003. "Testing for serial correlation in linear panel-data models," Stata Journal, StataCorp LP, vol. 3(2), pages 168-177, June.
    13. Sarah C. Rice, 2012. "Reputation and Uncertainty in Online Markets: An Experimental Study," Information Systems Research, INFORMS, vol. 23(2), pages 436-452, June.
    14. Chrysanthos Dellarocas & Charles A. Wood, 2008. "The Sound of Silence in Online Feedback: Estimating Trading Risks in the Presence of Reporting Bias," Management Science, INFORMS, vol. 54(3), pages 460-476, March.
    15. Jeffrey E. Sohl, 1999. "The early-stage equity market in the USA," Venture Capital, Taylor & Francis Journals, vol. 1(2), pages 101-120, April.
    16. Peter V. Marsden & Noah E. Friedkin, 1993. "Network Studies of Social Influence," Sociological Methods & Research, , vol. 22(1), pages 127-151, August.
    17. Monic Sun, 2012. "How Does the Variance of Product Ratings Matter?," Management Science, INFORMS, vol. 58(4), pages 696-707, April.
    18. Yan Chen & F. Maxwell Harper & Joseph Konstan & Sherry Xin Li, 2010. "Social Comparisons and Contributions to Online Communities: A Field Experiment on MovieLens," American Economic Review, American Economic Association, vol. 100(4), pages 1358-1398, September.
    19. Patrick J. Bateman & Peter H. Gray & Brian S. Butler, 2011. "Research Note ---The Impact of Community Commitment on Participation in Online Communities," Information Systems Research, INFORMS, vol. 22(4), pages 841-854, December.
    20. Anjana Susarla & Jeong-Ha Oh & Yong Tan, 2012. "Social Networks and the Diffusion of User-Generated Content: Evidence from YouTube," Information Systems Research, INFORMS, vol. 23(1), pages 23-41, March.
    21. anonymous, 1967. "Free For All," Management Science, INFORMS, vol. 13(6), pages 378-382, February.
    22. Chrysanthos Dellarocas, 2003. "The Digitization of Word of Mouth: Promise and Challenges of Online Feedback Mechanisms," Management Science, INFORMS, vol. 49(10), pages 1407-1424, October.
    23. Chris Forman & Anindya Ghose & Batia Wiesenfeld, 2008. "Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets," Information Systems Research, INFORMS, vol. 19(3), pages 291-313, September.
    24. Paul A. Pavlou & Angelika Dimoka, 2006. "The Nature and Role of Feedback Text Comments in Online Marketplaces: Implications for Trust Building, Price Premiums, and Seller Differentiation," Information Systems Research, INFORMS, vol. 17(4), pages 392-414, December.
    25. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    26. Manuel Arellano & Stephen Bond, 1991. "Some Tests of Specification for Panel Data: Monte Carlo Evidence and an Application to Employment Equations," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(2), pages 277-297.
    27. Bin Gu & Prabhudev Konana & Balaji Rajagopalan & Hsuan-Wei Michelle Chen, 2007. "Competition Among Virtual Communities and User Valuation: The Case of Investing-Related Communities," Information Systems Research, INFORMS, vol. 18(1), pages 68-85, March.
    28. Xiaoquan (Michael) Zhang & Feng Zhu, 2011. "Group Size and Incentives to Contribute: A Natural Experiment at Chinese Wikipedia," American Economic Review, American Economic Association, vol. 101(4), pages 1601-1615, June.
    29. Pradeep K. Chintagunta & Shyam Gopinath & Sriram Venkataraman, 2010. "The Effects of Online User Reviews on Movie Box Office Performance: Accounting for Sequential Rollout and Aggregation Across Local Markets," Marketing Science, INFORMS, vol. 29(5), pages 944-957, 09-10.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cheng Zhao & Chong Alex Wang, 2023. "A cross-site comparison of online review manipulation using Benford’s law," Electronic Commerce Research, Springer, vol. 23(1), pages 365-406, March.
    2. Lianren Wu & Jinjie Li & Jiayin Qi & Deli Kong & Xu Li, 2021. "The Role of Opinion Leaders in the Sustainable Development of Corporate-Led Consumer Advice Networks: Evidence from a Chinese Travel Content Community," Sustainability, MDPI, vol. 13(19), pages 1-20, October.
    3. Salvatore Carta & Andrea Medda & Alessio Pili & Diego Reforgiato Recupero & Roberto Saia, 2018. "Forecasting E-Commerce Products Prices by Combining an Autoregressive Integrated Moving Average (ARIMA) Model and Google Trends Data," Future Internet, MDPI, vol. 11(1), pages 1-19, December.
    4. Ziwei Cong & Jia Liu & Puneet Manchanda, 2021. "The Role of "Live" in Livestreaming Markets: Evidence Using Orthogonal Random Forest," Papers 2107.01629, arXiv.org, revised Sep 2022.
    5. Samer Faraj & Georg von Krogh & Eric Monteiro & Karim R. Lakhani, 2016. "Special Section Introduction—Online Community as Space for Knowledge Flows," Information Systems Research, INFORMS, vol. 27(4), pages 668-684, December.
    6. Tao Lu & May Yuan & Chong (Alex) Wang & Xiaoquan (Michael) Zhang, 2022. "Histogram Distortion Bias in Consumer Choices," Management Science, INFORMS, vol. 68(12), pages 8963-8978, December.
    7. Sheng, Jie & Amankwah-Amoah, Joseph & Wang, Xiaojun, 2017. "A multidisciplinary perspective of big data in management research," International Journal of Production Economics, Elsevier, vol. 191(C), pages 97-112.
    8. Zhang, Yuhan & Feng, Xin & Wu, Ye & Xiao, Jinghua, 2018. "The dynamics of online ratings with heterogeneous preferences in online review platform," Chaos, Solitons & Fractals, Elsevier, vol. 109(C), pages 26-30.
    9. Topaloglu, Omer & Dass, Mayukh & Kumar, Piyush, 2017. "Does who we are affect what we say and when? Investigating the impact of activity and connectivity on microbloggers' response to new products," Journal of Business Research, Elsevier, vol. 77(C), pages 23-29.
    10. Lu, Shuya & Wu, Jianan & Tseng, Shih-Lun (Allen), 2018. "How Online Reviews Become Helpful: A Dynamic Perspective," Journal of Interactive Marketing, Elsevier, vol. 44(C), pages 17-28.
    11. Jiaming Fang & Lixue Hu & Xiangqian Liu & Victor R. Prybutok, 2022. "Impact of air quality on online restaurant review comprehensiveness," Electronic Commerce Research, Springer, vol. 22(4), pages 1035-1058, December.
    12. Xunyi Wang & Meiling Jiang & Wencui Han & Liangfei Qiu, 2022. "Do Emotions Sell? The Impact of Emotional Expressions on Sales in the Space‐Sharing Economy," Production and Operations Management, Production and Operations Management Society, vol. 31(1), pages 65-82, January.
    13. Gao, Baojun & Li, Xiangge & Liu, Shan & Fang, Debin, 2018. "How power distance affects online hotel ratings: The positive moderating roles of hotel chain and reviewers’ travel experience," Tourism Management, Elsevier, vol. 65(C), pages 176-186.
    14. Yue Jin & Yong Tan & Jinghua Huang, 2022. "Managing contributor performance in knowledge‐sharing communities: A dynamic perspective," Production and Operations Management, Production and Operations Management Society, vol. 31(11), pages 3945-3962, November.
    15. Lin, Xiaolin & Li, Yibai & Wang, Xuequn, 2017. "Social commerce research: Definition, research themes and the trends," International Journal of Information Management, Elsevier, vol. 37(3), pages 190-201.
    16. Sheng, Jie & Amankwah-Amoah, Joseph & Wang, Xiaojun, 2019. "Technology in the 21st century: New challenges and opportunities," Technological Forecasting and Social Change, Elsevier, vol. 143(C), pages 321-335.
    17. Correa, Juan C. & Garzón, Wilmer & Brooker, Phillip & Sakarkar, Gopal & Carranza, Steven A. & Yunado, Leidy & Rincón, Alejandro, 2019. "Evaluation of collaborative consumption of food delivery services through web mining techniques," Journal of Retailing and Consumer Services, Elsevier, vol. 46(C), pages 45-50.
    18. Zhang, Ziqiong & Zhang, Zili & Yang, Yang, 2016. "The power of expert identity: How website-recognized expert reviews influence travelers' online rating behavior," Tourism Management, Elsevier, vol. 55(C), pages 15-24.
    19. Sheng, Jie, 2019. "Being Active in Online Communications: Firm Responsiveness and Customer Engagement Behaviour," Journal of Interactive Marketing, Elsevier, vol. 46(C), pages 40-51.
    20. Liang, Sai & Li, Hui & Liu, Xianwei & Schuckert, Markus, 2019. "Motivators behind information disclosure: Evidence from Airbnb hosts," Annals of Tourism Research, Elsevier, vol. 76(C), pages 305-319.
    21. Xiaoxiao Liu & Mingye Hu & Bo Sophia Xiao & Jingbo Shao, 2022. "Is my doctor around me? Investigating the impact of doctors’ presence on patients’ review behaviors on an online health platform," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(9), pages 1279-1296, September.
    22. Kawaljeet Kaur Kapoor & Kuttimani Tamilmani & Nripendra P. Rana & Pushp Patil & Yogesh K. Dwivedi & Sridhar Nerur, 2018. "Advances in Social Media Research: Past, Present and Future," Information Systems Frontiers, Springer, vol. 20(3), pages 531-558, June.
    23. Paulo B. Goes & Chenhui Guo & Mingfeng Lin, 2016. "Do Incentive Hierarchies Induce User Effort? Evidence from an Online Knowledge Exchange," Information Systems Research, INFORMS, vol. 27(3), pages 497-516, September.
    24. Dongpu Fu & Yili Hong & Kanliang Wang & Weiguo Fan, 2018. "Effects of membership tier on user content generation behaviors: evidence from online reviews," Electronic Commerce Research, Springer, vol. 18(3), pages 457-483, September.
    25. Roma, Paolo & Aloini, Davide, 2019. "How does brand-related user-generated content differ across social media? Evidence reloaded," Journal of Business Research, Elsevier, vol. 96(C), pages 322-339.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    2. Juan Feng & Xin Li & Xiaoquan (Michael) Zhang, 2019. "Online Product Reviews-Triggered Dynamic Pricing: Theory and Evidence," Information Systems Research, INFORMS, vol. 30(4), pages 1107-1123, December.
    3. King, Robert Allen & Racherla, Pradeep & Bush, Victoria D., 2014. "What We Know and Don't Know About Online Word-of-Mouth: A Review and Synthesis of the Literature," Journal of Interactive Marketing, Elsevier, vol. 28(3), pages 167-183.
    4. Natalia Levina & Manuel Arriaga, 2014. "Distinction and Status Production on User-Generated Content Platforms: Using Bourdieu’s Theory of Cultural Production to Understand Social Dynamics in Online Fields," Information Systems Research, INFORMS, vol. 25(3), pages 468-488, September.
    5. Khim-Yong Goh & Cheng-Suang Heng & Zhijie Lin, 2013. "Social Media Brand Community and Consumer Behavior: Quantifying the Relative Impact of User- and Marketer-Generated Content," Information Systems Research, INFORMS, vol. 24(1), pages 88-107, March.
    6. Young Kwark & Gene Moo Lee & Paul A. Pavlou & Liangfei Qiu, 2021. "On the Spillover Effects of Online Product Reviews on Purchases: Evidence from Clickstream Data," Information Systems Research, INFORMS, vol. 32(3), pages 895-913, September.
    7. Dongpu Fu & Yili Hong & Kanliang Wang & Weiguo Fan, 2018. "Effects of membership tier on user content generation behaviors: evidence from online reviews," Electronic Commerce Research, Springer, vol. 18(3), pages 457-483, September.
    8. Kick, Markus, 2015. "Social Media Research: A Narrative Review," EconStor Preprints 182506, ZBW - Leibniz Information Centre for Economics.
    9. Zhijie Lin & Ying Zhang & Yong Tan, 2019. "An Empirical Study of Free Product Sampling and Rating Bias," Service Science, INFORMS, vol. 30(1), pages 260-275, March.
    10. Chong (Alex) Wang & Xiaoquan (Michael) Zhang & Il-Horn Hann, 2018. "Socially Nudged: A Quasi-Experimental Study of Friends’ Social Influence in Online Product Ratings," Information Systems Research, INFORMS, vol. 29(3), pages 641-655, September.
    11. Ana Babić Rosario & Kristine Valck & Francesca Sotgiu, 2020. "Conceptualizing the electronic word-of-mouth process: What we know and need to know about eWOM creation, exposure, and evaluation," Journal of the Academy of Marketing Science, Springer, vol. 48(3), pages 422-448, May.
    12. Hailiang Chen & Prabuddha De & Yu Jeffrey Hu, 2015. "IT-Enabled Broadcasting in Social Media: An Empirical Study of Artists’ Activities and Music Sales," Information Systems Research, INFORMS, vol. 26(3), pages 513-531, September.
    13. Roma, Paolo & Aloini, Davide, 2019. "How does brand-related user-generated content differ across social media? Evidence reloaded," Journal of Business Research, Elsevier, vol. 96(C), pages 322-339.
    14. Marios Kokkodis & Theodoros Lappas, 2020. "Your Hometown Matters: Popularity-Difference Bias in Online Reputation Platforms," Information Systems Research, INFORMS, vol. 31(2), pages 412-430, June.
    15. Marchand, André & Hennig-Thurau, Thorsten & Wiertz, Caroline, 2017. "Not all digital word of mouth is created equal: Understanding the respective impact of consumer reviews and microblogs on new product success," International Journal of Research in Marketing, Elsevier, vol. 34(2), pages 336-354.
    16. Floyd, Kristopher & Freling, Ryan & Alhoqail, Saad & Cho, Hyun Young & Freling, Traci, 2014. "How Online Product Reviews Affect Retail Sales: A Meta-analysis," Journal of Retailing, Elsevier, vol. 90(2), pages 217-232.
    17. Christoph Schneider & Markus Weinmann & Peter N.C. Mohr & Jan vom Brocke, 2021. "When the Stars Shine Too Bright: The Influence of Multidimensional Ratings on Online Consumer Ratings," Management Science, INFORMS, vol. 67(6), pages 3871-3898, June.
    18. Jake Hoskins & Shyam Gopinath & J. Cameron Verhaal & Elham Yazdani, 2021. "The influence of the online community, professional critics, and location similarity on review ratings for niche and mainstream brands," Journal of the Academy of Marketing Science, Springer, vol. 49(6), pages 1065-1087, November.
    19. Mingfeng Lin & Yong Liu & Siva Viswanathan, 2018. "Effectiveness of Reputation in Contracting for Customized Production: Evidence from Online Labor Markets," Management Science, INFORMS, vol. 64(1), pages 345-359, January.
    20. Yipu Deng & Jinyang Zheng & Warut Khern-am-nuai & Karthik Kannan, 2022. "More than the Quantity: The Value of Editorial Reviews for a User-Generated Content Platform," Management Science, INFORMS, vol. 68(9), pages 6865-6888, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:25:y:2014:i:2:p:222-238. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.