IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v54y2008i3p460-476.html
   My bibliography  Save this article

The Sound of Silence in Online Feedback: Estimating Trading Risks in the Presence of Reporting Bias

Author

Listed:
  • Chrysanthos Dellarocas

    (R. H. Smith School of Business, University of Maryland, College Park, Maryland 20742)

  • Charles A. Wood

    (Mendoza College of Business, University of Notre Dame, Notre Dame, Indiana 46556)

Abstract

Most online feedback mechanisms rely on voluntary reporting of privately observed outcomes. This introduces the potential for reporting bias, a situation where traders exhibit different propensities to report different outcome types to the system. Unless properly accounted for, reporting bias may severely distort the distribution of public feedback relative to the underlying distribution of private transaction outcomes and, thus, hamper the reliability of feedback mechanisms. This study offers a method that allows users of feedback mechanisms where both partners of a bilateral exchange are allowed to report their satisfaction to "see through" the distortions introduced by reporting bias and derive unbiased estimates of the underlying distribution of privately observed outcomes. A key aspect of our method lies in extracting information from the number of transactions where one or both trading partners choose to remain silent. We apply our method to a large data set of eBay feedback. Our results support the widespread belief that eBay traders are more likely to post feedback when satisfied than when dissatisfied and are consistent with the presence of positive and negative reciprocation among eBay traders. Most importantly, our analysis derives unbiased estimates of the risks that are associated with trading on eBay that, we believe, are more realistic than those suggested by a naïve interpretation of the unusually high (>99%) levels of positive feedback currently found on that system.

Suggested Citation

  • Chrysanthos Dellarocas & Charles A. Wood, 2008. "The Sound of Silence in Online Feedback: Estimating Trading Risks in the Presence of Reporting Bias," Management Science, INFORMS, vol. 54(3), pages 460-476, March.
    • Handle: RePEc:inm:ormnsc:v:54:y:2008:i:3:p:460-476
    DOI: 10.1287/mnsc.1070.0747
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.1070.0747
    Download Restriction: no
    File URL: https://libkey.io/10.1287/mnsc.1070.0747?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ernst Fehr & Simon Gächter, 2000. "Fairness and Retaliation: The Economics of Reciprocity," Journal of Economic Perspectives, American Economic Association, vol. 14(3), pages 159-181, Summer.
    2. Patrick Bajari & Ali Hortaçsu, 2004. "Economic Insights from Internet Auctions," Journal of Economic Literature, American Economic Association, vol. 42(2), pages 457-486, June.
    3. Bowden, Roger J, 1973. "The Theory of Parametric Identification," Econometrica, Econometric Society, vol. 41(6), pages 1069-1074, November.
    4. Paul Resnick & Richard Zeckhauser & John Swanson & Kate Lockwood, 2006. "The value of reputation on eBay: A controlled experiment," Experimental Economics, Springer;Economic Science Association, vol. 9(2), pages 79-101, June.
    5. Rothenberg, Thomas J, 1971. "Identification in Parametric Models," Econometrica, Econometric Society, vol. 39(3), pages 577-591, May.
    6. Chrysanthos Dellarocas, 2003. "The Digitization of Word of Mouth: Promise and Challenges of Online Feedback Mechanisms," Management Science, INFORMS, vol. 49(10), pages 1407-1424, October.
    7. Klein, T.J. & Lambertz, C. & Spagnolo, G. & Stahl, K.O., 2006. "Last minute feedback," Other publications TiSEM 10afaa8e-ec7f-4269-9535-a, Tilburg University, School of Economics and Management.
    8. Chrysanthos Dellarocas, 2005. "Reputation Mechanism Design in Online Trading Environments with Pure Moral Hazard," Information Systems Research, INFORMS, vol. 16(2), pages 209-230, June.
    9. Dellarocas, Chrysanthos, 2003. "The Digitization of Word-of-mouth: Promise and Challenges of Online Feedback Mechanisms," Working papers 4296-03, Massachusetts Institute of Technology (MIT), Sloan School of Management.
    10. Ernst Fehr & Simon Gächter, 2000. "Fairness and Retaliation," International Economic Association Series, in: L.-A. Gérard-Varet & S.-C. Kolm & J. Mercier Ythier (ed.), The Economics of Reciprocity, Giving and Altruism, chapter 7, pages 153-173, Palgrave Macmillan.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Lingfang (Ivy) & Xiao, Erte, 2010. "Money Talks? An Experimental Study of Rebate in Reputation System Design," MPRA Paper 22401, University Library of Munich, Germany.
    2. Judy E. Scott & Dawn G. Gregg & Jae Hoon Choi, 2015. "Lemon complaints: When online auctions go sour," Information Systems Frontiers, Springer, vol. 17(1), pages 177-191, February.
    3. Przepiorka, Wojtek, 2014. "Reputation in offline and online markets: Solutions to trust problems in social and economic exchange," economic sociology. perspectives and conversations, Max Planck Institute for the Study of Societies, vol. 16(1), pages 4-10.
    4. Sarah C. Rice, 2012. "Reputation and Uncertainty in Online Markets: An Experimental Study," Information Systems Research, INFORMS, vol. 23(2), pages 436-452, June.
    5. Jolivet, Grégory & Jullien, Bruno & Postel-Vinay, Fabien, 2016. "Reputation and prices on the e-market: Evidence from a major French platform," International Journal of Industrial Organization, Elsevier, vol. 45(C), pages 59-75.
    6. Gary E. Bolton & David J. Kusterer & Johannes Mans, 2015. "Inflated reputations: Uncertainty, leniency & moral wiggle room in trader feedback systems," Cologne Graduate School Working Paper Series 06-04, Cologne Graduate School in Management, Economics and Social Sciences, revised 29 Jul 2016.
    7. David Masclet & Thierry Pénard, 2008. "Is the ebay feedback system really efficient ? an experimental study," Economics Working Paper Archive (University of Rennes & University of Caen) 200803, Center for Research in Economics and Management (CREM), University of Rennes, University of Caen and CNRS.
    8. Paul A. Pavlou & Angelika Dimoka, 2006. "The Nature and Role of Feedback Text Comments in Online Marketplaces: Implications for Trust Building, Price Premiums, and Seller Differentiation," Information Systems Research, INFORMS, vol. 17(4), pages 392-414, December.
    9. Krügel, Jan Philipp & Paetzel, Fabian, 2024. "The impact of fraud on reputation systems," Games and Economic Behavior, Elsevier, vol. 144(C), pages 329-354.
    10. Luís Cabral & Lingfang (Ivy) Li, 2015. "A Dollar for Your Thoughts: Feedback-Conditional Rebates on eBay," Management Science, INFORMS, vol. 61(9), pages 2052-2063, September.
    11. Lumeau, Marianne & Masclet, David & Penard, Thierry, 2015. "Reputation and social (dis)approval in feedback mechanisms: An experimental study," Journal of Economic Behavior & Organization, Elsevier, vol. 112(C), pages 127-140.
    12. Onur, Ilke & Velamuri, Malathi, 2014. "Competition, endogeneity and the winning bid: An empirical analysis of eBay auctions," Information Economics and Policy, Elsevier, vol. 26(C), pages 68-74.
    13. Anya Samek, 2012. "An Experimental Study of Reputation with Heterogeneous Goods," Artefactual Field Experiments 00439, The Field Experiments Website.
    14. Fan, Ying & Ju, Jiandong & Xiao, Mo, 2016. "Reputation premium and reputation management: Evidence from the largest e-commerce platform in China," International Journal of Industrial Organization, Elsevier, vol. 46(C), pages 63-76.
    15. José Canals-Cerdá, 2012. "The value of a good reputation online: an application to art auctions," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 36(1), pages 67-85, February.
    16. Matthias Wibral, 2015. "Identity changes and the efficiency of reputation systems," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 408-431, September.
    17. Hui, Xiang & Klein, Tobias & Stahl, Konrad, 2022. "Learning from Online Ratings," CEPR Discussion Papers 17006, C.E.P.R. Discussion Papers.
    18. Tobias Gesche, 2022. "Reference‐price shifts and customer antagonism: Evidence from reviews for online auctions," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 31(3), pages 558-578, August.
    19. Britta Hoyer & Dirk van Straaten, 2021. "Anonymity and Self-Expression in Online Rating Systems - An Experimental Analysis," Working Papers Dissertations 70, Paderborn University, Faculty of Business Administration and Economics.
    20. W. Bentley MacLeod, 2006. "Reputations, Relationships and the Enforcement of Incomplete Contracts," CESifo Working Paper Series 1730, CESifo.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:54:y:2008:i:3:p:460-476. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.