IDEAS home Printed from https://ideas.repec.org/p/net/wpaper/1611.html
   My bibliography  Save this paper

Do Employers Learn from Public, Subjective, Performance Reviews?

Author

Listed:
  • Alex Wood-Doughty

    (Department of Economics, University of California, Santa Barbara, CA 93106)

Abstract

Much of the new “gig economy” relies on reputation systems to reduce problems of asymmetric information. In most cases, these reputation systems function well by soliciting unbiased feedback from buyers and sellers. However, certain features of onlinelabor markets create incentives for employers to misreport worker performance. This paper tests whether employers learn about worker productivity from public, subjective, performance reviews using data from a large online labor market. Starting with a simple model of employer learning in the presence of potentially biased reviews, I derive testable hypotheses about the relationship between public information and wages, worker attrition, and contract renewals. I find that these public reviews provide substantial information to the market and that other firms use them to learn about the productivity of workers. I also find evidence that these reviews affect how long workers stay in the labor market. Finally, using data on applications, I provide evidence of a mechanism for honest reviews. I show that workers punish firms that leave negative reviews by refusing to work for them again. Together, this body of evidence suggests that reputation systems in online labor markets provide significant information to both workers and firms and help reduce problems of asymmetric information.

Suggested Citation

  • Alex Wood-Doughty, 2016. "Do Employers Learn from Public, Subjective, Performance Reviews?," Working Papers 16-11, NET Institute.
  • Handle: RePEc:net:wpaper:1611
    as

    Download full text from publisher

    File URL: http://www.netinst.org/Wood_Doughty_16-11.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dina Mayzlin & Yaniv Dover & Judith Chevalier, 2014. "Promotional Reviews: An Empirical Investigation of Online Review Manipulation," American Economic Review, American Economic Association, vol. 104(8), pages 2421-2455, August.
    2. Ajay Agrawal & John Horton & Nicola Lacetera & Elizabeth Lyons, 2015. "Digitization and the Contract Labor Market: A Research Agenda," NBER Chapters, in: Economic Analysis of the Digital Economy, pages 219-250, National Bureau of Economic Research, Inc.
    3. Lisa B. Kahn & Fabian Lange, 2014. "Employer Learning, Productivity, and the Earnings Distribution: Evidence from Performance Measures," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(4), pages 1575-1613.
    4. Jed DeVaro & Michael Waldman, 2012. "The Signaling Role of Promotions: Further Theory and Empirical Evidence," Journal of Labor Economics, University of Chicago Press, vol. 30(1), pages 91-147.
    5. Joshua C. Pinkston, 2009. "A Model of Asymmetric Employer Learning with Testable Implications," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(1), pages 367-394.
    6. Chris Nosko & Steven Tadelis, 2015. "The Limits of Reputation in Platform Markets: An Empirical Analysis and Field Experiment," NBER Working Papers 20830, National Bureau of Economic Research, Inc.
    7. Lawrence F. Katz & Alan B. Krueger, 2016. "The Rise and Nature of Alternative Work Arrangements in the United States, 1995-2015," NBER Working Papers 22667, National Bureau of Economic Research, Inc.
    8. Michael Luca, 2016. "Designing Online Marketplaces: Trust and Reputation Mechanisms," Harvard Business School Working Papers 17-017, Harvard Business School.
    9. Apostolos Filippas & John J. Horton & Joseph M. Golden, 2019. "Reputation Inflation," NBER Working Papers 25857, National Bureau of Economic Research, Inc.
    10. Dellarocas, Chrysanthos, 2003. "The Digitization of Word-of-mouth: Promise and Challenges of Online Feedback Mechanisms," Working papers 4296-03, Massachusetts Institute of Technology (MIT), Sloan School of Management.
    11. Roy Mill, 2011. "Hiring and Learning in Online Global Labor Markets," Working Papers 11-17, NET Institute, revised Oct 2011.
    12. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    13. Cragg, John G, 1971. "Some Statistical Models for Limited Dependent Variables with Application to the Demand for Durable Goods," Econometrica, Econometric Society, vol. 39(5), pages 829-844, September.
    14. Yubo Chen & Jinhong Xie, 2008. "Online Consumer Review: Word-of-Mouth as a New Element of Marketing Communication Mix," Management Science, INFORMS, vol. 54(3), pages 477-491, March.
    15. Michael Luca, 2016. "Designing Online Marketplaces: Trust and Reputation Mechanisms," NBER Chapters, in: Innovation Policy and the Economy, Volume 17, pages 77-93, National Bureau of Economic Research, Inc.
    16. Michael Luca & Georgios Zervas, 2013. "Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud," Harvard Business School Working Papers 14-006, Harvard Business School, revised May 2015.
    17. Michael Luca, 2016. "Designing Online Marketplaces: Trust and Reputation Mechanisms," NBER Working Papers 22616, National Bureau of Economic Research, Inc.
    18. Steven Tadelis, 2016. "Reputation and Feedback Systems in Online Platform Markets," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 321-340, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lingfang (Ivy) Li & Steven Tadelis & Xiaolan Zhou, 2020. "Buying reputation as a signal of quality: Evidence from an online marketplace," RAND Journal of Economics, RAND Corporation, vol. 51(4), pages 965-988, December.
    2. Marcello Basili & Maria Alessandra Rossi, 2018. "Platform-mediated reputation systems in the sharing economy and incentives to provide service quality: the case of ridesharing services," Department of Economics University of Siena 787, Department of Economics, University of Siena.
    3. Hui, Xiang & Klein, Tobias & Stahl, Konrad, 2022. "Learning from Online Ratings," CEPR Discussion Papers 17006, C.E.P.R. Discussion Papers.
    4. Gesche, Tobias, 2018. "Reference Price Shifts and Customer Antagonism: Evidence from Reviews for Online Auctions," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181650, Verein für Socialpolitik / German Economic Association.
    5. Apostolos Filippas & John Horton & Joseph M. Golden, 2017. "Reputation in the Long-Run," CESifo Working Paper Series 6750, CESifo.
    6. Peitz, Martin & Schwalbe, Ulrich, 2016. "Zwischen Sozialromantik und Neoliberalismus: Zur Ökonomie der Sharing-Economy," ZEW Discussion Papers 16-033, ZEW - Leibniz Centre for European Economic Research.
    7. Andreas J. Steur & Mischa Seiter, 2021. "Properties of feedback mechanisms on digital platforms: an exploratory study," Journal of Business Economics, Springer, vol. 91(4), pages 479-526, May.
    8. Kornberger, Martin & Pflueger, Dane & Mouritsen, Jan, 2017. "Evaluative infrastructures: Accounting for platform organization," Accounting, Organizations and Society, Elsevier, vol. 60(C), pages 79-95.
    9. Elina Ishmukhametova & Marina Sandomirskaia, 2023. "The Problem Of Reputation Reliability In Online Freelance Markets," HSE Working papers WP BRP 260/EC/2023, National Research University Higher School of Economics.
    10. Greiff, Matthias & Paetzel, Fabian, 2020. "Information about average evaluations spurs cooperation: An experiment on noisy reputation systems," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 334-356.
    11. Apostolos Filippas & John J. Horton & Joseph M. Golden, 2019. "Reputation Inflation," NBER Working Papers 25857, National Bureau of Economic Research, Inc.
    12. Cristiano Codagnone & Fabienne Abadie & Federico Biagi, 2016. "The Future of Work in the ‘Sharing Economy’. Market Efficiency and Equitable Opportunities or Unfair Precarisation?," JRC Research Reports JRC101280, Joint Research Centre.
    13. M. Narciso, 2022. "The Unreliability of Online Review Mechanisms," Journal of Consumer Policy, Springer, vol. 45(3), pages 349-368, September.
    14. Catherine Haeck & Frank Verboven, 2012. "The Internal Economics of a University: Evidence from Personnel Data," Journal of Labor Economics, University of Chicago Press, vol. 30(3), pages 591-626.
    15. Apostolos Filippas & John J. Horton & Joseph M. Golden, 2022. "Reputation Inflation," Marketing Science, INFORMS, vol. 41(4), pages 733-745, July.
    16. Alan Benson & Aaron Sojourner & Akhmed Umyarov, 2020. "Can Reputation Discipline the Gig Economy? Experimental Evidence from an Online Labor Market," Management Science, INFORMS, vol. 66(5), pages 1802-1825, May.
    17. Lisa B. Kahn, 2013. "Asymmetric Information between Employers," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 165-205, October.
    18. Martin Lukac & André Grow, 2021. "Reputation systems and recruitment in online labor markets: insights from an agent-based model," Journal of Computational Social Science, Springer, vol. 4(1), pages 207-229, May.
    19. Krügel, Jan Philipp & Paetzel, Fabian, 2024. "The impact of fraud on reputation systems," Games and Economic Behavior, Elsevier, vol. 144(C), pages 329-354.
    20. Yan Chen & Peter Cramton & John A. List & Axel Ockenfels, 2021. "Market Design, Human Behavior, and Management," Management Science, INFORMS, vol. 67(9), pages 5317-5348, September.

    More about this item

    Keywords

    online labor markets; reputation systems; employer learning;
    All these keywords.

    JEL classification:

    • D82 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Asymmetric and Private Information; Mechanism Design
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • J31 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Wage Level and Structure; Wage Differentials
    • J49 - Labor and Demographic Economics - - Particular Labor Markets - - - Other

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:net:wpaper:1611. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Nicholas Economides (email available below). General contact details of provider: http://www.NETinst.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.