IDEAS home Printed from https://ideas.repec.org/a/bla/joares/v59y2021i5p1573-1607.html
   My bibliography  Save this article

Forced Rating Systems from Employee and Supervisor Perspectives

Author

Listed:
  • EDDY CARDINAELS
  • CHRISTOPH FEICHTER

Abstract

Many firms use forced rating systems in which supervisors must evaluate employees according to a predefined distribution. We develop new theory suggesting that forced ratings are less likely to enhance performance when supervisors assess subjective dimensions of employee performance (e.g., creativity), but can have some harmful side effects. In a laboratory experiment, employees work on a creative task, and supervisors rate their performance. We do not find any difference in the employees’ performance or effort in a creative task setting between forced and free ratings. We do, however, find that forced ratings create higher stress for employees (ex post stress scales and biomarkers). Higher stress in turn mitigates the positive effect of effort on creativity. Furthermore, we find that actual creativity explains less of supervisors’ ratings of employees’ performance under forced ratings. Instead, factors that are unrelated to actual creativity, such as eloquent writing and strategic gaming behavior, matter more. Results of an additional online experiment confirm that forced ratings work differently in tasks where performance needs to be evaluated subjectively compared to tasks where objective measures are available.

Suggested Citation

  • Eddy Cardinaels & Christoph Feichter, 2021. "Forced Rating Systems from Employee and Supervisor Perspectives," Journal of Accounting Research, Wiley Blackwell, vol. 59(5), pages 1573-1607, December.
  • Handle: RePEc:bla:joares:v:59:y:2021:i:5:p:1573-1607
    DOI: 10.1111/1475-679X.12388
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/1475-679X.12388
    Download Restriction: no

    File URL: https://libkey.io/10.1111/1475-679X.12388?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lazear, Edward P & Rosen, Sherwin, 1981. "Rank-Order Tournaments as Optimum Labor Contracts," Journal of Political Economy, University of Chicago Press, vol. 89(5), pages 841-864, October.
    2. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    3. Canice Prendergast, 1999. "The Provision of Incentives in Firms," Journal of Economic Literature, American Economic Association, vol. 37(1), pages 7-63, March.
    4. Steven J. Kachelmeier & Bernhard E. Reichert & Michael G. Williamson, 2008. "Measuring and Motivating Quantity, Creativity, or Both," Journal of Accounting Research, Wiley Blackwell, vol. 46(2), pages 341-373, May.
    5. Kristina Rennekamp, 2012. "Processing Fluency and Investors’ Reactions to Disclosure Readability," Journal of Accounting Research, Wiley Blackwell, vol. 50(5), pages 1319-1354, December.
    6. Niamh Brennan & Encarna Guillamon-Saorin & Aileen Pierce, 2009. "Impression management : developing and illustrating a scheme of analysis for narrative disclosures – a methodological note," Open Access publications 10197/2905, Research Repository, University College Dublin.
    7. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    8. Hans K. Hvide, 2002. "Tournament Rewards and Risk Taking," Journal of Labor Economics, University of Chicago Press, vol. 20(4), pages 877-898, October.
    9. Kampkötter, Patrick & Sliwka, Dirk, 2011. "Differentiation and Performance: An Empirical Investigation on the Incentive Effects of Bonus Plans," IZA Discussion Papers 6070, Institute of Labor Economics (IZA).
    10. Borodin A. D., 2016. "World experience of state influence on the economy," Visnyk of National University of Civil Protection of Ukraine. Public Administration series., National University of Civil Protection of Ukraine, vol. 4(1), pages 37-43, January.
    11. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    12. Doris M. Merkl-Davies & Niamh Brennan, 2007. "Discretionary disclosure strategies in corporate narratives : incremental information or impression management?," Open Access publications 10197/2907, Research Repository, University College Dublin.
    13. Johannes Berger & Christine Harbring & Dirk Sliwka, 2013. "Performance Appraisals and the Impact of Forced Distribution--An Experimental Investigation," Management Science, INFORMS, vol. 59(1), pages 54-68, June.
    14. Johannes Abeler & Steffen Altmann & Sebastian Kube & Matthias Wibral, 2010. "Gift Exchange and Workers' Fairness Concerns: When Equality is Unfair," Journal of the European Economic Association, MIT Press, vol. 8(6), pages 1299-1324, December.
    15. Sanjiv Erat & Uri Gneezy, 2017. "Erratum to: Incentives for creativity," Experimental Economics, Springer;Economic Science Association, vol. 20(1), pages 274-275, March.
    16. Niamh M. Brennan & Encarna Guillamon‐Saorin & Aileen Pierce, 2009. "Methodological Insights," Accounting, Auditing & Accountability Journal, Emerald Group Publishing Limited, vol. 22(5), pages 789-832, June.
    17. Paul J. Zak & Amos Nadler, 2010. "Using Brains to Create Trust: A Manager’s Toolbox," Chapters, in: Angela A. Stanton & Mellani Day & Isabell M. Welpe (ed.), Neuroeconomics and the Firm, chapter 4, Edward Elgar Publishing.
    18. Dennis Campbell, 2012. "Employee Selection as a Control System," Journal of Accounting Research, Wiley Blackwell, vol. 50(4), pages 931-966, September.
    19. Stewart, Susan M & Gruys, Melissa L & Storm, Maria, 2010. "Forced distribution performance evaluation systems: Advantages, disadvantages and keys to implementation," Journal of Management & Organization, Cambridge University Press, vol. 16(1), pages 168-179, March.
    20. Bol, Jasmijn C. & Kramer, Stephan & Maas, Victor S., 2016. "How control system design affects performance evaluation compression: The role of information accuracy and outcome transparency," Accounting, Organizations and Society, Elsevier, vol. 51(C), pages 64-73.
    21. Moers, Frank, 2005. "Discretion and bias in performance evaluation: the impact of diversity and subjectivity," Accounting, Organizations and Society, Elsevier, vol. 30(1), pages 67-80, January.
    22. Christine Harbring & Bernd Irlenbusch & Matthias Krakel & Reinhard Selten, 2007. "Sabotage in Corporate Contests - An Experimental Analysis," International Journal of the Economics of Business, Taylor & Francis Journals, vol. 14(3), pages 367-392.
    23. Kenneth Benoit & Kevin Munger & Arthur Spirling, 2019. "Measuring and Explaining Political Sophistication through Textual Complexity," American Journal of Political Science, John Wiley & Sons, vol. 63(2), pages 491-508, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Choi, Bong-Geun & Choi, Jung Ho & Malik, Sara, 2023. "Not just for investors: The role of earnings announcements in guiding job seekers," Journal of Accounting and Economics, Elsevier, vol. 76(1).
    2. Wang, Laura W. & Yin, Huaxiang, 2023. "The effects of emotion-understanding ability and tournament incentives on supervisors’ propensity to acquire subordinate-type information to use in control decisions," Accounting, Organizations and Society, Elsevier, vol. 107(C).
    3. Eric Floyd & Michael Hallsworth & John List & Robert Metcalfe & Kristian Rotaru & Ivo Vlaev, 2022. "What motivates people to pay their taxes? Evidence from four experiments on tax compliance," Natural Field Experiments 00750, The Field Experiments Website.
    4. Cardinaels, Eddy & Feichter, Christoph, 2023. "Forced Ranking: Fluch oder Segen?," Other publications TiSEM fbf9daf8-8658-4307-a733-c, Tilburg University, School of Economics and Management.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Johannes Berger & Christine Harbring & Dirk Sliwka, 2013. "Performance Appraisals and the Impact of Forced Distribution--An Experimental Investigation," Management Science, INFORMS, vol. 59(1), pages 54-68, June.
    2. Drago, Carlo & Ginesti, Gianluca & Pongelli, Claudia & Sciascia, Salvatore, 2018. "Reporting strategies: What makes family firms beat around the bush? Family-related antecedents of annual report readability," Journal of Family Business Strategy, Elsevier, vol. 9(2), pages 142-150.
    3. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    4. Irene Trapp & Rouven Trapp, 2019. "The psychological effects of centrality bias: an experimental analysis," Journal of Business Economics, Springer, vol. 89(2), pages 155-189, March.
    5. Christoph Feichter & Isabella Grabner, 2020. "Empirische Forschung zu Management Control – Ein Überblick und neue Trends [Empirical Management Control Reserach—An Overview and Future Directions]," Schmalenbach Journal of Business Research, Springer, vol. 72(2), pages 149-181, June.
    6. Loberg, Linda & Nüesch, Stephan & Foege, Johann Nils, 2021. "Forced distribution rating systems and team collaboration," Journal of Economic Behavior & Organization, Elsevier, vol. 188(C), pages 18-35.
    7. Bradler, Christiane & Neckermann, Susanne & Warnke, Arne Jonas, 2016. "Incentivizing creativity: A large-scale experiment with tournaments and gifts," ZEW Discussion Papers 16-040, ZEW - Leibniz Centre for European Economic Research.
    8. Emmanuel Dechenaux & Dan Kovenock & Roman Sheremeta, 2015. "A survey of experimental research on contests, all-pay auctions and tournaments," Experimental Economics, Springer;Economic Science Association, vol. 18(4), pages 609-669, December.
    9. Simon Gächter & Lingbo Huang & Martin Sefton, 2016. "Combining “real effort” with induced effort costs: the ball-catching task," Experimental Economics, Springer;Economic Science Association, vol. 19(4), pages 687-712, December.
    10. Maria-Silvia Sandulescu, 2017. "Impression management – an international perspective," The Audit Financiar journal, Chamber of Financial Auditors of Romania, vol. 15(148), pages 605-605.
    11. Marco Kleine & Sebastian Kube, 2015. "Communication and Trust in Principal-Team Relationships: Experimental Evidence," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2015_06, Max Planck Institute for Research on Collective Goods.
    12. Leung, Sidney & Parker, Lee & Courtis, John, 2015. "Impression management through minimal narrative disclosure in annual reports," The British Accounting Review, Elsevier, vol. 47(3), pages 275-289.
    13. Yifei Huang & Matt Shum & Xi Wu & Jason Zezhong Xiao, 2019. "Discovery of Bias and Strategic Behavior in Crowdsourced Performance Assessment," Papers 1908.01718, arXiv.org, revised Oct 2019.
    14. Tiffany Cheng-Han Leung & Robin Stanley Snell, 2021. "Strategies for Social and Environmental Disclosure: The Case of Multinational Gambling Companies," Journal of Business Ethics, Springer, vol. 168(3), pages 447-467, January.
    15. Kampkötter, Patrick & Sliwka, Dirk, 2011. "Differentiation and Performance: An Empirical Investigation on the Incentive Effects of Bonus Plans," IZA Discussion Papers 6070, Institute of Labor Economics (IZA).
    16. Do, Truc & Zhang, Huai & Zuo, Luo, 2022. "Rocking the boat: How relative performance evaluation affects corporate risk taking," Journal of Accounting and Economics, Elsevier, vol. 73(1).
    17. Fochmann, Martin & Sachs, Florian & Weimann, Joachim, 2019. "Managing wages: Fairness norms of low- and high-performing team members," arqus Discussion Papers in Quantitative Tax Research 238, arqus - Arbeitskreis Quantitative Steuerlehre.
    18. Letina, Igor & Liu, Shuo & Netzer, Nick, 2020. "Delegating performance evaluation," Theoretical Economics, Econometric Society, vol. 15(2), May.
    19. Ozbeklik, Serkan & Smith, Janet Kiholm, 2017. "Risk taking in competition: Evidence from match play golf tournaments," Journal of Corporate Finance, Elsevier, vol. 44(C), pages 506-523.
    20. Dunne, Neil J. & Brennan, Niamh M. & Kirwan, Collette E., 2021. "Impression management and Big Four auditors: Scrutiny at a public inquiry," Accounting, Organizations and Society, Elsevier, vol. 88(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:joares:v:59:y:2021:i:5:p:1573-1607. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0021-8456 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.