IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp9285.html
   My bibliography  Save this paper

The Complementary Use of Experiments and Field Data to Evaluate Management Practices: The Case of Subjective Performance Evaluations

Author

Listed:
  • Kampkötter, Patrick

    (University of Tübingen)

  • Sliwka, Dirk

    (University of Cologne)

Abstract

Most firms rely on subjective evaluations by supervisors to assess their employees' performance. This article discusses the implementation of such appraisal processes, exploring the use of multiple research methods such as the analysis of personnel records, survey data, and lab and field experiments to study them in detail. We argue that the complementary use of these methods helps to build a better understanding of how subjective evaluations are conducted and appraisal systems should be designed.

Suggested Citation

  • Kampkötter, Patrick & Sliwka, Dirk, 2015. "The Complementary Use of Experiments and Field Data to Evaluate Management Practices: The Case of Subjective Performance Evaluations," IZA Discussion Papers 9285, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp9285
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp9285.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Sandra E. Black & Lisa M. Lynch, 2004. "What's driving the new economy?: the benefits of workplace innovation," Economic Journal, Royal Economic Society, vol. 114(493), pages 97-116, February.
    2. Thomas J. Dohmen & Ben Kriechel & Gerard A. Pfann, 2004. "Monkey bars and ladders: The importance of lateral and vertical job mobility in internal labor market careers," Journal of Population Economics, Springer;European Society for Population Economics, vol. 17(2), pages 193-228, June.
    3. Nicholas Bloom & John Van Reenen, 2007. "Measuring and Explaining Management Practices Across Firms and Countries," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(4), pages 1351-1408.
    4. Guido Friebel & Matthias Heinz & Miriam Krueger & Nikolay Zubanov, 2017. "Team Incentives and Performance: Evidence from a Retail Chain," American Economic Review, American Economic Association, vol. 107(8), pages 2168-2203, August.
    5. repec:iab:iabfme:201505(en is not listed on IDEAS
    6. Botond Kőszegi & Matthew Rabin, 2006. "A Model of Reference-Dependent Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 121(4), pages 1133-1165.
    7. Bolton, Gary E, 1991. "A Comparative Model of Bargaining: Theory and Evidence," American Economic Review, American Economic Association, vol. 81(5), pages 1096-1136, December.
    8. Abbink, Klaus & Sadrieh, Abdolkarim, 2009. "The pleasure of being nasty," Economics Letters, Elsevier, vol. 105(3), pages 306-308, December.
    9. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    10. Tanjim Hossain & John A. List, 2012. "The Behavioralist Visits the Factory: Increasing Productivity Using Simple Framing Manipulations," Management Science, INFORMS, vol. 58(12), pages 2151-2167, December.
    11. Giebe, Thomas & Gürtler, Oliver, 2012. "Optimal contracts for lenient supervisors," Journal of Economic Behavior & Organization, Elsevier, vol. 81(2), pages 403-420.
    12. Josse Delfgaauw & Robert Dur & Joeri Sol & Willem Verbeke, 2013. "Tournament Incentives in the Field: Gender Differences in the Workplace," Journal of Labor Economics, University of Chicago Press, vol. 31(2), pages 305-326.
    13. Nicholas Bloom & Christos Genakos & Raffaella Sadun & John Van Reenen, 2011. "Management Practices Across Firms and Countries," CEP Discussion Papers dp1109, Centre for Economic Performance, LSE.
    14. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    15. Bloom, Nicholas & Van Reenen, John, 2011. "Human Resource Management and Productivity," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 19, pages 1697-1767, Elsevier.
    16. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2011. "Field Experiments with Firms," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 63-82, Summer.
    17. Broszeit, Sandra & Wolter, Stefanie, 2015. "LPP - Linked Personnel Panel : quality of work and economic success: longitudinal study in German establishments (data documentation on the first wave)," FDZ Datenreport. Documentation on Labour Market Data 201501_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    18. Alexander Sebald & Markus Walzl, 2014. "Subjective Performance Evaluations and Reciprocity in Principal–Agent Relations," Scandinavian Journal of Economics, Wiley Blackwell, vol. 116(2), pages 570-590, April.
    19. Nicholas Bloom & John Van Reenen, 2010. "Why Do Management Practices Differ across Firms and Countries?," Journal of Economic Perspectives, American Economic Association, vol. 24(1), pages 203-224, Winter.
    20. Casey Ichniowski & Kathryn Shaw, 2004. "Using "Insider Econometrics" to Study Productivity," American Economic Review, American Economic Association, vol. 94(2), pages 217-223, May.
    21. Armin Falk & James J. Heckman, 2009. "Lab Experiments are a Major Source of Knowledge in the Social Sciences," CESifo Working Paper Series 2894, CESifo.
    22. David E. Bell, 1985. "Disappointment in Decision Making Under Uncertainty," Operations Research, INFORMS, vol. 33(1), pages 1-27, February.
    23. Takahashi, Shingo & Owan, Hideo & Tsuru, Tsuyoshi & Uehara, Katsuhito, 2014. "Multitasking Incentives and Biases in Subjective Performance Evaluation," Discussion Paper Series 614, Institute of Economic Research, Hitotsubashi University.
    24. Frederiksen, Anders & Lange, Fabian & Kriechel, Ben, 2017. "Subjective performance evaluations and employee careers," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 408-429.
    25. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    26. Christian Grund & Judith Przemeck, 2012. "Subjective performance appraisal and inequality aversion," Applied Economics, Taylor & Francis Journals, vol. 44(17), pages 2149-2155, June.
    27. Ernst Fehr & Georg Kirchsteiger & Arno Riedl, 1993. "Does Fairness Prevent Market Clearing? An Experimental Investigation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(2), pages 437-459.
    28. Ernst Fehr & Simon Gachter & Georg Kirchsteiger, 1997. "Reciprocity as a Contract Enforcement Device: Experimental Evidence," Econometrica, Econometric Society, vol. 65(4), pages 833-860, July.
    29. Axel Ockenfels & Dirk Sliwka & Peter Werner, 2015. "Bonus Payments and Reference Point Violations," Management Science, INFORMS, vol. 61(7), pages 1496-1513, July.
    30. George Baker & Michael Gibbs & Bengt Holmstrom, 1994. "The Wage Policy of a Firm," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 109(4), pages 921-955.
    31. Bellmann, Lutz & Bender, Stefan & Bossler, Mario & Broszeit, Sandra & Dickmann, Christian & Gensicke, Miriam & Gilberg, Reiner & Grunau, Philipp & Kampkötter, Patrick & Laske, Katharina & Mohrenweiser, 2015. "LPP - Linked Personnel Panel : quality of work and economic success: longitudinal study in German establishments (data collection on the first wave)," FDZ Methodenreport 201505_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    32. Halse, Nikolaj & Smeets, Valérie & Warzynski, Frédèric, 2011. "International Differences in Subjective Performance Evaluation,Compensation and Career Dynamics in a Global Company," Working Papers 11-15, University of Aarhus, Aarhus School of Business, Department of Economics.
    33. repec:adr:anecst:y:2001:i:63-64:p:03 is not listed on IDEAS
    34. Prendergast, Canice & Topel, Robert H, 1996. "Favoritism in Organizations," Journal of Political Economy, University of Chicago Press, vol. 104(5), pages 958-978, October.
    35. Moers, Frank, 2005. "Discretion and bias in performance evaluation: the impact of diversity and subjectivity," Accounting, Organizations and Society, Elsevier, vol. 30(1), pages 67-80, January.
    36. Sunde, Uwe & Roider, Andreas & Englmaier, Florian, 2012. "The Role of Salience in Performance Schemes: Evidence from a Field Experiment," CEPR Discussion Papers 8921, C.E.P.R. Discussion Papers.
    37. Flabbi, Luca & Ichino, Andrea, 2001. "Productivity, seniority and wages: new evidence from personnel data," Labour Economics, Elsevier, vol. 8(3), pages 359-387, June.
    38. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    39. Graham Loomes & Robert Sugden, 1986. "Disappointment and Dynamic Consistency in Choice under Uncertainty," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(2), pages 271-282.
    40. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    41. Canice Prendergast, 1999. "The Provision of Incentives in Firms," Journal of Economic Literature, American Economic Association, vol. 37(1), pages 7-63, March.
    42. Axel Ockenfels & Gary E. Bolton, 2000. "ERC: A Theory of Equity, Reciprocity, and Competition," American Economic Review, American Economic Association, vol. 90(1), pages 166-193, March.
    43. Johannes Berger & Christine Harbring & Dirk Sliwka, 2013. "Performance Appraisals and the Impact of Forced Distribution--An Experimental Investigation," Management Science, INFORMS, vol. 59(1), pages 54-68, June.
    44. Breuer, Kathrin & Nieken, Petra & Sliwka, Dirk, 2010. "Social Ties and Subjective Performance Evaluations: An Empirical Investigation," IZA Discussion Papers 4913, Institute of Labor Economics (IZA).
    45. Fehr, Ernst & Schmidt, Klaus M., 2006. "The Economics of Fairness, Reciprocity and Altruism - Experimental Evidence and New Theories," Handbook on the Economics of Giving, Reciprocity and Altruism, in: S. Kolm & Jean Mercier Ythier (ed.), Handbook of the Economics of Giving, Altruism and Reciprocity, edition 1, volume 1, chapter 8, pages 615-691, Elsevier.
    46. Daniel J. Zizzo & Andrew J. Oswald, 2001. "Are People Willing to Pay to Reduce Others'Incomes?," Annals of Economics and Statistics, GENES, issue 63-64, pages 39-65.
    47. Axel Engellandt & Regina T. Riphahn, 2011. "Evidence on Incentive Effects of Subjective Performance Evaluations," ILR Review, Cornell University, ILR School, vol. 64(2), pages 241-257, January.
    48. Florian Englmaier & Katharina Schüßler, 2015. "Complementarities of HRM Practices - A Case for Employing Multiple Methods and Integrating Multiple Fields," CESifo Working Paper Series 5249, CESifo.
    49. repec:pri:rpdevs:deaton_instruments_randomization_learning_all_04april_2010 is not listed on IDEAS
    50. Bellemare, Charles & Shearer, Bruce, 2009. "Gift giving and worker productivity: Evidence from a firm-level experiment," Games and Economic Behavior, Elsevier, vol. 67(1), pages 233-244, September.
    51. George Baker & Michael Gibbs & Bengt Holmstrom, 1994. "The Internal Economics of the Firm: Evidence from Personnel Data," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 109(4), pages 881-919.
    52. Prendergast, Canice & Topel, Robert, 1993. "Discretion and bias in performance evaluation," European Economic Review, Elsevier, vol. 37(2-3), pages 355-365, April.
    53. repec:iab:iabfda:201501(en is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Matthias Fahn, 2019. "Reciprocity in dynamic employment relationships," CESifo Working Paper Series 7634, CESifo.
    2. Brändle, Tobias & Grunau, Philipp & Haylock, Michael & Kampkötter, Patrick, 2020. "Recruitment strategies and match quality - New evidence from representative linked employer-employee data," University of Tübingen Working Papers in Business and Economics 134, University of Tuebingen, Faculty of Economics and Social Sciences, School of Business and Economics.
    3. Uwe Jirjahn & Jens Mohrenweiser, 2019. "Performance Pay and Applicant Screening," British Journal of Industrial Relations, London School of Economics, vol. 57(3), pages 540-575, September.
    4. Englmaier, Florian & Schüßler, Katharina, 2015. "Complementarities of HRM Practices," Discussion Paper Series of SFB/TR 15 Governance and the Efficiency of Economic Systems 503, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich.
    5. Florian Englmaier & Katharina Schüßler, 2015. "Complementarities of HRM Practices - A Case for Employing Multiple Methods and Integrating Multiple Fields," CESifo Working Paper Series 5249, CESifo.
    6. Matthias Fahn & Giorgio Zanarone, 2021. "Pay Transparency Under Subjective Performance Evaluation," CESifo Working Paper Series 8849, CESifo.
    7. Florian Englmaier & Guido Friebel & Gerd Muehlheusser & Andreas Roider, 2016. "Symposium on Evidence-Based Management," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 172(2), pages 305-311, June.
    8. Enzo Brox & Michael Lechner, 2024. "Teamwork and Spillover Effects in Performance Evaluations," Papers 2403.15200, arXiv.org.
    9. Frederiksen, Anders & Lange, Fabian & Kriechel, Ben, 2017. "Subjective performance evaluations and employee careers," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 408-429.
    10. Alexander Ahammer & Matthias Fahn & Flora Stiftinger, 2023. "Outside options and worker motivation," Economics working papers 2023-08, Department of Economics, Johannes Kepler University Linz, Austria.
    11. Ockenfels, Axel & Sliwka, Dirk & Werner, Peter, 2024. "Multi-Rater Performance Evaluations and Incentives," IZA Discussion Papers 16812, Institute of Labor Economics (IZA).
    12. Werner, Peter, 2024. "On common evaluation standards and the acceptance of wage inequality," Games and Economic Behavior, Elsevier, vol. 145(C), pages 137-156.
    13. Irene Trapp & Rouven Trapp, 2019. "The psychological effects of centrality bias: an experimental analysis," Journal of Business Economics, Springer, vol. 89(2), pages 155-189, March.
    14. Pohlan, Laura & Steffes, Susanne, 2022. "Performance feedback and job search behavior: Empirical evidence from linked employer-employee data," ZEW Discussion Papers 22-048, ZEW - Leibniz Centre for European Economic Research.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Axel Ockenfels & Dirk Sliwka & Peter Werner, 2015. "Bonus Payments and Reference Point Violations," Management Science, INFORMS, vol. 61(7), pages 1496-1513, July.
    2. Marchegiani, Lucia & Reggiani, Tommaso & Rizzolli, Matteo, 2016. "Loss averse agents and lenient supervisors in performance appraisal," Journal of Economic Behavior & Organization, Elsevier, vol. 131(PA), pages 183-197.
    3. Johannes Berger & Christine Harbring & Dirk Sliwka, 2013. "Performance Appraisals and the Impact of Forced Distribution--An Experimental Investigation," Management Science, INFORMS, vol. 59(1), pages 54-68, June.
    4. Dohmen, Thomas, 2014. "Behavioral labor economics: Advances and future directions," Labour Economics, Elsevier, vol. 30(C), pages 71-85.
    5. Frederiksen, Anders & Lange, Fabian & Kriechel, Ben, 2017. "Subjective performance evaluations and employee careers," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 408-429.
    6. Yan Chen & Peter Cramton & John A. List & Axel Ockenfels, 2021. "Market Design, Human Behavior, and Management," Management Science, INFORMS, vol. 67(9), pages 5317-5348, September.
    7. Brandes, Leif & Franck, Egon, 2012. "Social preferences or personal career concerns? Field evidence on positive and negative reciprocity in the workplace," Journal of Economic Psychology, Elsevier, vol. 33(5), pages 925-939.
    8. Lucia Marchegiani & Tommaso Reggiani & Matteo Rizzolli, 2013. "Severity vs. Leniency Bias in Performance Appraisal: Experimental evidence," BEMPS - Bozen Economics & Management Paper Series BEMPS01, Faculty of Economics and Management at the Free University of Bozen.
    9. Werner, Peter, 2024. "On common evaluation standards and the acceptance of wage inequality," Games and Economic Behavior, Elsevier, vol. 145(C), pages 137-156.
    10. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    11. Kathrin Manthei & Dirk Sliwka, 2019. "Multitasking and Subjective Performance Evaluations: Theory and Evidence from a Field Experiment in a Bank," Management Science, INFORMS, vol. 65(12), pages 5861-5883, December.
    12. Ockenfels, Axel & Sliwka, Dirk & Werner, Peter, 2024. "Multi-Rater Performance Evaluations and Incentives," IZA Discussion Papers 16812, Institute of Labor Economics (IZA).
    13. Sliwka, Dirk & Werner, Peter, 2016. "How Do Agents React to Dynamic Wage Increases? An Experimental Study," IZA Discussion Papers 9855, Institute of Labor Economics (IZA).
    14. Golman, Russell & Bhatia, Sudeep, 2012. "Performance evaluation inflation and compression," Accounting, Organizations and Society, Elsevier, vol. 37(8), pages 534-543.
    15. Gosnell, Greer & Metcalfe, Robert & List, John A, 2016. "A new approach to an age-old problem: solving externalities by incenting workers directly," LSE Research Online Documents on Economics 84331, London School of Economics and Political Science, LSE Library.
    16. Boosey, Luke & Goerg, Sebastian, 2020. "The timing of discretionary bonuses – effort, signals, and reciprocity," Games and Economic Behavior, Elsevier, vol. 124(C), pages 254-280.
    17. Cao, Cangjian & Li, Sherry Xin & Liu, Tracy Xiao, 2020. "A gift with thoughtfulness: A field experiment on work incentives," Games and Economic Behavior, Elsevier, vol. 124(C), pages 17-42.
    18. Guido Friebel & Matthias Heinz & Miriam Krueger & Nikolay Zubanov, 2017. "Team Incentives and Performance: Evidence from a Retail Chain," American Economic Review, American Economic Association, vol. 107(8), pages 2168-2203, August.
    19. Kampkötter, Patrick & Mohrenweiser, Jens & Sliwka, Dirk & Steffes, Susanne & Wolter, Stefanie, 2015. "Measuring the use of human resources practices and employee attitudes: The linked personnel panel," ZEW Discussion Papers 15-074, ZEW - Leibniz Centre for European Economic Research.
    20. Gill, David & Stone, Rebecca, 2010. "Fairness and desert in tournaments," Games and Economic Behavior, Elsevier, vol. 69(2), pages 346-364, July.

    More about this item

    Keywords

    subjective performance evaluation; performance appraisals; management practices; experiments; field data; LPP;
    All these keywords.

    JEL classification:

    • D22 - Microeconomics - - Production and Organizations - - - Firm Behavior: Empirical Analysis
    • J33 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Compensation Packages; Payment Methods
    • M12 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration - - - Personnel Management; Executives; Executive Compensation
    • M52 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Compensation and Compensation Methods and Their Effects

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp9285. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.