IDEAS home Printed from https://ideas.repec.org/p/pdn/dispap/131.html
   My bibliography  Save this paper

Evaluators’ Consideration of Warmth and Competence in Verbal and Numerical Performance Assessments

Author

Listed:
  • Jana Kim Gutt

    (Paderborn University)

Abstract

When conducting performance appraisals, evaluators largely depend on their subjective perception. This makes performance appraisals particularly vulnerable to biases, especially along the lines of warmth and competence – the two primary dimensions of social judgment. Warmth reflects the ability to build and maintain social relationships, while competence refers to achieving goals and completing tasks. Although both dimensions have been extensively studied in the past, there is limited understanding of how they influence observation-based assessments, particularly in relation to the evaluation format and the impact of the rater and ratee gender. To address this gap, the study employs a laboratory experiment to investigate how warmth- and competence-related behaviors in a task setting translate into performance appraisals, namely numerical ratings, written comments, and spoken comments. The evaluation comments are converted into numerical ratings using a machine learning algorithm, which allows for comparison with the assigned numerical ratings. Findings reveal that the consideration of warmth and competence depends not only on the appraisal format but also on the rater (evaluator) and ratee (task-solver) gender. This study enhances the understanding of how evaluations differ across formats and examines the role of gender in shaping perceptions of warmth and competence.

Suggested Citation

  • Jana Kim Gutt, 2025. "Evaluators’ Consideration of Warmth and Competence in Verbal and Numerical Performance Assessments," Working Papers Dissertations 131, Paderborn University, Faculty of Business Administration and Economics.
  • Handle: RePEc:pdn:dispap:131
    as

    Download full text from publisher

    File URL: http://groups.uni-paderborn.de/wp-wiwi/RePEc/pdf/dispap/DP131.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Roberto Centeno & Ramón Hermoso & Maria Fasli, 2015. "On the inaccuracy of numerical ratings: dealing with biased opinions in social networks," Information Systems Frontiers, Springer, vol. 17(4), pages 809-825, August.
    2. Adler, Seymour & Campion, Michael & Colquitt, Alan & Grubb, Amy & Murphy, Kevin & Ollander-Krane, Rob & Pulakos, Elaine D., 2016. "Getting Rid of Performance Ratings: Genius or Folly? A Debate," Industrial and Organizational Psychology, Cambridge University Press, vol. 9(2), pages 219-252, June.
    3. Christian Grund & Judith Przemeck, 2012. "Subjective performance appraisal and inequality aversion," Applied Economics, Taylor & Francis Journals, vol. 44(17), pages 2149-2155, June.
    4. Ko, S.J. & Judd, C.M. & Stapel, D.A., 2009. "Stereotyping based on voice in the presence of individuating information : Vocal femininity affects perceived competence but not warmth," Other publications TiSEM 2106002e-5b25-4802-b77f-6, Tilburg University, School of Economics and Management.
    5. Claire E Ashton-James & Joshua M Tybur & Verena Grießer & Daniel Costa, 2019. "Stereotypes about surgeon warmth and competence: The role of surgeon gender," PLOS ONE, Public Library of Science, vol. 14(2), pages 1-10, February.
    6. Johannes Berger & Christine Harbring & Dirk Sliwka, 2013. "Performance Appraisals and the Impact of Forced Distribution--An Experimental Investigation," Management Science, INFORMS, vol. 59(1), pages 54-68, June.
    7. Roberto A. Weber & Colin F. Camerer, 2003. "Cultural Conflict and Merger Failure: An Experimental Approach," Management Science, INFORMS, vol. 49(4), pages 400-415, April.
    8. Stefano Pagliaro & Marco Brambilla & Simona Sacchi & Manuela D’Angelo & Naomi Ellemers, 2013. "Initial Impressions Determine Behaviours: Morality Predicts the Willingness to Help Newcomers," Journal of Business Ethics, Springer, vol. 117(1), pages 37-44, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marchegiani, Lucia & Reggiani, Tommaso & Rizzolli, Matteo, 2016. "Loss averse agents and lenient supervisors in performance appraisal," Journal of Economic Behavior & Organization, Elsevier, vol. 131(PA), pages 183-197.
    2. Patrick Kampkötter & Dirk Sliwka, 2016. "The Complementary Use of Experiments and Field Data to Evaluate Management Practices: The Case of Subjective Performance Evaluations," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 172(2), pages 364-389, June.
    3. Jana Kim Gutt & Kirsten Thommes & Miro Mehic, 2025. "Can Verbal Performance Appraisals and Machine Learning Models Improve the Accuracy of Performance Evaluations?," Working Papers Dissertations 132, Paderborn University, Faculty of Business Administration and Economics.
    4. Anna Stankiewicz-Mróz, 2019. "Influence of Interlocking Directorates on Integration after the Acquisition of Warsaw Stock Exchange—Listed Companies," Sustainability, MDPI, vol. 11(24), pages 1-22, December.
    5. Hirota, Haruaki & Iwata, Kazuyuki & Tanaka, Kenta, 2022. "Is public official training effective at reducing costs? Evidence from survey data on Japanese municipal mergers," Economic Analysis and Policy, Elsevier, vol. 75(C), pages 145-158.
    6. Robert S. Gibbons & Manuel Grieder & Holger Herz & Christian Zehnder, 2019. "Building an Equilibrium: Rules Versus Principles in Relational Contracts," CESifo Working Paper Series 7871, CESifo.
    7. Simon Gaechter & Chris Starmer & Fabio Tufano, 2022. "Measuring “group cohesion” to reveal the power of social relationships in team production," Discussion Papers 2022-12, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    8. Houser, Daniel & Yang, Yang, 2024. "Learning language: An experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 217(C), pages 547-559.
    9. Shi, Wei & Tang, Yinuo, 2015. "Cultural similarity as in-group favoritism: The impact of religious and ethnic similarities on alliance formation and announcement returns," Journal of Corporate Finance, Elsevier, vol. 34(C), pages 32-46.
    10. Kyriaki Papadopoulou, 2020. "Comparative Review Of Performance Measurement Methods Effectiveness," Economics and Management, Faculty of Economics, SOUTH-WEST UNIVERSITY "NEOFIT RILSKI", BLAGOEVGRAD, vol. 17(1), pages 127-139.
    11. Katrin Weiskirchner-Merten, 2020. "Interdependence, participation, and coordination in the budgeting process," Business Research, Springer;German Academic Association for Business Research, vol. 13(1), pages 247-274, April.
    12. De Chiara, Alessandro & Livio, Luca, 2017. "The threat of corruption and the optimal supervisory task," Journal of Economic Behavior & Organization, Elsevier, vol. 133(C), pages 172-186.
    13. Wilfred Amaldoss & Richard Staelin, 2010. "Cross-Function and Same-Function Alliances: How Does Alliance Structure Affect the Behavior of Partnering Firms?," Management Science, INFORMS, vol. 56(2), pages 302-317, February.
    14. Angelovski, Andrej & Brandts, Jordi & Sola, Carles, 2016. "Hiring and escalation bias in subjective performance evaluations: A laboratory experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 121(C), pages 114-129.
    15. Malmendier, Ulrike & Tate, Geoffrey, 2008. "Who makes acquisitions? CEO overconfidence and the market's reaction," Journal of Financial Economics, Elsevier, vol. 89(1), pages 20-43, July.
    16. Marco Kleine & Sebastian Kube, 2015. "Communication and Trust in Principal-Team Relationships: Experimental Evidence," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2015_06, Max Planck Institute for Research on Collective Goods.
    17. Ostapchuk, Igor & Gagalyuk, Taras & Curtiss, Jarmila, 2021. "Post-acquisition integration and growth of farms: the case of Ukrainian agroholdings," International Food and Agribusiness Management Review, International Food and Agribusiness Management Association, vol. 24(4), April.
    18. Nasser Saad Al Kahtani & Sulphey M. M., 2022. "A Study on How Psychological Capital, Social Capital, Workplace Wellbeing, and Employee Engagement Relate to Task Performance," SAGE Open, , vol. 12(2), pages 21582440221, May.
    19. repec:diw:diwwpp:dp1843 is not listed on IDEAS
    20. Goldberg, Amir & Srivastava, Sameer B & Manian, Govind & Monroe, William & Potts, Christopher, 2016. "Fitting In or Standing Out? The Tradeoffs of Structural and Cultural Embeddedness," Institute for Research on Labor and Employment, Working Paper Series qt9bf631rg, Institute of Industrial Relations, UC Berkeley.
    21. Andreas Blume & April Franco, 2002. "Learning from failure," Staff Report 299, Federal Reserve Bank of Minneapolis.

    More about this item

    Keywords

    performance appraisal; evaluation formats; social judgment; machine learning; gender stereotypes; quantitative text analysis;
    All these keywords.

    JEL classification:

    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • M51 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Firm Employment Decisions; Promotions
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pdn:dispap:131. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: WP-WiWi-Info (email available below). General contact details of provider: https://edirc.repec.org/data/fwpadde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.