IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/uczaw_v1.html
   My bibliography  Save this paper

Acceptance and motivational effect of AI-driven feedback in the workplace: An experimental study with direct replication

Author

Listed:
  • Hein, Ilka
  • Cecil, Julia

    (Ludwig-Maximilians-Universität München)

  • Lermer, Eva

    (LMU Munich)

Abstract

Artificial intelligence (AI) is increasingly taking over leadership tasks in companies, including the provision of feedback. However, the effect of AI-driven feedback on employees and its theoretical foundations are poorly understood. We aimed to close this research gap by comparing perceptions of AI and human feedback based on construal level theory and the feedback process model. Using these theories, our objective was also to investigate the moderating role of feedback valence and the mediating effect of social distance. A 2 × 2 between-subjects design was applied to manipulate feedback source (human vs. AI) and valence (negative vs. positive) via vignettes. In a preregistered experimental study (S1) and subsequent direct replication (S2), responses from NS1 = 263 and NS2 = 449 participants were studied who completed a German online questionnaire asking for feedback acceptance, performance motivation, social distance, acceptance of the feedback source itself, and intention to seek further feedback. Regression analyses showed that AI feedback was rated as less accurate and led to lower performance motivation, acceptance of the feedback provider, and intention to seek further feedback. These effects were mediated by perceived social distance. Moreover, for feedback acceptance and performance motivation, the differences were only found for positive but not for negative feedback in the first study. This implies that AI feedback may not inherently be perceived as more negatively than human feedback as it depends on the feedback's valence. Furthermore, the mediation effects indicate that the shown negative evaluations of the AI can be explained by higher social distance and that increased social closeness to feedback providers may improve appraisals of them and of their feedback. Theoretical contributions of the studies and implications for the use of AI for providing feedback in the workplace are discussed, emphasizing the influence of effects related to construal level theory.

Suggested Citation

  • Hein, Ilka & Cecil, Julia & Lermer, Eva, 2024. "Acceptance and motivational effect of AI-driven feedback in the workplace: An experimental study with direct replication," OSF Preprints uczaw_v1, Center for Open Science.
    • Handle: RePEc:osf:osfxxx:uczaw_v1
    DOI: 10.31219/osf.io/uczaw_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/66609d2577ff4c504de04616/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/uczaw_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Aickin, M. & Gensler, H., 1996. "Adjusting for multiple testing when reporting research results: The Bonferroni vs Holm methods," American Journal of Public Health, American Public Health Association, vol. 86(5), pages 726-728.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hyojung Tak & Gregory Ruhnke & Ya-Chen Shih, 2015. "The Association between Patient-Centered Attributes of Care and Patient Satisfaction," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 8(2), pages 187-197, April.
    2. Van de Velde, Liesbeth & Verbeke, Wim & Popp, Michael & Van Huylenbroeck, Guido, 2010. "The importance of message framing for providing information about sustainability and environmental aspects of energy," Energy Policy, Elsevier, vol. 38(10), pages 5541-5549, October.
    3. Mahamed G. H. Omran & Maurice Clerc & Fatme Ghaddar & Ahmad Aldabagh & Omar Tawfik, 2022. "Permutation Tests for Metaheuristic Algorithms," Mathematics, MDPI, vol. 10(13), pages 1-15, June.
    4. José‐Luis Pinto‐Prades & José‐María Abellán‐Perpiñán, 2005. "Measuring the health of populations: the veil of ignorance approach," Health Economics, John Wiley & Sons, Ltd., vol. 14(1), pages 69-82, January.
    5. Yuetong Chen & Hao Wang & Baolong Zhang & Wei Zhang, 2022. "A method of measuring the article discriminative capacity and its distribution," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3317-3341, June.
    6. Rozgonjuk, Dmitri & Schmitz, Florian & Kannen, Christopher & Montag, Christian, 2021. "Cognitive ability and personality: Testing broad to nuanced associations with a smartphone app," Intelligence, Elsevier, vol. 88(C).
    7. Carl Berning & Bernd Weiß, 2016. "Publication bias in the German social sciences: an application of the caliper test to three top-tier German social science journals," Quality & Quantity: International Journal of Methodology, Springer, vol. 50(2), pages 901-917, March.
    8. Chun-Hao Li & Ming-Chang Tsai, 2014. "Is the Easy Life Always the Happiest? Examining the Association of Convenience and Well-Being in Taiwan," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 117(3), pages 673-688, July.
    9. Zoilo Emilio García-Batista & Kiero Guerra-Peña & Antonio Cano-Vindel & Solmary Xiomara Herrera-Martínez & Leonardo Adrián Medrano, 2018. "Validity and reliability of the Beck Depression Inventory (BDI-II) in general and hospital population of Dominican Republic," PLOS ONE, Public Library of Science, vol. 13(6), pages 1-12, June.
    10. J.S. Bell & S.E. Aaltonen & M.S. Airaksinen & D. Volmer & M.S. Gharat & R. Muceniece & A. Vitola & V. Foulon & F.A. Desplenter & T.F. Chen, 2010. "Determinants of Mental Health Stigma Among Pharmacy Students in Australia, Belgium, Estonia, Finland, India and Latvia," International Journal of Social Psychiatry, , vol. 56(1), pages 3-14, January.
    11. Ellen S. Mitchell & Qiuchen Yang & Heather Behr & Annabell Ho & Laura DeLuca & Christine N. May & Andreas Michaelides, 2021. "Psychosocial Characteristics by Weight Loss and Engagement in a Digital Intervention Supporting Self-Management of Weight," IJERPH, MDPI, vol. 18(4), pages 1-17, February.
    12. Colette Cunningham-Myrie & Katherine P Theall & Novie Younger-Coleman & Lisa-Gaye Greene & Parris Lyew-Ayee & Rainford Wilks, 2021. "Associations of neighborhood physical and crime environments with obesity-related outcomes in Jamaica," PLOS ONE, Public Library of Science, vol. 16(4), pages 1-19, April.
    13. Eleonora Cataldo & Maddalena Fucile & Giovan Battista Mattii, 2022. "Effects of Kaolin and Shading Net on the Ecophysiology and Berry Composition of Sauvignon Blanc Grapevines," Agriculture, MDPI, vol. 12(4), pages 1-21, March.
    14. Natalia Nehrebecka, 2017. "Probability-of-default curve calibration and validation of internal rating systems," IFC Bulletins chapters, in: Bank for International Settlements (ed.), Statistical implications of the new financial landscape, volume 43, Bank for International Settlements.
    15. Ruhm, Christopher J., 2003. "Good times make you sick," Journal of Health Economics, Elsevier, vol. 22(4), pages 637-658, July.
    16. Paolo Finotelli & Ottavia Dipasquale & Isa Costantini & Alessia Pini & Francesca Baglio & Giuseppe Baselli & Paolo Dulio & Mara Cercignani, 2018. "Exploring resting-state functional connectivity invariants across the lifespan in healthy people by means of a recently proposed graph theoretical model," PLOS ONE, Public Library of Science, vol. 13(11), pages 1-28, November.
    17. Hein, Ilka & Cecil, Julia & Lermer, Eva, 2024. "Acceptance and motivational effect of AI-driven feedback in the workplace: An experimental study with direct replication," OSF Preprints uczaw, Center for Open Science.
    18. Lennart Reifels & Amy Morgan & Lay San Too & Marisa Schlichthorst & Michelle Williamson & Helen Jordan, 2021. "What Works in Community-Led Suicide Prevention: Perspectives of Wesley LifeForce Network Coordinators," IJERPH, MDPI, vol. 18(11), pages 1-14, June.
    19. Ju-Yu Yen & Yi-Chun Yeh & Peng-Wei Wang & Tai-Ling Liu & Yun-Yu Chen & Chih-Hung Ko, 2017. "Emotional Regulation in Young Adults with Internet Gaming Disorder," IJERPH, MDPI, vol. 15(1), pages 1-11, December.
    20. Tulowiecki, Stephen J., 2014. "Using vegetation data within presettlement land survey records for species distribution modeling: A tale of two datasets," Ecological Modelling, Elsevier, vol. 291(C), pages 109-120.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:uczaw_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.