IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/uczaw.html
   My bibliography  Save this paper

Acceptance and motivational effect of AI-driven feedback in the workplace: An experimental study with direct replication

Author

Listed:
  • Hein, Ilka
  • Cecil, Julia

    (Ludwig-Maximilians-Universität München)

  • Lermer, Eva

    (LMU Munich)

Abstract

Artificial intelligence (AI) is increasingly taking over leadership tasks in companies, including the provision of feedback. However, the effect of AI-driven feedback on employees and its theoretical foundations are poorly understood. We aimed to reduce this research gap by comparing perceptions of AI and human feedback based on construal level theory and the feedback process model. A 2 x 2 between-subjects design with vignettes was applied to manipulate feedback source (human vs. AI) and valence (negative vs. positive). In a preregistered experimental study (S1) and subsequent direct replication (S2), responses from NS1 = 263 and NS2 = 449 participants who completed a German online questionnaire were studied. Regression analyses showed that AI feedback was rated as less accurate and led to lower performance motivation, acceptance of the feedback provider, and intention to seek further feedback. These effects were mediated by perceived social distance. Moreover, for feedback acceptance and performance motivation, the differences were only found for positive but not for negative feedback in the first study. This implies that AI feedback may not inherently be perceived as more negatively than human feedback as it depends on the feedback’s valence. Furthermore, the mediation effects indicate that the shown negative evaluations of the AI can be explained by higher social distance and that increased social closeness to feedback providers may improve appraisals of them and of their feedback. Theoretical contributions of the studies and implications for the use of AI for providing feedback in the workplace are discussed, emphasizing the influence of effects related to construal level theory.

Suggested Citation

  • Hein, Ilka & Cecil, Julia & Lermer, Eva, 2024. "Acceptance and motivational effect of AI-driven feedback in the workplace: An experimental study with direct replication," OSF Preprints uczaw, Center for Open Science.
    • Handle: RePEc:osf:osfxxx:uczaw
    DOI: 10.31219/osf.io/uczaw
    as

    Download full text from publisher

    File URL: https://osf.io/download/66609d2577ff4c504de04616/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/uczaw?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Aickin, M. & Gensler, H., 1996. "Adjusting for multiple testing when reporting research results: The Bonferroni vs Holm methods," American Journal of Public Health, American Public Health Association, vol. 86(5), pages 726-728.
    2. Siliang Tong & Nan Jia & Xueming Luo & Zheng Fang, 2021. "The Janus face of artificial intelligence feedback: Deployment versus disclosure effects on employee performance," Strategic Management Journal, Wiley Blackwell, vol. 42(9), pages 1600-1631, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hyojung Tak & Gregory Ruhnke & Ya-Chen Shih, 2015. "The Association between Patient-Centered Attributes of Care and Patient Satisfaction," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 8(2), pages 187-197, April.
    2. Milan Miric & Nan Jia & Kenneth G. Huang, 2023. "Using supervised machine learning for large‐scale classification in management research: The case for identifying artificial intelligence patents," Strategic Management Journal, Wiley Blackwell, vol. 44(2), pages 491-519, February.
    3. Colette Cunningham-Myrie & Katherine P Theall & Novie Younger-Coleman & Lisa-Gaye Greene & Parris Lyew-Ayee & Rainford Wilks, 2021. "Associations of neighborhood physical and crime environments with obesity-related outcomes in Jamaica," PLOS ONE, Public Library of Science, vol. 16(4), pages 1-19, April.
    4. Eleonora Cataldo & Maddalena Fucile & Giovan Battista Mattii, 2022. "Effects of Kaolin and Shading Net on the Ecophysiology and Berry Composition of Sauvignon Blanc Grapevines," Agriculture, MDPI, vol. 12(4), pages 1-21, March.
    5. Van de Velde, Liesbeth & Verbeke, Wim & Popp, Michael & Van Huylenbroeck, Guido, 2010. "The importance of message framing for providing information about sustainability and environmental aspects of energy," Energy Policy, Elsevier, vol. 38(10), pages 5541-5549, October.
    6. Mahamed G. H. Omran & Maurice Clerc & Fatme Ghaddar & Ahmad Aldabagh & Omar Tawfik, 2022. "Permutation Tests for Metaheuristic Algorithms," Mathematics, MDPI, vol. 10(13), pages 1-15, June.
    7. Johannes Habel & Sascha Alavi & Nicolas Heinitz, 2023. "A theory of predictive sales analytics adoption," AMS Review, Springer;Academy of Marketing Science, vol. 13(1), pages 34-54, June.
    8. Koehler, Maximilian & Sauermann, Henry, 2024. "Algorithmic management in scientific research," Research Policy, Elsevier, vol. 53(4).
    9. Natalia Nehrebecka, 2017. "Probability-of-default curve calibration and validation of internal rating systems," IFC Bulletins chapters, in: Bank for International Settlements (ed.), Statistical implications of the new financial landscape, volume 43, Bank for International Settlements.
    10. José‐Luis Pinto‐Prades & José‐María Abellán‐Perpiñán, 2005. "Measuring the health of populations: the veil of ignorance approach," Health Economics, John Wiley & Sons, Ltd., vol. 14(1), pages 69-82, January.
    11. Ruhm, Christopher J., 2003. "Good times make you sick," Journal of Health Economics, Elsevier, vol. 22(4), pages 637-658, July.
    12. Paolo Finotelli & Ottavia Dipasquale & Isa Costantini & Alessia Pini & Francesca Baglio & Giuseppe Baselli & Paolo Dulio & Mara Cercignani, 2018. "Exploring resting-state functional connectivity invariants across the lifespan in healthy people by means of a recently proposed graph theoretical model," PLOS ONE, Public Library of Science, vol. 13(11), pages 1-28, November.
    13. Yuetong Chen & Hao Wang & Baolong Zhang & Wei Zhang, 2022. "A method of measuring the article discriminative capacity and its distribution," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3317-3341, June.
    14. Manav Raj & Justin Berg & Rob Seamans, 2023. "Art-ificial Intelligence: The Effect of AI Disclosure on Evaluations of Creative Content," Papers 2303.06217, arXiv.org, revised Jun 2024.
    15. Wang, Sai & Wen, Wen & Niu, Yuhao & Li, Xin, 2024. "Digital transformation and corporate labor investment efficiency," Emerging Markets Review, Elsevier, vol. 59(C).
    16. Jing Wang & Zeyu Xing & Rui Zhang, 2023. "AI technology application and employee responsibility," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-17, December.
    17. Jiaqi Xu & Xiaofei Tang & En-Chung Chang & Haoyu Peng, 2024. "Working with AI: the impact of organizational intelligent service strategy on employees’ perception of career achievement," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-20, December.
    18. Rozgonjuk, Dmitri & Schmitz, Florian & Kannen, Christopher & Montag, Christian, 2021. "Cognitive ability and personality: Testing broad to nuanced associations with a smartphone app," Intelligence, Elsevier, vol. 88(C).
    19. Carl Berning & Bernd Weiß, 2016. "Publication bias in the German social sciences: an application of the caliper test to three top-tier German social science journals," Quality & Quantity: International Journal of Methodology, Springer, vol. 50(2), pages 901-917, March.
    20. Lennart Reifels & Amy Morgan & Lay San Too & Marisa Schlichthorst & Michelle Williamson & Helen Jordan, 2021. "What Works in Community-Led Suicide Prevention: Perspectives of Wesley LifeForce Network Coordinators," IJERPH, MDPI, vol. 18(11), pages 1-14, June.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:uczaw. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.