IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v70y2024i9p5753-5775.html
   My bibliography  Save this article

Friend or Foe? Teaming Between Artificial Intelligence and Workers with Variation in Experience

Author

Listed:
  • Weiguang Wang

    (Simon Business School, University of Rochester, Rochester, New York 14627)

  • Guodong (Gordon) Gao

    (Carey Business School, Johns Hopkins University, Baltimore, Maryland 21202)

  • Ritu Agarwal

    (Carey Business School, Johns Hopkins University, Baltimore, Maryland 21202)

Abstract

As artificial intelligence (AI) applications become more pervasive, it is critical to understand how knowledge workers with different levels and types of experience can team with AI for productivity gains. We focus on the influence of two major types of human work experience (narrow experience based on the specific task volume and broad experience based on seniority) on the human-AI team dynamics. We developed an AI solution for medical chart coding in a publicly traded company and conducted a field study among the knowledge workers. Based on a detailed analysis performed at the medical chart level, we find evidence that AI benefits workers with greater task-based experience, but senior workers gain less from AI than their junior colleagues. Further investigation reveals that the relatively lower productivity lift from AI is not a result of seniority per se but lower trust in AI, likely triggered by the senior workers’ broader job responsibilities. This study provides new empirical insights into the differential roles of worker experience in the collaborative dynamics between AI and knowledge workers, which have important societal and business implications.

Suggested Citation

  • Weiguang Wang & Guodong (Gordon) Gao & Ritu Agarwal, 2024. "Friend or Foe? Teaming Between Artificial Intelligence and Workers with Variation in Experience," Management Science, INFORMS, vol. 70(9), pages 5753-5775, September.
  • Handle: RePEc:inm:ormnsc:v:70:y:2024:i:9:p:5753-5775
    DOI: 10.1287/mnsc.2021.00588
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2021.00588
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2021.00588?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Card, David & Krueger, Alan B, 1994. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania," American Economic Review, American Economic Association, vol. 84(4), pages 772-793, September.
    2. Andreas Fügener & Jörn Grahl & Alok Gupta & Wolfgang Ketter, 2022. "Cognitive Challenges in Human–Artificial Intelligence Collaboration: Investigating the Path Toward Productive Delegation," Information Systems Research, INFORMS, vol. 33(2), pages 678-696, June.
    3. Chiara Longoni & Andrea Bonezzi & Carey K Morewedge, 2019. "Resistance to Medical Artificial Intelligence," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 46(4), pages 629-650.
    4. Scott Mayer McKinney & Marcin Sieniek & Varun Godbole & Jonathan Godwin & Natasha Antropova & Hutan Ashrafian & Trevor Back & Mary Chesus & Greg S. Corrado & Ara Darzi & Mozziyar Etemadi & Florencia G, 2020. "International evaluation of an AI system for breast cancer screening," Nature, Nature, vol. 577(7788), pages 89-94, January.
    5. Anne Case & Angus Deaton, 2017. "Mortality and Morbidity in the 21st Century," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 48(1 (Spring), pages 397-476.
    6. Jussupow, Ekaterina & Spohrer, Kai & Heinzl, Armin & Gawlitza, Joshua, 2021. "Augmenting Medical Diagnosis Decisions? An Investigation into Physicians’ Decision-Making Process with Artificial Intelligence," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 137446, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    7. Anton Korinek & Joseph E. Stiglitz, 2018. "Artificial Intelligence and Its Implications for Income Distribution and Unemployment," NBER Chapters, in: The Economics of Artificial Intelligence: An Agenda, pages 349-390, National Bureau of Economic Research, Inc.
    8. Erik Brynjolfsson, 2022. "The Turing Trap: The Promise & Peril of Human-Like Artificial Intelligence," Papers 2201.04200, arXiv.org.
    9. David Card & Alan Krueger, 1993. "Minimum Wages and Employment: A Case Study of the Fast Food Industry in New Jersey and Pennsylvania," Working Papers 694, Princeton University, Department of Economics, Industrial Relations Section..
    10. Claudia Goldin & Lawrence F. Katz, 1998. "The Origins of Technology-Skill Complementarity," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 113(3), pages 693-732.
    11. Chad Syverson, 2017. "Challenges to Mismeasurement Explanations for the US Productivity Slowdown," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 165-186, Spring.
    12. Ruyi Ge & Zhiqiang (Eric) Zheng & Xuan Tian & Li Liao, 2021. "Human–Robot Interaction: When Investors Adjust the Usage of Robo-Advisors in Peer-to-Peer Lending," Information Systems Research, INFORMS, vol. 32(3), pages 774-785, September.
    13. Kristian Lum, 2017. "Limitations of mitigating judicial bias with machine learning," Nature Human Behaviour, Nature, vol. 1(7), pages 1-1, July.
    14. Sturm, Timo & Gerlach, Jin & Pumplun, Luisa & Mesbah, Neda & Peters, Felix & Tauchert, Christoph & Nan, Ning & Buxmann, Peter, 2021. "Coordinating Human and Machine Learning for Effective Organizational Learning," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 125653, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    15. Scott Mayer McKinney & Marcin Sieniek & Varun Godbole & Jonathan Godwin & Natasha Antropova & Hutan Ashrafian & Trevor Back & Mary Chesus & Greg S. Corrado & Ara Darzi & Mozziyar Etemadi & Florencia G, 2020. "Addendum: International evaluation of an AI system for breast cancer screening," Nature, Nature, vol. 586(7829), pages 19-19, October.
    16. Timothy F. Bresnahan & Erik Brynjolfsson & Lorin M. Hitt, 2002. "Information Technology, Workplace Organization, and the Demand for Skilled Labor: Firm-Level Evidence," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(1), pages 339-376.
    17. Ragnar Fjelland, 2020. "Why general artificial intelligence will not be realized," Palgrave Communications, Palgrave Macmillan, vol. 7(1), pages 1-9, December.
    18. Tinglong Dai & Shubhranshu Singh, 2020. "Conspicuous by Its Absence: Diagnostic Expert Testing Under Uncertainty," Marketing Science, INFORMS, vol. 39(3), pages 540-563, May.
    19. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    20. Tom Fangyun Tan & Serguei Netessine, 2020. "At Your Service on the Table: Impact of Tabletop Technology on Restaurant Performance," Management Science, INFORMS, vol. 66(10), pages 4496-4515, October.
    21. D. Harrison McKnight & Vivek Choudhury & Charles Kacmar, 2002. "Developing and Validating Trust Measures for e-Commerce: An Integrative Typology," Information Systems Research, INFORMS, vol. 13(3), pages 334-359, September.
    22. Ekaterina Jussupow & Kai Spohrer & Armin Heinzl & Joshua Gawlitza, 2021. "Augmenting Medical Diagnosis Decisions? An Investigation into Physicians’ Decision-Making Process with Artificial Intelligence," Information Systems Research, INFORMS, vol. 32(3), pages 713-735, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Christoph Riedl & Eric Bogert, 2024. "Effects of AI Feedback on Learning, the Skill Gap, and Intellectual Diversity," Papers 2409.18660, arXiv.org.
    2. Hanzhe Li & Jin Li & Ye Luo & Xiaowei Zhang, 2024. "AI Persuasion, Bayesian Attribution, and Career Concerns of Doctors," Papers 2410.01114, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dawei (David) Zhang & Gang Peng & Yuliang Yao & Tyson R. Browning, 2024. "Is a College Education Still Enough? The IT-Labor Relationship with Education Level, Task Routineness, and Artificial Intelligence," Information Systems Research, INFORMS, vol. 35(3), pages 992-1010, September.
    2. Kevin Bauer & Andrej Gill, 2024. "Mirror, Mirror on the Wall: Algorithmic Assessments, Transparency, and Self-Fulfilling Prophecies," Information Systems Research, INFORMS, vol. 35(1), pages 226-248, March.
    3. Tinglong Dai & Sridhar Tayur, 2022. "Designing AI‐augmented healthcare delivery systems for physician buy‐in and patient acceptance," Production and Operations Management, Production and Operations Management Society, vol. 31(12), pages 4443-4451, December.
    4. Ulrich Gnewuch & Stefan Morana & Oliver Hinz & Ralf Kellner & Alexander Maedche, 2024. "More Than a Bot? The Impact of Disclosing Human Involvement on Customer Interactions with Hybrid Service Agents," Information Systems Research, INFORMS, vol. 35(3), pages 936-955, September.
    5. Ekaterina Jussupow & Kai Spohrer & Armin Heinzl, 2022. "Radiologists’ Usage of Diagnostic AI Systems," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 64(3), pages 293-309, June.
    6. Ritu Agarwal & Michelle Dugas & Guodong (Gordon) Gao, 2024. "Augmenting physicians with artificial intelligence to transform healthcare: Challenges and opportunities," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 33(2), pages 360-374, March.
    7. Kevin Bauer & Moritz von Zahn & Oliver Hinz, 2023. "Expl(AI)ned: The Impact of Explainable Artificial Intelligence on Users’ Information Processing," Information Systems Research, INFORMS, vol. 34(4), pages 1582-1602, December.
    8. Dickens, Richard & Machin, Stephen & Manning, Alan, 1998. "Estimating the effect of minimum wages on employment from the distribution of wages: A critical view," Labour Economics, Elsevier, vol. 5(2), pages 109-134, June.
    9. Do, Manh Hung & Nguyen, Trung Thanh & Grote, Ulrike, 2023. "Land consolidation, rice production, and agricultural transformation: Evidence from household panel data for Vietnam," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 157-173.
    10. Majd Oteibi & Adam Tamimi & Kaneez Abbas & Gabriel Tamimi & Danesh Khazaei & Hadi Khazaei, 2024. "Advancing Digital Health using AI and Machine Learning Solutions for Early Ultrasonic Detection of Breast Disorders in Women," International Journal of Research and Scientific Innovation, International Journal of Research and Scientific Innovation (IJRSI), vol. 11(11), pages 518-527, November.
    11. Pearce Edwards & Patrick Pierson, 2023. "Incumbent-Aligned Terrorism and Voting Behavior: Evidence from Argentina’s 1973 Elections," Journal of Conflict Resolution, Peace Science Society (International), vol. 67(4), pages 672-700, April.
    12. Leora Friedberg, 2003. "The Impact of Technological Change on Older Workers: Evidence from Data on Computer Use," ILR Review, Cornell University, ILR School, vol. 56(3), pages 511-529, April.
    13. Christopher Bennett & Brent Evans & Christopher Marsicano, 2021. "Taken for Granted? Effects of Loan-Reduction Initiatives on Student Borrowing, Admission Metrics, and Campus Diversity," Research in Higher Education, Springer;Association for Institutional Research, vol. 62(5), pages 569-599, August.
    14. Scott Alan Carson & Scott A. Carson, 2022. "Nineteenth and Early 20th Century Physical Activity and Calories by Gender and Race," CESifo Working Paper Series 10140, CESifo.
    15. Alexander P. L. Martindale & Carrie D. Llewellyn & Richard O. Visser & Benjamin Ng & Victoria Ngai & Aditya U. Kale & Lavinia Ferrante Ruffano & Robert M. Golub & Gary S. Collins & David Moher & Melis, 2024. "Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    16. Emilie Jašová & Klára Čermáková & Božena Kadeřábková & Pavel Procházka, 2016. "Působení institucionálních faktorů na strukturální a cyklickou nezaměstnanost v zemích Visegrádské skupiny [Influence of Institutional Factors on Structural and Cyclical Unemployment in the Countri," Politická ekonomie, Prague University of Economics and Business, vol. 2016(1), pages 34-50.
    17. Christoph Riedl & Eric Bogert, 2024. "Effects of AI Feedback on Learning, the Skill Gap, and Intellectual Diversity," Papers 2409.18660, arXiv.org.
    18. Ekaterina Prytkova, 2021. "ICT's Wide Web: a System-Level Analysis of ICT's Industrial Diffusion with Algorithmic Links," Jena Economics Research Papers 2021-005, Friedrich-Schiller-University Jena.
    19. Boucekkine, Raouf & Crifo, Patricia, 2008. "Human Capital Accumulation And The Transition From Specialization To Multitasking," Macroeconomic Dynamics, Cambridge University Press, vol. 12(3), pages 320-344, June.
    20. Georgiana-Virginia Bonea & Vlad I. Rosca, 2022. "Social policies around the minimum wage in Romania during the Covid- 19 crisis," Journal of Community Positive Practices, Catalactica NGO, issue 1, pages 3-19.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:70:y:2024:i:9:p:5753-5775. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.