IDEAS home Printed from https://ideas.repec.org/a/eee/tefoso/v203y2024ics0040162524001859.html
   My bibliography  Save this article

The impact of ChatGPT on human skills: A quantitative study on twitter data

Author

Listed:
  • Giordano, Vito
  • Spada, Irene
  • Chiarello, Filippo
  • Fantoni, Gualtiero

Abstract

The novel generative Artificial Intelligence (AI) developed by OpenAI, i.e., ChatGPT, rised a great interest in both scientific and business contexts. This new wave of technological advancement typically produces deep transformation in the workplace, requiring new skills. However, none of the studies in literature provide quantitative analysis and measures on the impact of ChatGPT on human skills. To address this gap, we collected a database of 616,073 tweets about ChatGPT, and used Natural Language Processing techniques to identify the tasks users requested ChatGPT to perform, and the sentiment related to these tasks. Then, we compared these tasks with a standard taxonomy of skills (i.e., ESCO) using BERT. The results of the study underline that ChatGPT impacts 185 different skills. Moreover, we proposed a model to represent the interaction of the user and ChatGPT, useful to define four skills which are emerging for using this new technology.

Suggested Citation

  • Giordano, Vito & Spada, Irene & Chiarello, Filippo & Fantoni, Gualtiero, 2024. "The impact of ChatGPT on human skills: A quantitative study on twitter data," Technological Forecasting and Social Change, Elsevier, vol. 203(C).
    • Handle: RePEc:eee:tefoso:v:203:y:2024:i:c:s0040162524001859
    DOI: 10.1016/j.techfore.2024.123389
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0040162524001859
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.techfore.2024.123389?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pär J. Ågerfalk, 2020. "Artificial intelligence as digital agency," European Journal of Information Systems, Taylor & Francis Journals, vol. 29(1), pages 1-8, January.
    2. Daron Acemoglu & David Autor & Jonathon Hazell & Pascual Restrepo, 2022. "Artificial Intelligence and Jobs: Evidence from Online Vacancies," Journal of Labor Economics, University of Chicago Press, vol. 40(S1), pages 293-340.
    3. Chris Stokel-Walker, 2023. "ChatGPT listed as author on research papers: many scientists disapprove," Nature, Nature, vol. 613(7945), pages 620-621, January.
    4. Kim, Kun & Park, Oun-joung & Yun, Seunghyun & Yun, Haejung, 2017. "What makes tourists feel negatively about tourism destinations? Application of hybrid text mining methodology to smart destination management," Technological Forecasting and Social Change, Elsevier, vol. 123(C), pages 362-369.
    5. Li, Xin & Wen, Yang & Jiang, Jiaojiao & Daim, Tugrul & Huang, Lucheng, 2022. "Identifying potential breakthrough research: A machine learning method using scientific papers and Twitter data," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    6. Arts, Sam & Hou, Jianan & Gomez, Juan Carlos, 2021. "Natural language processing to identify the creation and impact of new technologies in patent text: Code, data, and new measures," Research Policy, Elsevier, vol. 50(2).
    7. Montobbio, Fabio & Staccioli, Jacopo & Virgillito, Maria Enrica & Vivarelli, Marco, 2022. "Robots and the origin of their labour-saving impact," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    8. Porter, Alan L. & Garner, Jon & Carley, Stephen F. & Newman, Nils C., 2019. "Emergence scoring to identify frontier R&D topics and key players," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 628-643.
    9. Gaetano Cascini & Davide Russo, 2007. "Computer-aided analysis of patents and search for TRIZ contradictions," International Journal of Product Development, Inderscience Enterprises Ltd, vol. 4(1/2), pages 52-67.
    10. Chris Stokel-Walker & Richard Van Noorden, 2023. "What ChatGPT and generative AI mean for science," Nature, Nature, vol. 614(7947), pages 214-216, February.
    11. Small, Henry & Boyack, Kevin W. & Klavans, Richard, 2014. "Identifying emerging topics in science and technology," Research Policy, Elsevier, vol. 43(8), pages 1450-1467.
    12. Icíar Dominguez Lacasa & Hariolf Grupp & Ulrich Schmoch, 2003. "Tracing technological change over long periods in Germany in chemicals using patent statistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 57(2), pages 175-195, June.
    13. Kayser, Victoria & Blind, Knut, 2017. "Extending the knowledge base of foresight: The contribution of text mining," Technological Forecasting and Social Change, Elsevier, vol. 116(C), pages 208-215.
    14. Kumar, Naveen & Lee, Seul Chan, 2022. "Human-machine interface in smart factory: A systematic literature review," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    15. Puccetti, Giovanni & Giordano, Vito & Spada, Irene & Chiarello, Filippo & Fantoni, Gualtiero, 2023. "Technology identification from patent texts: A novel named entity recognition method," Technological Forecasting and Social Change, Elsevier, vol. 186(PB).
    16. Rotolo, Daniele & Hicks, Diana & Martin, Ben R., 2015. "What is an emerging technology?," Research Policy, Elsevier, vol. 44(10), pages 1827-1843.
    17. Samira Ranaei & Arho Suominen & Alan Porter & Stephen Carley, 2020. "Evaluating technological emergence using text analytics: two case technologies and three approaches," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 215-247, January.
    18. Izumi Yamashita & Akiyoshi Murakami & Stephanie Cairns & Fernando Galindo-Rueda, 2021. "Measuring the AI content of government-funded R&D projects: A proof of concept for the OECD Fundstat initiative," OECD Science, Technology and Industry Working Papers 2021/09, OECD Publishing.
    19. Colombo, Emilio & Mercorio, Fabio & Mezzanzanica, Mario, 2019. "AI meets labor market: Exploring the link between automation and skills," Information Economics and Policy, Elsevier, vol. 47(C), pages 27-37.
    20. Rice, Stephen & Crouse, Sean R. & Winter, Scott R. & Rice, Connor, 2024. "The advantages and limitations of using ChatGPT to enhance technological research," Technology in Society, Elsevier, vol. 76(C).
    21. Acemoglu, Daron & Autor, David, 2011. "Skills, Tasks and Technologies: Implications for Employment and Earnings," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 12, pages 1043-1171, Elsevier.
    22. Hélène Dernis & Flavio Calvino & Laurent Moussiegt & Daisuke Nawa & Lea Samek & Mariagrazia Squicciarini, 2023. "Identifying artificial intelligence actors using online data," OECD Science, Technology and Industry Working Papers 2023/01, OECD Publishing.
    23. Abadie, Amelie & Chowdhury, Soumyadeb & Mangla, Sachin Kumar, 2024. "A shared journey: Experiential perspective and empirical evidence of virtual social robot ChatGPT's priori acceptance," Technological Forecasting and Social Change, Elsevier, vol. 201(C).
    24. Holly Else, 2023. "Abstracts written by ChatGPT fool scientists," Nature, Nature, vol. 613(7944), pages 423-423, January.
    25. Frey, Carl Benedikt & Osborne, Michael A., 2017. "The future of employment: How susceptible are jobs to computerisation?," Technological Forecasting and Social Change, Elsevier, vol. 114(C), pages 254-280.
    26. Dowling, Michael & Lucey, Brian, 2023. "ChatGPT for (Finance) research: The Bananarama Conjecture," Finance Research Letters, Elsevier, vol. 53(C).
    27. David H. Autor, 2015. "Why Are There Still So Many Jobs? The History and Future of Workplace Automation," Journal of Economic Perspectives, American Economic Association, vol. 29(3), pages 3-30, Summer.
    28. Ozcan, Sercan & Suloglu, Metin & Sakar, C. Okan & Chatufale, Sushant, 2021. "Social media mining for ideation: Identification of sustainable solutions and opinions," Technovation, Elsevier, vol. 107(C).
    29. Eva A. M. van Dis & Johan Bollen & Willem Zuidema & Robert van Rooij & Claudi L. Bockting, 2023. "ChatGPT: five priorities for research," Nature, Nature, vol. 614(7947), pages 224-226, February.
    30. Kumar, Satish & Rao, Purnima & Singhania, Shubham & Verma, Shubhangi & Kheterpal, Myra, 2024. "Will artificial intelligence drive the advancements in higher education? A tri-phased exploration," Technological Forecasting and Social Change, Elsevier, vol. 201(C).
    31. Van Roy, Vincent & Vértesy, Dániel & Vivarelli, Marco, 2018. "Technology and employment: Mass unemployment or job creation? Empirical evidence from European patenting firms," Research Policy, Elsevier, vol. 47(9), pages 1762-1776.
    32. Talaei-Khoei, Amir & Yang, Alan T. & Masialeti, Masialeti, 2024. "How does incorporating ChatGPT within a firm reinforce agility-mediated performance? The moderating role of innovation infusion and firms’ ethical identity," Technovation, Elsevier, vol. 132(C).
    33. Flavio Calvino & Lea Samek & Mariagrazia Squicciarini & Cody Morris, 2022. "Identifying and characterising AI adopters: A novel approach based on big data," OECD Science, Technology and Industry Working Papers 2022/06, OECD Publishing.
    34. Moravec, Vaclav & Hynek, Nik & Skare, Marinko & Gavurova, Beata & Kubak, Matus, 2024. "Human or machine? The perception of artificial intelligence in journalism, its socio-economic conditions, and technological developments toward the digital future," Technological Forecasting and Social Change, Elsevier, vol. 200(C).
    35. Saura, Jose Ramon & Palacios-Marqués, Daniel & Ribeiro-Soriano, Domingo, 2023. "Exploring the boundaries of open innovation: Evidence from social media mining," Technovation, Elsevier, vol. 119(C).
    36. Mariani, Marcello & Dwivedi, Yogesh K., 2024. "Generative artificial intelligence in innovation management: A preview of future research developments," Journal of Business Research, Elsevier, vol. 175(C).
    37. Chiarello, Filippo & Giordano, Vito & Spada, Irene & Barandoni, Simone & Fantoni, Gualtiero, 2024. "Future applications of generative large language models: A data-driven case study on ChatGPT," Technovation, Elsevier, vol. 133(C).
    38. Christopher Kohl & Marlene Knigge & Galina Baader & Markus Böhm & Helmut Krcmar, 2018. "Anticipating acceptance of emerging technologies using twitter: the case of self-driving cars," Journal of Business Economics, Springer, vol. 88(5), pages 617-642, July.
    39. Kim, Daewon & Kim, Suwon, 2021. "A model for user acceptance of robot journalism: Influence of positive disconfirmation and uncertainty avoidance," Technological Forecasting and Social Change, Elsevier, vol. 163(C).
    40. Flavio Calvino & Luca Fontanelli, 2023. "A portrait of AI adopters across countries: Firm characteristics, assets’ complementarities and productivity," OECD Science, Technology and Industry Working Papers 2023/02, OECD Publishing.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hao, Xinyue & Demir, Emrah & Eyers, Daniel, 2024. "Exploring collaborative decision-making: A quasi-experimental study of human and Generative AI interaction," Technology in Society, Elsevier, vol. 78(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chiarello, Filippo & Giordano, Vito & Spada, Irene & Barandoni, Simone & Fantoni, Gualtiero, 2024. "Future applications of generative large language models: A data-driven case study on ChatGPT," Technovation, Elsevier, vol. 133(C).
    2. Puccetti, Giovanni & Giordano, Vito & Spada, Irene & Chiarello, Filippo & Fantoni, Gualtiero, 2023. "Technology identification from patent texts: A novel named entity recognition method," Technological Forecasting and Social Change, Elsevier, vol. 186(PB).
    3. Montobbio, Fabio & Staccioli, Jacopo & Virgillito, Maria Enrica & Vivarelli, Marco, 2022. "Robots and the origin of their labour-saving impact," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    4. Rathi, Sawan & Majumdar, Adrija & Chatterjee, Chirantan, 2024. "Did the COVID-19 pandemic propel usage of AI in pharmaceutical innovation? New evidence from patenting data," Technological Forecasting and Social Change, Elsevier, vol. 198(C).
    5. Lu, Kun & Yang, Guancan & Wang, Xue, 2022. "Topics emerged in the biomedical field and their characteristics," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    6. Chiarello, Filippo & Fantoni, Gualtiero & Hogarth, Terence & Giordano, Vito & Baltina, Liga & Spada, Irene, 2021. "Towards ESCO 4.0 – Is the European classification of skills in line with Industry 4.0? A text mining approach," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    7. Domini, Giacomo & Grazzi, Marco & Moschella, Daniele & Treibich, Tania, 2022. "For whom the bell tolls: The firm-level effects of automation on wage and gender inequality," Research Policy, Elsevier, vol. 51(7).
    8. Borsato, Andrea & Lorentz, André, 2023. "The Kaldor–Verdoorn law at the age of robots and AI," Research Policy, Elsevier, vol. 52(10).
    9. Albanesi, Stefania & Dias da Silva, Antonio & Jimeno, Juan Francisco & Lamo, Ana & Wabitsch, Alena, 2023. "New Technologies and Jobs in Europe," CEPR Discussion Papers 18220, C.E.P.R. Discussion Papers.
    10. Li, Munan & Porter, Alan L. & Suominen, Arho & Burmaoglu, Serhat & Carley, Stephen, 2021. "An exploratory perspective to measure the emergence degree for a specific technology based on the philosophy of swarm intelligence," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    11. Cirillo, Valeria & Evangelista, Rinaldo & Guarascio, Dario & Sostero, Matteo, 2021. "Digitalization, routineness and employment: An exploration on Italian task-based data," Research Policy, Elsevier, vol. 50(7).
    12. Woo, Seokkyun & Youtie, Jan & Ott, Ingrid & Scheu, Fenja, 2021. "Understanding the long-term emergence of autonomous vehicles technologies," Technological Forecasting and Social Change, Elsevier, vol. 170(C).
    13. Nicola Cassandro & Marco Centra & Dario Guarascio & Piero Esposito, 2021. "What drives employment–unemployment transitions? Evidence from Italian task-based data," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 38(3), pages 1109-1147, October.
    14. Jung, Jin Hwa & Lim, Dong-Geon, 2020. "Industrial robots, employment growth, and labor cost: A simultaneous equation analysis," Technological Forecasting and Social Change, Elsevier, vol. 159(C).
    15. Fossen, Frank M. & Sorgner, Alina, 2022. "New digital technologies and heterogeneous wage and employment dynamics in the United States: Evidence from individual-level data," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    16. Jiang, Man & Yang, Siluo & Gao, Qiang, 2024. "Multidimensional indicators to identify emerging technologies: Perspective of technological knowledge flow," Journal of Informetrics, Elsevier, vol. 18(1).
    17. David J. Deming, 2017. "The Growing Importance of Social Skills in the Labor Market," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1593-1640.
    18. Alex Chernoff & Casey Warman, 2023. "COVID-19 and implications for automation," Applied Economics, Taylor & Francis Journals, vol. 55(17), pages 1939-1957, April.
    19. Armanda Cetrulo & Dario Guarascio & Maria Enrica Virgillito, 2020. "Anatomy of the Italian occupational structure: concentrated power and distributed knowledge," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 29(6), pages 1345-1379.
    20. Gries, Thomas & Naudé, Wim, 2022. "Modelling artificial intelligence in economics," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 56, pages 1-12.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:tefoso:v:203:y:2024:i:c:s0040162524001859. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.sciencedirect.com/science/journal/00401625 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.