IDEAS home Printed from https://ideas.repec.org/a/eee/tefoso/v203y2024ics0040162524001859.html
   My bibliography  Save this article

The impact of ChatGPT on human skills: A quantitative study on twitter data

Author

Listed:
  • Giordano, Vito
  • Spada, Irene
  • Chiarello, Filippo
  • Fantoni, Gualtiero

Abstract

The novel generative Artificial Intelligence (AI) developed by OpenAI, i.e., ChatGPT, rised a great interest in both scientific and business contexts. This new wave of technological advancement typically produces deep transformation in the workplace, requiring new skills. However, none of the studies in literature provide quantitative analysis and measures on the impact of ChatGPT on human skills. To address this gap, we collected a database of 616,073 tweets about ChatGPT, and used Natural Language Processing techniques to identify the tasks users requested ChatGPT to perform, and the sentiment related to these tasks. Then, we compared these tasks with a standard taxonomy of skills (i.e., ESCO) using BERT. The results of the study underline that ChatGPT impacts 185 different skills. Moreover, we proposed a model to represent the interaction of the user and ChatGPT, useful to define four skills which are emerging for using this new technology.

Suggested Citation

  • Giordano, Vito & Spada, Irene & Chiarello, Filippo & Fantoni, Gualtiero, 2024. "The impact of ChatGPT on human skills: A quantitative study on twitter data," Technological Forecasting and Social Change, Elsevier, vol. 203(C).
    • Handle: RePEc:eee:tefoso:v:203:y:2024:i:c:s0040162524001859
    DOI: 10.1016/j.techfore.2024.123389
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0040162524001859
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.techfore.2024.123389?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pär J. Ågerfalk, 2020. "Artificial intelligence as digital agency," European Journal of Information Systems, Taylor & Francis Journals, vol. 29(1), pages 1-8, January.
    2. Hélène Dernis & Flavio Calvino & Laurent Moussiegt & Daisuke Nawa & Lea Samek & Mariagrazia Squicciarini, 2023. "Identifying artificial intelligence actors using online data," OECD Science, Technology and Industry Working Papers 2023/01, OECD Publishing.
    3. Abadie, Amelie & Chowdhury, Soumyadeb & Mangla, Sachin Kumar, 2024. "A shared journey: Experiential perspective and empirical evidence of virtual social robot ChatGPT's priori acceptance," Technological Forecasting and Social Change, Elsevier, vol. 201(C).
    4. Daron Acemoglu & David Autor & Jonathon Hazell & Pascual Restrepo, 2022. "Artificial Intelligence and Jobs: Evidence from Online Vacancies," Journal of Labor Economics, University of Chicago Press, vol. 40(S1), pages 293-340.
    5. Rotolo, Daniele & Hicks, Diana & Martin, Ben R., 2015. "What is an emerging technology?," Research Policy, Elsevier, vol. 44(10), pages 1827-1843.
    6. Chris Stokel-Walker, 2023. "ChatGPT listed as author on research papers: many scientists disapprove," Nature, Nature, vol. 613(7945), pages 620-621, January.
    7. Kim, Kun & Park, Oun-joung & Yun, Seunghyun & Yun, Haejung, 2017. "What makes tourists feel negatively about tourism destinations? Application of hybrid text mining methodology to smart destination management," Technological Forecasting and Social Change, Elsevier, vol. 123(C), pages 362-369.
    8. Holly Else, 2023. "Abstracts written by ChatGPT fool scientists," Nature, Nature, vol. 613(7944), pages 423-423, January.
    9. Li, Xin & Wen, Yang & Jiang, Jiaojiao & Daim, Tugrul & Huang, Lucheng, 2022. "Identifying potential breakthrough research: A machine learning method using scientific papers and Twitter data," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    10. Arts, Sam & Hou, Jianan & Gomez, Juan Carlos, 2021. "Natural language processing to identify the creation and impact of new technologies in patent text: Code, data, and new measures," Research Policy, Elsevier, vol. 50(2).
    11. Colombo, Emilio & Mercorio, Fabio & Mezzanzanica, Mario, 2019. "AI meets labor market: Exploring the link between automation and skills," Information Economics and Policy, Elsevier, vol. 47(C), pages 27-37.
    12. Frey, Carl Benedikt & Osborne, Michael A., 2017. "The future of employment: How susceptible are jobs to computerisation?," Technological Forecasting and Social Change, Elsevier, vol. 114(C), pages 254-280.
    13. Dowling, Michael & Lucey, Brian, 2023. "ChatGPT for (Finance) research: The Bananarama Conjecture," Finance Research Letters, Elsevier, vol. 53(C).
    14. Montobbio, Fabio & Staccioli, Jacopo & Virgillito, Maria Enrica & Vivarelli, Marco, 2022. "Robots and the origin of their labour-saving impact," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    15. David H. Autor, 2015. "Why Are There Still So Many Jobs? The History and Future of Workplace Automation," Journal of Economic Perspectives, American Economic Association, vol. 29(3), pages 3-30, Summer.
    16. Ozcan, Sercan & Suloglu, Metin & Sakar, C. Okan & Chatufale, Sushant, 2021. "Social media mining for ideation: Identification of sustainable solutions and opinions," Technovation, Elsevier, vol. 107(C).
    17. Eva A. M. van Dis & Johan Bollen & Willem Zuidema & Robert van Rooij & Claudi L. Bockting, 2023. "ChatGPT: five priorities for research," Nature, Nature, vol. 614(7947), pages 224-226, February.
    18. Porter, Alan L. & Garner, Jon & Carley, Stephen F. & Newman, Nils C., 2019. "Emergence scoring to identify frontier R&D topics and key players," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 628-643.
    19. Kumar, Satish & Rao, Purnima & Singhania, Shubham & Verma, Shubhangi & Kheterpal, Myra, 2024. "Will artificial intelligence drive the advancements in higher education? A tri-phased exploration," Technological Forecasting and Social Change, Elsevier, vol. 201(C).
    20. Acemoglu, Daron & Autor, David, 2011. "Skills, Tasks and Technologies: Implications for Employment and Earnings," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 12, pages 1043-1171, Elsevier.
    21. Van Roy, Vincent & Vértesy, Dániel & Vivarelli, Marco, 2018. "Technology and employment: Mass unemployment or job creation? Empirical evidence from European patenting firms," Research Policy, Elsevier, vol. 47(9), pages 1762-1776.
    22. Talaei-Khoei, Amir & Yang, Alan T. & Masialeti, Masialeti, 2024. "How does incorporating ChatGPT within a firm reinforce agility-mediated performance? The moderating role of innovation infusion and firms’ ethical identity," Technovation, Elsevier, vol. 132(C).
    23. Flavio Calvino & Lea Samek & Mariagrazia Squicciarini & Cody Morris, 2022. "Identifying and characterising AI adopters: A novel approach based on big data," OECD Science, Technology and Industry Working Papers 2022/06, OECD Publishing.
    24. Moravec, Vaclav & Hynek, Nik & Skare, Marinko & Gavurova, Beata & Kubak, Matus, 2024. "Human or machine? The perception of artificial intelligence in journalism, its socio-economic conditions, and technological developments toward the digital future," Technological Forecasting and Social Change, Elsevier, vol. 200(C).
    25. Gaetano Cascini & Davide Russo, 2007. "Computer-aided analysis of patents and search for TRIZ contradictions," International Journal of Product Development, Inderscience Enterprises Ltd, vol. 4(1/2), pages 52-67.
    26. Saura, Jose Ramon & Palacios-Marqués, Daniel & Ribeiro-Soriano, Domingo, 2023. "Exploring the boundaries of open innovation: Evidence from social media mining," Technovation, Elsevier, vol. 119(C).
    27. Chris Stokel-Walker & Richard Van Noorden, 2023. "What ChatGPT and generative AI mean for science," Nature, Nature, vol. 614(7947), pages 214-216, February.
    28. Mariani, Marcello & Dwivedi, Yogesh K., 2024. "Generative artificial intelligence in innovation management: A preview of future research developments," Journal of Business Research, Elsevier, vol. 175(C).
    29. Chiarello, Filippo & Giordano, Vito & Spada, Irene & Barandoni, Simone & Fantoni, Gualtiero, 2024. "Future applications of generative large language models: A data-driven case study on ChatGPT," Technovation, Elsevier, vol. 133(C).
    30. Small, Henry & Boyack, Kevin W. & Klavans, Richard, 2014. "Identifying emerging topics in science and technology," Research Policy, Elsevier, vol. 43(8), pages 1450-1467.
    31. Icíar Dominguez Lacasa & Hariolf Grupp & Ulrich Schmoch, 2003. "Tracing technological change over long periods in Germany in chemicals using patent statistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 57(2), pages 175-195, June.
    32. Christopher Kohl & Marlene Knigge & Galina Baader & Markus Böhm & Helmut Krcmar, 2018. "Anticipating acceptance of emerging technologies using twitter: the case of self-driving cars," Journal of Business Economics, Springer, vol. 88(5), pages 617-642, July.
    33. Kayser, Victoria & Blind, Knut, 2017. "Extending the knowledge base of foresight: The contribution of text mining," Technological Forecasting and Social Change, Elsevier, vol. 116(C), pages 208-215.
    34. Kumar, Naveen & Lee, Seul Chan, 2022. "Human-machine interface in smart factory: A systematic literature review," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    35. Kim, Daewon & Kim, Suwon, 2021. "A model for user acceptance of robot journalism: Influence of positive disconfirmation and uncertainty avoidance," Technological Forecasting and Social Change, Elsevier, vol. 163(C).
    36. Puccetti, Giovanni & Giordano, Vito & Spada, Irene & Chiarello, Filippo & Fantoni, Gualtiero, 2023. "Technology identification from patent texts: A novel named entity recognition method," Technological Forecasting and Social Change, Elsevier, vol. 186(PB).
    37. Samira Ranaei & Arho Suominen & Alan Porter & Stephen Carley, 2020. "Evaluating technological emergence using text analytics: two case technologies and three approaches," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 215-247, January.
    38. Izumi Yamashita & Akiyoshi Murakami & Stephanie Cairns & Fernando Galindo-Rueda, 2021. "Measuring the AI content of government-funded R&D projects: A proof of concept for the OECD Fundstat initiative," OECD Science, Technology and Industry Working Papers 2021/09, OECD Publishing.
    39. Rice, Stephen & Crouse, Sean R. & Winter, Scott R. & Rice, Connor, 2024. "The advantages and limitations of using ChatGPT to enhance technological research," Technology in Society, Elsevier, vol. 76(C).
    40. Flavio Calvino & Luca Fontanelli, 2023. "A portrait of AI adopters across countries: Firm characteristics, assets’ complementarities and productivity," OECD Science, Technology and Industry Working Papers 2023/02, OECD Publishing.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chiarello, Filippo & Giordano, Vito & Spada, Irene & Barandoni, Simone & Fantoni, Gualtiero, 2024. "Future applications of generative large language models: A data-driven case study on ChatGPT," Technovation, Elsevier, vol. 133(C).
    2. Puccetti, Giovanni & Giordano, Vito & Spada, Irene & Chiarello, Filippo & Fantoni, Gualtiero, 2023. "Technology identification from patent texts: A novel named entity recognition method," Technological Forecasting and Social Change, Elsevier, vol. 186(PB).
    3. Montobbio, Fabio & Staccioli, Jacopo & Virgillito, Maria Enrica & Vivarelli, Marco, 2022. "Robots and the origin of their labour-saving impact," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    4. Rathi, Sawan & Majumdar, Adrija & Chatterjee, Chirantan, 2024. "Did the COVID-19 pandemic propel usage of AI in pharmaceutical innovation? New evidence from patenting data," Technological Forecasting and Social Change, Elsevier, vol. 198(C).
    5. Lu, Kun & Yang, Guancan & Wang, Xue, 2022. "Topics emerged in the biomedical field and their characteristics," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    6. Chiarello, Filippo & Fantoni, Gualtiero & Hogarth, Terence & Giordano, Vito & Baltina, Liga & Spada, Irene, 2021. "Towards ESCO 4.0 – Is the European classification of skills in line with Industry 4.0? A text mining approach," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    7. Jung, Jin Hwa & Lim, Dong-Geon, 2020. "Industrial robots, employment growth, and labor cost: A simultaneous equation analysis," Technological Forecasting and Social Change, Elsevier, vol. 159(C).
    8. Domini, Giacomo & Grazzi, Marco & Moschella, Daniele & Treibich, Tania, 2022. "For whom the bell tolls: The firm-level effects of automation on wage and gender inequality," Research Policy, Elsevier, vol. 51(7).
    9. Borsato, Andrea & Lorentz, André, 2023. "The Kaldor–Verdoorn law at the age of robots and AI," Research Policy, Elsevier, vol. 52(10).
    10. Albanesi, Stefania & Dias da Silva, Antonio & Jimeno, Juan Francisco & Lamo, Ana & Wabitsch, Alena, 2023. "New Technologies and Jobs in Europe," CEPR Discussion Papers 18220, C.E.P.R. Discussion Papers.
    11. Fossen, Frank M. & Sorgner, Alina, 2022. "New digital technologies and heterogeneous wage and employment dynamics in the United States: Evidence from individual-level data," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    12. Nicola Cassandro & Marco Centra & Dario Guarascio & Piero Esposito, 2021. "What drives employment–unemployment transitions? Evidence from Italian task-based data," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 38(3), pages 1109-1147, October.
    13. Li, Munan & Porter, Alan L. & Suominen, Arho & Burmaoglu, Serhat & Carley, Stephen, 2021. "An exploratory perspective to measure the emergence degree for a specific technology based on the philosophy of swarm intelligence," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    14. Cirillo, Valeria & Evangelista, Rinaldo & Guarascio, Dario & Sostero, Matteo, 2021. "Digitalization, routineness and employment: An exploration on Italian task-based data," Research Policy, Elsevier, vol. 50(7).
    15. Woo, Seokkyun & Youtie, Jan & Ott, Ingrid & Scheu, Fenja, 2021. "Understanding the long-term emergence of autonomous vehicles technologies," Technological Forecasting and Social Change, Elsevier, vol. 170(C).
    16. Jiang, Man & Yang, Siluo & Gao, Qiang, 2024. "Multidimensional indicators to identify emerging technologies: Perspective of technological knowledge flow," Journal of Informetrics, Elsevier, vol. 18(1).
    17. Ayhan, Fatih & Elal, Onuray, 2023. "The IMPACTS of technological change on employment: Evidence from OECD countries with panel data analysis," Technological Forecasting and Social Change, Elsevier, vol. 190(C).
    18. Caitlin Allen Whitehead & Haroon Bhorat & Robert Hill & Tim Köhler & François Steenkamp, 2021. "The Potential Employment Implications of the Fourth Industrial Revolution Technologies: The Case of the Manufacturing, Engineering and Related Services Sector," Working Papers 202106, University of Cape Town, Development Policy Research Unit.
    19. David J. Deming, 2017. "The Growing Importance of Social Skills in the Labor Market," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1593-1640.
    20. Alex Chernoff & Casey Warman, 2023. "COVID-19 and implications for automation," Applied Economics, Taylor & Francis Journals, vol. 55(17), pages 1939-1957, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:tefoso:v:203:y:2024:i:c:s0040162524001859. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.sciencedirect.com/science/journal/00401625 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.