IDEAS home Printed from https://ideas.repec.org/a/eee/techno/v133y2024ics016649722400052x.html
   My bibliography  Save this article

Future applications of generative large language models: A data-driven case study on ChatGPT

Author

Listed:
  • Chiarello, Filippo
  • Giordano, Vito
  • Spada, Irene
  • Barandoni, Simone
  • Fantoni, Gualtiero

Abstract

This study delves into the evolving role of generative Large Language Models (LLMs). We develop a data-driven approach to collect and analyse tasks that users are asking to generative LLMs. Thanks to the focus on tasks this paper contributes to give a quantitative and granular understanding of the potential influence of LLMs in different business areas. Utilizing a dataset comprising over 3.8 million tweets, we identify and cluster 31,747 unique tasks, with a specific case study on ChatGPT. To reach this goal, the proposed method combines two Natural Language Processing (NLP) Techniques, Named Entity Recognition (NER) and BERTopic. The combination makes it possible to collect granular tasks of LLMs (NER) and clusters them in business areas (BERTopic). Our findings reveal a wide spectrum of applications, from programming assistance to creative content generation, highlighting LLM's versatility. The analysis highlighted six emerging areas of application for ChatGPT: human resources, programming, social media, office automation, search engines, education. The study also examines the implications of these findings for innovation management, proposing a research agenda to explore the intersection of the identified areas, with four stages of the innovation process: idea generation, screening/idea selection, development, and diffusion/sales/marketing.

Suggested Citation

  • Chiarello, Filippo & Giordano, Vito & Spada, Irene & Barandoni, Simone & Fantoni, Gualtiero, 2024. "Future applications of generative large language models: A data-driven case study on ChatGPT," Technovation, Elsevier, vol. 133(C).
    • Handle: RePEc:eee:techno:v:133:y:2024:i:c:s016649722400052x
    DOI: 10.1016/j.technovation.2024.103002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S016649722400052X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.technovation.2024.103002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cho, Jaehan & DeStefano, Timothy & Kim, Hanhin & Kim, Inchul & Paik, Jin Hyun, 2023. "What's driving the diffusion of next-generation digital technologies?," Technovation, Elsevier, vol. 119(C).
    2. Janghyeok Yoon & Hyunseok Park & Kwangsoo Kim, 2013. "Identifying technological competition trends for R&D planning using dynamic patent maps: SAO-based content analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 313-331, January.
    3. Eric von Hippel, 1986. "Lead Users: A Source of Novel Product Concepts," Management Science, INFORMS, vol. 32(7), pages 791-805, July.
    4. Chris Stokel-Walker, 2023. "ChatGPT listed as author on research papers: many scientists disapprove," Nature, Nature, vol. 613(7945), pages 620-621, January.
    5. Li, Xin & Wen, Yang & Jiang, Jiaojiao & Daim, Tugrul & Huang, Lucheng, 2022. "Identifying potential breakthrough research: A machine learning method using scientific papers and Twitter data," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    6. Arts, Sam & Hou, Jianan & Gomez, Juan Carlos, 2021. "Natural language processing to identify the creation and impact of new technologies in patent text: Code, data, and new measures," Research Policy, Elsevier, vol. 50(2).
    7. Li, Xin & Xie, Qianqian & Jiang, Jiaojiao & Zhou, Yuan & Huang, Lucheng, 2019. "Identifying and monitoring the development trends of emerging technologies using patent analysis and Twitter data mining: The case of perovskite solar cell technology," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 687-705.
    8. Porter, Alan L. & Garner, Jon & Carley, Stephen F. & Newman, Nils C., 2019. "Emergence scoring to identify frontier R&D topics and key players," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 628-643.
    9. Robert D. Dewar & Jane E. Dutton, 1986. "The Adoption of Radical and Incremental Innovations: An Empirical Analysis," Management Science, INFORMS, vol. 32(11), pages 1422-1433, November.
    10. Mariani, Marcello M. & Machado, Isa & Magrelli, Vittoria & Dwivedi, Yogesh K., 2023. "Artificial intelligence in innovation research: A systematic review, conceptual framework, and future research directions," Technovation, Elsevier, vol. 122(C).
    11. Ameye, Nicolas & Bughin, Jacques & van Zeebroeck, Nicolas, 2023. "How uncertainty shapes herding in the corporate use of artificial intelligence technology," Technovation, Elsevier, vol. 127(C).
    12. Eric Abrahamson & Lori Rosenkopf, 1997. "Social Network Effects on the Extent of Innovation Diffusion: A Computer Simulation," Organization Science, INFORMS, vol. 8(3), pages 289-309, June.
    13. Small, Henry & Boyack, Kevin W. & Klavans, Richard, 2014. "Identifying emerging topics in science and technology," Research Policy, Elsevier, vol. 43(8), pages 1450-1467.
    14. Icíar Dominguez Lacasa & Hariolf Grupp & Ulrich Schmoch, 2003. "Tracing technological change over long periods in Germany in chemicals using patent statistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 57(2), pages 175-195, June.
    15. Rotolo, Daniele & Hicks, Diana & Martin, Ben R., 2015. "What is an emerging technology?," Research Policy, Elsevier, vol. 44(10), pages 1827-1843.
    16. Samira Ranaei & Arho Suominen & Alan Porter & Stephen Carley, 2020. "Evaluating technological emergence using text analytics: two case technologies and three approaches," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 215-247, January.
    17. Abadie, Amelie & Chowdhury, Soumyadeb & Mangla, Sachin Kumar, 2024. "A shared journey: Experiential perspective and empirical evidence of virtual social robot ChatGPT's priori acceptance," Technological Forecasting and Social Change, Elsevier, vol. 201(C).
    18. Holly Else, 2023. "Abstracts written by ChatGPT fool scientists," Nature, Nature, vol. 613(7944), pages 423-423, January.
    19. Spyros Makridakis & Fotios Petropoulos & Yanfei Kang, 2023. "Large Language Models: Their Success and Impact," Forecasting, MDPI, vol. 5(3), pages 1-14, August.
    20. Hong, Suckwon & Kim, Juram & Woo, Han-Gyun & Kim, Young-Choon & Lee, Changyong, 2022. "Screening ideas in the early stages of technology development: A word2vec and convolutional neural network approach," Technovation, Elsevier, vol. 112(C).
    21. Just, Julian, 2024. "Natural language processing for innovation search – Reviewing an emerging non-human innovation intermediary," Technovation, Elsevier, vol. 129(C).
    22. Hofmann, Peter & Keller, Robert & Urbach, Nils, 2019. "Inter-technology relationship networks: Arranging technologies through text mining," Technological Forecasting and Social Change, Elsevier, vol. 143(C), pages 202-213.
    23. Ozcan, Sercan & Suloglu, Metin & Sakar, C. Okan & Chatufale, Sushant, 2021. "Social media mining for ideation: Identification of sustainable solutions and opinions," Technovation, Elsevier, vol. 107(C).
    24. Eva A. M. van Dis & Johan Bollen & Willem Zuidema & Robert van Rooij & Claudi L. Bockting, 2023. "ChatGPT: five priorities for research," Nature, Nature, vol. 614(7947), pages 224-226, February.
    25. Hannigan, Timothy R. & Briggs, Anthony R. & Valadao, Rodrigo & Seidel, Marc-David L. & Jennings, P. Devereaux, 2022. "A new tool for policymakers: Mapping cultural possibilities in an emerging AI entrepreneurial ecosystem," Research Policy, Elsevier, vol. 51(9).
    26. Jeon, Eunji & Yoon, Naeun & Sohn, So Young, 2023. "Exploring new digital therapeutics technologies for psychiatric disorders using BERTopic and PatentSBERTa," Technological Forecasting and Social Change, Elsevier, vol. 186(PA).
    27. Andrea Bonaccorsi & Filippo Chiarello & Gualtiero Fantoni, 2021. "Impact for whom? Mapping the users of public research with lexicon-based text mining," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1745-1774, February.
    28. Katharine Sanderson, 2023. "GPT-4 is here: what scientists think," Nature, Nature, vol. 615(7954), pages 773-773, March.
    29. Kaplan, Andreas M. & Haenlein, Michael, 2016. "Higher education and the digital revolution: About MOOCs, SPOCs, social media, and the Cookie Monster," Business Horizons, Elsevier, vol. 59(4), pages 441-450.
    30. Christopher Kohl & Marlene Knigge & Galina Baader & Markus Böhm & Helmut Krcmar, 2018. "Anticipating acceptance of emerging technologies using twitter: the case of self-driving cars," Journal of Business Economics, Springer, vol. 88(5), pages 617-642, July.
    31. Ali, Omar & Murray, Peter A. & Momin, Mujtaba & Dwivedi, Yogesh K. & Malik, Tegwen, 2024. "The effects of artificial intelligence applications in educational settings: Challenges and strategies," Technological Forecasting and Social Change, Elsevier, vol. 199(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Giordano, Vito & Spada, Irene & Chiarello, Filippo & Fantoni, Gualtiero, 2024. "The impact of ChatGPT on human skills: A quantitative study on twitter data," Technological Forecasting and Social Change, Elsevier, vol. 203(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giordano, Vito & Spada, Irene & Chiarello, Filippo & Fantoni, Gualtiero, 2024. "The impact of ChatGPT on human skills: A quantitative study on twitter data," Technological Forecasting and Social Change, Elsevier, vol. 203(C).
    2. Puccetti, Giovanni & Giordano, Vito & Spada, Irene & Chiarello, Filippo & Fantoni, Gualtiero, 2023. "Technology identification from patent texts: A novel named entity recognition method," Technological Forecasting and Social Change, Elsevier, vol. 186(PB).
    3. Lu, Kun & Yang, Guancan & Wang, Xue, 2022. "Topics emerged in the biomedical field and their characteristics," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    4. Li, Munan & Porter, Alan L. & Suominen, Arho & Burmaoglu, Serhat & Carley, Stephen, 2021. "An exploratory perspective to measure the emergence degree for a specific technology based on the philosophy of swarm intelligence," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    5. Woo, Seokkyun & Youtie, Jan & Ott, Ingrid & Scheu, Fenja, 2021. "Understanding the long-term emergence of autonomous vehicles technologies," Technological Forecasting and Social Change, Elsevier, vol. 170(C).
    6. Jiang, Man & Yang, Siluo & Gao, Qiang, 2024. "Multidimensional indicators to identify emerging technologies: Perspective of technological knowledge flow," Journal of Informetrics, Elsevier, vol. 18(1).
    7. Peter Sjögårde & Fereshteh Didegah, 2022. "The association between topic growth and citation impact of research publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1903-1921, April.
    8. Li, Xin & Xie, Qianqian & Jiang, Jiaojiao & Zhou, Yuan & Huang, Lucheng, 2019. "Identifying and monitoring the development trends of emerging technologies using patent analysis and Twitter data mining: The case of perovskite solar cell technology," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 687-705.
    9. Alin ZAMFIROIU & Denisa VASILE & Daniel SAVU, 2023. "ChatGPT – A Systematic Review of Published Research Papers," Informatica Economica, Academy of Economic Studies - Bucharest, Romania, vol. 27(1), pages 5-16.
    10. Xu, Shuo & Hao, Liyuan & Yang, Guancan & Lu, Kun & An, Xin, 2021. "A topic models based framework for detecting and forecasting emerging technologies," Technological Forecasting and Social Change, Elsevier, vol. 162(C).
    11. Amber Geurts & Ralph Gutknecht & Philine Warnke & Arjen Goetheer & Elna Schirrmeister & Babette Bakker & Svetlana Meissner, 2022. "New perspectives for data‐supported foresight: The hybrid AI‐expert approach," Futures & Foresight Science, John Wiley & Sons, vol. 4(1), March.
    12. Porter, Alan L. & Garner, Jon & Carley, Stephen F. & Newman, Nils C., 2019. "Emergence scoring to identify frontier R&D topics and key players," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 628-643.
    13. Peres, Renana & Schreier, Martin & Schweidel, David & Sorescu, Alina, 2023. "On ChatGPT and beyond: How generative artificial intelligence may affect research, teaching, and practice," International Journal of Research in Marketing, Elsevier, vol. 40(2), pages 269-275.
    14. Gozuacik, Necip & Sakar, C. Okan & Ozcan, Sercan, 2023. "Technological forecasting based on estimation of word embedding matrix using LSTM networks," Technological Forecasting and Social Change, Elsevier, vol. 191(C).
    15. Just, Julian, 2024. "Natural language processing for innovation search – Reviewing an emerging non-human innovation intermediary," Technovation, Elsevier, vol. 129(C).
    16. Li, Munan & Wang, Wenshu & Zhou, Keyu, 2021. "Exploring the technology emergence related to artificial intelligence: A perspective of coupling analyses," Technological Forecasting and Social Change, Elsevier, vol. 172(C).
    17. Waßenhoven, Anna & Rennings, Michael & Laibach, Natalie & Bröring, Stefanie, 2023. "What constitutes a “Key Enabling Technology” for transition processes: Insights from the bioeconomy's technological landscape," Technological Forecasting and Social Change, Elsevier, vol. 197(C).
    18. Xu, Haiyun & Winnink, Jos & Yue, Zenghui & Zhang, Huiling & Pang, Hongshen, 2021. "Multidimensional Scientometric indicators for the detection of emerging research topics," Technological Forecasting and Social Change, Elsevier, vol. 163(C).
    19. Moehrle, Martin G. & Caferoglu, Hüseyin, 2019. "Technological speciation as a source for emerging technologies. Using semantic patent analysis for the case of camera technology," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 776-784.
    20. Park, Inchae & Triulzi, Giorgio & Magee, Christopher L., 2022. "Tracing the emergence of new technology: A comparative analysis of five technological domains," Technological Forecasting and Social Change, Elsevier, vol. 184(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:techno:v:133:y:2024:i:c:s016649722400052x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.sciencedirect.com/science/journal/01664972 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.