IDEAS home Printed from https://ideas.repec.org/a/bla/sysdyn/v40y2024i3ne1773.html
   My bibliography  Save this article

Generative AI and simulation modeling: how should you (not) use large language models like ChatGPT

Author

Listed:
  • Ali Akhavan
  • Mohammad S. Jalali

Abstract

Generative Artificial Intelligence (AI) tools, such as Large Language Models (LLMs) and chatbots like ChatGPT, hold promise for advancing simulation modeling. Despite their growing prominence and associated debates, there remains a gap in comprehending the potential of generative AI in this field and a lack of guidelines for its effective deployment. This article endeavors to bridge these gaps. We discuss the applications of ChatGPT through an example of modeling COVID‐19's impact on economic growth in the United States. However, our guidelines are generic and can be applied to a broader range of generative AI tools. Our work presents a systematic approach for integrating generative AI across the simulation research continuum, from problem articulation to insight derivation and documentation, independent of the specific simulation modeling method. We emphasize while these tools offer enhancements in refining ideas and expediting processes, they should complement rather than replace critical thinking inherent to research. © 2024 The Authors. System Dynamics Review published by John Wiley & Sons Ltd on behalf of System Dynamics Society.

Suggested Citation

  • Ali Akhavan & Mohammad S. Jalali, 2024. "Generative AI and simulation modeling: how should you (not) use large language models like ChatGPT," System Dynamics Review, System Dynamics Society, vol. 40(3), July.
    • Handle: RePEc:bla:sysdyn:v:40:y:2024:i:3:n:e1773
    DOI: 10.1002/sdr.1773
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/sdr.1773
    Download Restriction: no
    File URL: https://libkey.io/10.1002/sdr.1773?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Thomas Monks & Christine S. M. Currie & Bhakti Stephan Onggo & Stewart Robinson & Martin Kunc & Simon J. E. Taylor, 2019. "Strengthening the reporting of empirical simulation studies: Introducing the STRESS guidelines," Journal of Simulation, Taylor & Francis Journals, vol. 13(1), pages 55-67, January.
    2. Chris Stokel-Walker & Richard Van Noorden, 2023. "What ChatGPT and generative AI mean for science," Nature, Nature, vol. 614(7947), pages 214-216, February.
    3. Richard Van Noorden & Richard Webb, 2023. "ChatGPT and science: the AI system was a force in 2023 — for good and bad," Nature, Nature, vol. 624(7992), pages 509-509, December.
    4. Dowling, Michael & Lucey, Brian, 2023. "ChatGPT for (Finance) research: The Bananarama Conjecture," Finance Research Letters, Elsevier, vol. 53(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wahyono, Budi & Rapih, Subroto & Boungou, Whelsy, 2023. "Unleashing the wordsmith: Analysing the stock market reactions to the launch of ChatGPT in the US Education sector," Finance Research Letters, Elsevier, vol. 58(PC).
    2. Giordano, Vito & Spada, Irene & Chiarello, Filippo & Fantoni, Gualtiero, 2024. "The impact of ChatGPT on human skills: A quantitative study on twitter data," Technological Forecasting and Social Change, Elsevier, vol. 203(C).
    3. Rice, Stephen & Crouse, Sean R. & Winter, Scott R. & Rice, Connor, 2024. "The advantages and limitations of using ChatGPT to enhance technological research," Technology in Society, Elsevier, vol. 76(C).
    4. Turgut Karakose & Murat Demirkol & Ramazan Yirci & Hakan Polat & Tuncay Yavuz Ozdemir & Tijen Tülübaş, 2023. "A Conversation with ChatGPT about Digital Leadership and Technology Integration: Comparative Analysis Based on Human–AI Collaboration," Administrative Sciences, MDPI, vol. 13(7), pages 1-19, June.
    5. Nguyen, Le Khanh Ngan & Howick, Susan & Megiddo, Itamar, 2024. "A framework for conceptualising hybrid system dynamics and agent-based simulation models," European Journal of Operational Research, Elsevier, vol. 315(3), pages 1153-1166.
    6. Smales, Lee A., 2023. "Classification of RBA monetary policy announcements using ChatGPT," Finance Research Letters, Elsevier, vol. 58(PC).
    7. Ion-Danut LIXANDRU, 2024. "The Use of Artificial Intelligence for Qualitative Data Analysis: ChatGPT," Informatica Economica, Academy of Economic Studies - Bucharest, Romania, vol. 28(1), pages 57-67.
    8. Hoffmann, Stefan & Lasarov, Wassili & Dwivedi, Yogesh K., 2024. "AI-empowered scale development: Testing the potential of ChatGPT," Technological Forecasting and Social Change, Elsevier, vol. 205(C).
    9. Muhammad Tahir & Sufyan Ali & Ayesha Sohail & Ying Zhang & Xiaohua Jin, 2024. "Unlocking Online Insights: LSTM Exploration and Transfer Learning Prospects," Annals of Data Science, Springer, vol. 11(4), pages 1421-1434, August.
    10. Hassnian Ali & Ahmet Faruk Aysan, 2023. "What will ChatGPT revolutionize in the financial industry?," Modern Finance, Modern Finance Institute, vol. 1(1), pages 116-129.
    11. Xing, Yunfei & Zhang, Justin Zuopeng & Teng, Guangqing & Zhou, Xiaotang, 2024. "Voices in the digital storm: Unraveling online polarization with ChatGPT," Technology in Society, Elsevier, vol. 77(C).
    12. Amina Badreddine & Hadjira Larbi Cherif, 2023. "ChatGPT in Academic Research: Demonstrating Limitations through Real Practical Examples," Post-Print hal-04379581, HAL.
    13. Alonso-Robisco, Andres & Carbó, José Manuel, 2023. "Analysis of CBDC narrative by central banks using large language models," Finance Research Letters, Elsevier, vol. 58(PC).
    14. Thomas, Asha & Duggal, Harshleen Kaur & Khatri, Puja & Corvello, Vincenzo, 2024. "ChatGPT appropriation: A catalyst for creative performance, innovation orientation, and agile leadership," Technology in Society, Elsevier, vol. 78(C).
    15. Christian Fieberg & Lars Hornuf & David J. Streich, 2023. "Using GPT-4 for Financial Advice," CESifo Working Paper Series 10529, CESifo.
    16. Jeong, Woojin & Park, Seongwan & Lee, Seungyun & Son, Bumho & Lee, Jaewook & Ko, Hyungjin, 2024. "Influence and predictive power of sentiment: Evidence from the lithium market," Finance Research Letters, Elsevier, vol. 68(C).
    17. Chong Lan & Yongsheng Wang & Chengze Wang & Shirong Song & Zheng Gong, 2023. "Application of ChatGPT-Based Digital Human in Animation Creation," Future Internet, MDPI, vol. 15(9), pages 1-18, September.
    18. Brady D. Lund & Ting Wang & Nishith Reddy Mannuru & Bing Nie & Somipam Shimray & Ziang Wang, 2023. "ChatGPT and a new academic reality: Artificial Intelligence‐written research papers and the ethics of the large language models in scholarly publishing," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(5), pages 570-581, May.
    19. Manu Suvarna & Alain Claude Vaucher & Sharon Mitchell & Teodoro Laino & Javier Pérez-Ramírez, 2023. "Language models and protocol standardization guidelines for accelerating synthesis planning in heterogeneous catalysis," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    20. Talaei-Khoei, Amir & Yang, Alan T. & Masialeti, Masialeti, 2024. "How does incorporating ChatGPT within a firm reinforce agility-mediated performance? The moderating role of innovation infusion and firms’ ethical identity," Technovation, Elsevier, vol. 132(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:sysdyn:v:40:y:2024:i:3:n:e1773. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1111/0883-7066 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.