IDEAS home Printed from https://ideas.repec.org/a/bla/sysdyn/v40y2024i4ne1781.html
   My bibliography  Save this article

Are we there yet? Saturation analysis as a foundation for confidence in system dynamics modeling, applied to a conceptualization process using qualitative data

Author

Listed:
  • Andrada Tomoaia‐Cotisel
  • Samuel D. Allen
  • Hyunjung Kim
  • David F. Andersen
  • Nabeel Qureshi
  • Zaid Chalabi

Abstract

Saturation is a useful concept for system dynamics, yet it has not been widely explored or integrated into the modeling process. In this article, we describe saturation as a metaphor describing the point at which a conceptual representation of a system meets the study purpose and no longer requires modification. When saturation is reached, additional data about the problem would not offer added information, thus indicating that additional data gathering and analysis would likely be redundant. We discuss two visualization techniques, “saturation curves” and “shared understanding diagrams,” for assessing saturation when conceptualizing with causal loop diagrams and show their application in a case example. Using saturation analysis during a system dynamics research process has many advantages, including: (i) identifying model structures potentially needing revisions, (ii) observing the extent to which evidence supports the current conceptualization, (iii) reflecting extensively, (iv) documenting important modeling decisions, and (v) potentially improving the problem statement. © 2024 The Author(s). System Dynamics Review published by John Wiley & Sons Ltd on behalf of System Dynamics Society.

Suggested Citation

  • Andrada Tomoaia‐Cotisel & Samuel D. Allen & Hyunjung Kim & David F. Andersen & Nabeel Qureshi & Zaid Chalabi, 2024. "Are we there yet? Saturation analysis as a foundation for confidence in system dynamics modeling, applied to a conceptualization process using qualitative data," System Dynamics Review, System Dynamics Society, vol. 40(4), October.
  • Handle: RePEc:bla:sysdyn:v:40:y:2024:i:4:n:e1781
    DOI: 10.1002/sdr.1781
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/sdr.1781
    Download Restriction: no

    File URL: https://libkey.io/10.1002/sdr.1781?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Eduard Romanenko & Jack Homer & Nanna Lien, 2023. "As simple as possible but not simpler: structural sensitivity testing of a dynamic model of adolescent overweight and obesity," System Dynamics Review, System Dynamics Society, vol. 39(2), pages 125-139, April.
    2. Warren W. Farr & Samuel D. Allen & Andrada Tomoaia‐Cotisel & Peter S. Hovmand, 2022. "Documenting the modeling process with a standardized data structure described and implemented in DynamicVu," System Dynamics Review, System Dynamics Society, vol. 38(3), pages 264-291, July.
    3. David C. Lane & Özge Pala & Yaman Barlas & David C. Lane, 2015. "Validity is a Matter of Confidence—But Not Just in System Dynamics," Systems Research and Behavioral Science, Wiley Blackwell, vol. 32(4), pages 450-458, July.
    4. John Sterman, 2018. "System dynamics at sixty: the path forward," System Dynamics Review, System Dynamics Society, vol. 34(1-2), pages 5-47, January.
    5. Isaacs, Williams & Senge, Peter, 1992. "Overcoming limits to learning in computer-based learning environments," European Journal of Operational Research, Elsevier, vol. 59(1), pages 183-196, May.
    6. G P Richardson, 1999. "Reflections for the future of system dynamics," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 50(4), pages 440-449, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrada Tomoaia‐Cotisel & Samuel D. Allen & Hyunjung Kim & David Andersen & Zaid Chalabi, 2022. "Rigorously interpreted quotation analysis for evaluating causal loop diagrams in late‐stage conceptualization," System Dynamics Review, System Dynamics Society, vol. 38(1), pages 41-80, January.
    2. Guido A. Veldhuis & Eefje M. Smits‐Clijsen & Rob P.M. van Waas, 2024. "Techniques to enhance the public policy impact of qualitative system dynamics models," System Dynamics Review, System Dynamics Society, vol. 40(4), October.
    3. Jiangbo Yu, 2022. "An elementary mechanism for simultaneously modeling discrete decisions and decision times," System Dynamics Review, System Dynamics Society, vol. 38(3), pages 215-245, July.
    4. Florian Kapmeier, 2020. "Reflections on developing a simulation model on sustainable and healthy diets for decision makers: Comment on the paper by Kopainsky," Systems Research and Behavioral Science, Wiley Blackwell, vol. 37(6), pages 928-935, November.
    5. Guido A. Veldhuis & Dominique Blok & Maaike H.T. de Boer & Gino J. Kalkman & Roos M. Bakker & Rob P.M. van Waas, 2024. "From text to model: Leveraging natural language processing for system dynamics model development," System Dynamics Review, System Dynamics Society, vol. 40(3), July.
    6. Claire F. Brereton & Paul Jagals, 2021. "Applications of Systems Science to Understand and Manage Multiple Influences within Children’s Environmental Health in Least Developed Countries: A Causal Loop Diagram Approach," IJERPH, MDPI, vol. 18(6), pages 1-23, March.
    7. Igor Krejčí & Pavel Moulis & Jana Pitrová & Ivana Tichá & Ladislav Pilař & Jan Rydval, 2019. "Traps and Opportunities of Czech Small-Scale Beef Cattle Farming," Sustainability, MDPI, vol. 11(15), pages 1-26, August.
    8. Benjamin L. Turner & Melissa Wuellner & Erin Cortus & Steven Boot Chumbley, 2022. "A multi‐university cohort model for teaching complex and interdisciplinary problem‐solving using system dynamics," Systems Research and Behavioral Science, Wiley Blackwell, vol. 39(2), pages 185-199, March.
    9. Benjamin L. Turner & Michael Goodman, 2024. "Capturing the science behind the craft: a reporting framework to improve quality and confidence in nonsimulated models," System Dynamics Review, System Dynamics Society, vol. 40(4), October.
    10. George P. Richardson, 2024. "Building confidence in exploratory models," System Dynamics Review, System Dynamics Society, vol. 40(4), October.
    11. Lopes, Rita & Videira, Nuno, 2017. "Modelling feedback processes underpinning management of ecosystem services: The role of participatory systems mapping," Ecosystem Services, Elsevier, vol. 28(PA), pages 28-42.
    12. Justin D. Connolly & Graeme J. Doole, 2024. "An analysis of participants' introductory experience with causal loop diagrams (CLDs) using group model building (GMB) scripts," System Dynamics Review, System Dynamics Society, vol. 40(4), October.
    13. Eduard Romanenko & Jack Homer & Nanna Lien, 2023. "As simple as possible but not simpler: structural sensitivity testing of a dynamic model of adolescent overweight and obesity," System Dynamics Review, System Dynamics Society, vol. 39(2), pages 125-139, April.
    14. Miles M. Yang & Hong Jiang & Michael Shayne Gary, 2016. "Challenging learning goals improve performance in dynamically complex microworld simulations," System Dynamics Review, System Dynamics Society, vol. 32(3-4), pages 204-232, July.
    15. Milad Mousavian, H. & Hamed Shakouri, G. & Mashayekhi, Ali-Naghi & Kazemi, Aliyeh, 2020. "Does the short-term boost of renewable energies guarantee their stable long-term growth? Assessment of the dynamics of feed-in tariff policy," Renewable Energy, Elsevier, vol. 159(C), pages 1252-1268.
    16. Rameez R. Qureshi & David N. Ford & Charles M. Wolf, 2024. "Descriptive design structure matrices for improved system dynamics qualitative modeling," System Dynamics Review, System Dynamics Society, vol. 40(4), October.
    17. Camilo Olaya, 2015. "Cows, agency, and the significance of operational thinking," System Dynamics Review, System Dynamics Society, vol. 31(4), pages 183-219, October.
    18. Stankov, Ivana & Useche, Andres Felipe & Meisel, Jose D. & Montes, Felipe & Morais, Lidia MO. & Friche, Amelia AL. & Langellier, Brent A. & Hovmand, Peter & Sarmiento, Olga Lucia & Hammond, Ross A. & , 2021. "From causal loop diagrams to future scenarios: Using the cross-impact balance method to augment understanding of urban health in Latin America," Social Science & Medicine, Elsevier, vol. 282(C).
    19. Negar Darabi & Niyousha Hosseinichimeh, 2020. "System dynamics modeling in health and medicine: a systematic literature review," System Dynamics Review, System Dynamics Society, vol. 36(1), pages 29-73, January.
    20. Merla Kubli, 2020. "Navigating through the unknown: How conjoint analysis reduces uncertainty in energy consumer modelling," Systems Research and Behavioral Science, Wiley Blackwell, vol. 37(6), pages 880-885, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:sysdyn:v:40:y:2024:i:4:n:e1781. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1111/0883-7066 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.