IDEAS home Printed from https://ideas.repec.org/a/bla/sysdyn/v36y2020i2p135-157.html
   My bibliography  Save this article

Assessing the efficacy of group model building workshops in an applied setting through purposive text analysis

Author

Listed:
  • Nicholas Valcourt
  • Jeffrey Walters
  • Amy Javernick‐Will
  • Karl Linden

Abstract

Group model building (GMB) approaches have been shown to improve participants' understanding of complexity by shifting and aligning individuals' mental models of the interconnections within complex systems. However, reviews of GMB literature have identified knowledge gaps for assessing the efficacy of GMB activities. To address these gaps, these studies recommend assessing multiple cases, shifting from controlled to applied settings, and reporting on objective measures. We address each of these items by comparing the outputs of multiple community‐based GMB workshops to participants' mental models elicited through pre‐workshop interviews. Using purposive text analysis, we developed causal loop diagrams for comparison to a group workshop model. Through a quantitative analysis, we find that individuals convened in GMB workshops have greater alignment on factors, causal links, and feedback. We believe these contributions can help other GMB practitioners better assess the efficacy of their activities with more rigor and detail. © 2020 System Dynamics Society

Suggested Citation

  • Nicholas Valcourt & Jeffrey Walters & Amy Javernick‐Will & Karl Linden, 2020. "Assessing the efficacy of group model building workshops in an applied setting through purposive text analysis," System Dynamics Review, System Dynamics Society, vol. 36(2), pages 135-157, April.
    • Handle: RePEc:bla:sysdyn:v:36:y:2020:i:2:p:135-157
    DOI: 10.1002/sdr.1657
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/sdr.1657
    Download Restriction: no
    File URL: https://libkey.io/10.1002/sdr.1657?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Walters, Jeffrey P. & Chinowsky, Paul S., 2016. "Planning rural water services in Nicaragua: A systems-based analysis of impact factors using graphical modeling," Environmental Science & Policy, Elsevier, vol. 57(C), pages 93-100.
    2. Kate Neely & Jeffrey P. Walters, 2016. "Using Causal Loop Diagramming to Explore the Drivers of the Sustained Functionality of Rural Water Services in Timor-Leste," Sustainability, MDPI, vol. 8(1), pages 1-18, January.
    3. repec:dau:papers:123456789/5035 is not listed on IDEAS
    4. Michel G. Bougon, 1992. "Congregate Cognitive Maps: A Unified Dynamic Theory Of Organization And Strategy," Journal of Management Studies, Wiley Blackwell, vol. 29(3), pages 369-387, May.
    5. Céline Bérard, 2010. "Group model building using system dynamics: an analysis of methodological frameworks," Post-Print halshs-00519039, HAL.
    6. Martin Schaffernicht, 2019. "Unrecognized interdependencies in mental models—The case for taking feedback loops into account," Systems Research and Behavioral Science, Wiley Blackwell, vol. 36(4), pages 580-603, July.
    7. Etienne Rouwette & Ingrid Bastings & Hans Blokker, 2011. "A Comparison of Group Model Building and Strategic Options Development and Analysis," Group Decision and Negotiation, Springer, vol. 20(6), pages 781-803, November.
    8. Etiënne A. J. A. Rouwette, 2012. "Does Group Model Building Work? Evidence from and Comments on the Paper by Videira et al," Systems Research and Behavioral Science, Wiley Blackwell, vol. 29(6), pages 620-623, November.
    9. Krystyna Stave & Michael Dwyer & Marcia Turner, 2019. "Exploring the value of participatory system dynamics in two paired field studies of stakeholder engagement in sustainability discussions," Systems Research and Behavioral Science, Wiley Blackwell, vol. 36(2), pages 156-179, March.
    10. Jeffrey Walters & Jessica Kaminsky & Lawrence Gottschamer, 2018. "A Systems Analysis of Factors Influencing Household Solar PV Adoption in Santiago, Chile," Sustainability, MDPI, vol. 10(4), pages 1-17, April.
    11. Geeske Scholz & Martina Austermann & Kai Kaldrack & Claudia Pahl-Wostl, 2015. "Evaluating group model building exercises: a method for comparing externalized mental models and group models," System Dynamics Review, System Dynamics Society, vol. 31(1-2), pages 28-45, January.
    12. Scott, Rodney J & Cavana, Robert Y & Cameron, Donald, 2016. "Recent evidence on the effectiveness of group model building," European Journal of Operational Research, Elsevier, vol. 249(3), pages 908-918.
    13. Schaffernicht, Martin & Groesser, Stefan N., 2011. "A comprehensive method for comparing mental models of dynamic systems," European Journal of Operational Research, Elsevier, vol. 210(1), pages 57-67, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kenzie, Erin S. & Wakeland, Wayne & Jetter, Antonie & Lich, Kristen Hassmiller & Seater, Mellodie & Gunn, Rose & Davis, Melinda M., 2024. "Protocol for an interview-based method for mapping mental models using causal-loop diagramming and realist interviewing," Evaluation and Program Planning, Elsevier, vol. 103(C).
    2. Richard John Ormerod, 2023. "The logic of semiotics applied to mathematical and social interaction in operational research consulting practice: Towards a foundational view," Systems Research and Behavioral Science, Wiley Blackwell, vol. 40(1), pages 16-42, January.
    3. Ellis Ballard & Kelsey Werner & Pratiti Priyadarshini, 2021. "Boundary objects in translation: the role of language in participatory system dynamics modeling," System Dynamics Review, System Dynamics Society, vol. 37(4), pages 310-332, October.
    4. Pluchinotta, Irene & Salvia, Giuseppe & Zimmermann, Nici, 2022. "The importance of eliciting stakeholders’ system boundary perceptions for problem structuring and decision-making," European Journal of Operational Research, Elsevier, vol. 302(1), pages 280-293.
    5. Ormerod, Richard & Yearworth, Mike & White, Leroy, 2023. "Understanding participant actions in OR interventions using practice theories: A research agenda," European Journal of Operational Research, Elsevier, vol. 306(2), pages 810-827.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicholas Valcourt & Jeffrey Walters & Amy Javernick-Will & Karl Linden & Betelhem Hailegiorgis, 2020. "Understanding Rural Water Services as a Complex System: An Assessment of Key Factors as Potential Leverage Points for Improved Service Sustainability," Sustainability, MDPI, vol. 12(3), pages 1-17, February.
    2. Lami, Isabella M. & Tavella, Elena, 2019. "On the usefulness of soft OR models in decision making: A comparison of Problem Structuring Methods supported and self-organized workshops," European Journal of Operational Research, Elsevier, vol. 275(3), pages 1020-1036.
    3. Asif, Muhammad & Inam, Azhar & Adamowski, Jan & Shoaib, Muhammad & Tariq, Hisham & Ahmad, Shakil & Alizadeh, Mohammad Reza & Nazeer, Aftab, 2023. "Development of methods for the simplification of complex group built causal loop diagrams: A case study of the Rechna doab," Ecological Modelling, Elsevier, vol. 476(C).
    4. Federico Cosenz & Guido Noto, 2016. "Applying System Dynamics Modelling to Strategic Management: A Literature Review," Systems Research and Behavioral Science, Wiley Blackwell, vol. 33(6), pages 703-741, November.
    5. Marleen McCardle-Keurentjes & Etiënne A. J. A. Rouwette, 2018. "Asking Questions: A Sine Qua Non of Facilitation in Decision Support?," Group Decision and Negotiation, Springer, vol. 27(5), pages 757-788, October.
    6. Schaffernicht, Martin F.G. & Groesser, Stefan N., 2014. "The SEXTANT software: A tool for automating the comparative analysis of mental models of dynamic systems," European Journal of Operational Research, Elsevier, vol. 238(2), pages 566-578.
    7. Paulo Gonçalves & Paolo Ferrari & Luca Crivelli & Emiliano Albanese, 2023. "Model‐informed health system reorganization during emergencies," Production and Operations Management, Production and Operations Management Society, vol. 32(5), pages 1323-1344, May.
    8. Pluchinotta, Irene & Salvia, Giuseppe & Zimmermann, Nici, 2022. "The importance of eliciting stakeholders’ system boundary perceptions for problem structuring and decision-making," European Journal of Operational Research, Elsevier, vol. 302(1), pages 280-293.
    9. Marchant, Thierry, 1999. "Cognitive maps and fuzzy implications," European Journal of Operational Research, Elsevier, vol. 114(3), pages 626-637, May.
    10. Midgley, Gerald & Cavana, Robert Y. & Brocklesby, John & Foote, Jeff L. & Wood, David R.R. & Ahuriri-Driscoll, Annabel, 2013. "Towards a new framework for evaluating systemic problem structuring methods," European Journal of Operational Research, Elsevier, vol. 229(1), pages 143-154.
    11. Hugo Herrera & Nuno Videira & Hubert P.L.M. Korzilius & Kathya Lorena Cordova‐Pozo & Marleen H.F. McCardle‐Keurentjes, 2022. "Reflecting on factors influencing long‐lasting organisational effects of group model‐building interventions," System Dynamics Review, System Dynamics Society, vol. 38(2), pages 190-209, April.
    12. Natalia Ciobanu & Ali Kerem Saysel, 2021. "Using social–ecological inventory and group model building for resilience assessment to climate change in a network governance setting: a case study from Ikel watershed in Moldova," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 23(1), pages 1065-1085, January.
    13. Roy D. Johnson & Astrid Lipp, 2007. "Cognitive Mapping: A Process to Support Strategic Planning in an Academic Department," Group Decision and Negotiation, Springer, vol. 16(1), pages 43-60, January.
    14. Bruno M. B. Pinto & Fernando A. F. Ferreira & Ronald W. Spahr & Mark A. Sunderman & Leandro F. Pereira, 2023. "Analyzing causes of urban blight using cognitive mapping and DEMATEL," Annals of Operations Research, Springer, vol. 325(2), pages 1083-1110, June.
    15. Arifa Tanveer & Shihong Zeng & Muhammad Irfan & Rui Peng, 2021. "Do Perceived Risk, Perception of Self-Efficacy, and Openness to Technology Matter for Solar PV Adoption? An Application of the Extended Theory of Planned Behavior," Energies, MDPI, vol. 14(16), pages 1-24, August.
    16. Scott, Rodney J & Cavana, Robert Y & Cameron, Donald, 2016. "Recent evidence on the effectiveness of group model building," European Journal of Operational Research, Elsevier, vol. 249(3), pages 908-918.
    17. Maria Cleofe Giorgino & Federico Barnabè & Martin Kunc, 2020. "Integrating qualitative system dynamics with accounting practices: The case of integrated reporting and resource mapping," Systems Research and Behavioral Science, Wiley Blackwell, vol. 37(1), pages 97-118, January.
    18. Amro M Elshurafa & Abdel Rahman Muhsen, 2019. "The Upper Limit of Distributed Solar PV Capacity in Riyadh: A GIS-Assisted Study," Sustainability, MDPI, vol. 11(16), pages 1-20, August.
    19. Serge Lenga, 2013. "Un effet modérateur des processus cognitifs de l'entrepreneur sur les opportunités d'affaires situées dans l'espace géographique," Working Papers hal-00832027, HAL.
    20. Cassidy, Rachel & Tomoaia-Cotisel, Andrada & Semwanga, Agnes Rwashana & Binyaruka, Peter & Chalabi, Zaid & Blanchet, Karl & Singh, Neha S. & Maiba, John & Borghi, Josephine, 2021. "Understanding the maternal and child health system response to payment for performance in Tanzania using a causal loop diagram approach," Social Science & Medicine, Elsevier, vol. 285(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:sysdyn:v:36:y:2020:i:2:p:135-157. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1111/0883-7066 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.