IDEAS home Printed from https://ideas.repec.org/a/bla/sysdyn/v34y2018i1-2p354-384.html
   My bibliography  Save this article

Potential benefits of model use in group model building: insights from an experimental investigation

Author

Listed:
  • Marleen H. F. McCardle‐Keurentjes
  • Etiënne A. J. A. Rouwette
  • Jac A. M. Vennix
  • Eric Jacobs

Abstract

How do individuals discover the feedback structure of a situation? Does such knowledge help people design and select better decisions? Do decision aids such as causal loop diagrams help? These questions have so far received limited research attention in controlled studies in system dynamics. Here we test the effectiveness of different methods commonly used in group decision settings such as group model building workshops. We employed a hidden profile experimental design in which each individual in a group possessed private information that must be shared to arrive at a good solution—in this case, policies to improve performance. The task placed participants in the role of a manager in a department at the Saturday Evening Post. Processing of department‐specific information will be needed to discover the full feedback structure. We compare decision quality and structural understanding across four conditions: (i) a control setting in which participants only receive minutes of a meeting; (ii) a setting in which participants are actively engaged in qualitative modeling (developing a causal loop diagram); (iii) a setting in which participants receive a causal loop diagram as a decision aid; and (iv) setting (iii) but with all participants given full information. Model use had no effect on the importance participants attached to critical information, understanding of model structure, or confidence in their decisions. However, for participants actively engaged in modeling, we found a substantial correlation between importance attached to critical information, understanding, and confidence. The results have implications for group model building research and practice. © 2018 System Dynamics Society

Suggested Citation

  • Marleen H. F. McCardle‐Keurentjes & Etiënne A. J. A. Rouwette & Jac A. M. Vennix & Eric Jacobs, 2018. "Potential benefits of model use in group model building: insights from an experimental investigation," System Dynamics Review, System Dynamics Society, vol. 34(1-2), pages 354-384, January.
    • Handle: RePEc:bla:sysdyn:v:34:y:2018:i:1-2:p:354-384
    DOI: 10.1002/sdr.1603
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/sdr.1603
    Download Restriction: no
    File URL: https://libkey.io/10.1002/sdr.1603?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hugo J. Herrera & Marleen H. F. McCardle-Keurentjes & Nuno Videira, 2016. "Evaluating Facilitated Modelling Processes and Outcomes: An Experiment Comparing a Single and a Multimethod Approach in Group Model Building," Group Decision and Negotiation, Springer, vol. 25(6), pages 1277-1318, November.
    2. Franco, L. Alberto & Montibeller, Gilberto, 2010. "Facilitated modelling in operational research," European Journal of Operational Research, Elsevier, vol. 205(3), pages 489-500, September.
    3. Lane, David C. & Munro, Eileen & Husemann, Elke, 2016. "Blending systems thinking approaches for organisational analysis: Reviewing child protection in England," European Journal of Operational Research, Elsevier, vol. 251(2), pages 613-623.
    4. Heath, Chip & Gonzalez, Rich, 1995. "Interaction with Others Increases Decision Confidence but Not Decision Quality: Evidence against Information Collection Views of Interactive Decision Making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 61(3), pages 305-326, March.
    5. Etiënne A. J. A. Rouwette & Jac A. M. Vennix & Albert J. A. Felling, 2009. "On Evaluating the Performance of Problem Structuring Methods: An Attempt at Formulating a Conceptual Model," Group Decision and Negotiation, Springer, vol. 18(6), pages 567-587, November.
    6. D F Andersen & J A M Vennix & G P Richardson & E A J A Rouwette, 2007. "Group model building: problem structuring, policy simulation and decision support," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(5), pages 691-694, May.
    7. Roger I. Hall, 1984. "The Natural Logic of Management Policy Making: Its Implications for the Survival of an Organization," Management Science, INFORMS, vol. 30(8), pages 905-927, August.
    8. Sniezek, Janet A., 1992. "Groups under uncertainty: An examination of confidence in group decision making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 52(1), pages 124-155, June.
    9. Edward B. Roberts, 1977. "Strategies for Effective Implementation of Complex Corporate Models," Interfaces, INFORMS, vol. 8(1), pages 26-33, November.
    10. Scott, Rodney J & Cavana, Robert Y & Cameron, Donald, 2016. "Recent evidence on the effectiveness of group model building," European Journal of Operational Research, Elsevier, vol. 249(3), pages 908-918.
    11. Sterman, John., 1994. "Learning in and about complex systems," Working papers 3660-94., Massachusetts Institute of Technology (MIT), Sloan School of Management.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hugo Herrera & Nuno Videira & Hubert P.L.M. Korzilius & Kathya Lorena Cordova‐Pozo & Marleen H.F. McCardle‐Keurentjes, 2022. "Reflecting on factors influencing long‐lasting organisational effects of group model‐building interventions," System Dynamics Review, System Dynamics Society, vol. 38(2), pages 190-209, April.
    2. Kirsten Davis & Navid Ghaffarzadegan & Jacob Grohs & Dustin Grote & Niyousha Hosseinichimeh & David Knight & Hesam Mahmoudi & Konstantinos Triantis, 2020. "The Lake Urmia vignette: a tool to assess understanding of complexity in socio‐environmental systems," System Dynamics Review, System Dynamics Society, vol. 36(2), pages 191-222, April.
    3. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marleen McCardle-Keurentjes & Etiënne A. J. A. Rouwette, 2018. "Asking Questions: A Sine Qua Non of Facilitation in Decision Support?," Group Decision and Negotiation, Springer, vol. 27(5), pages 757-788, October.
    2. Lami, Isabella M. & Tavella, Elena, 2019. "On the usefulness of soft OR models in decision making: A comparison of Problem Structuring Methods supported and self-organized workshops," European Journal of Operational Research, Elsevier, vol. 275(3), pages 1020-1036.
    3. Hugo Herrera & Nuno Videira & Hubert P.L.M. Korzilius & Kathya Lorena Cordova‐Pozo & Marleen H.F. McCardle‐Keurentjes, 2022. "Reflecting on factors influencing long‐lasting organisational effects of group model‐building interventions," System Dynamics Review, System Dynamics Society, vol. 38(2), pages 190-209, April.
    4. Cunico, Giovanni & Aivazidou, Eirini & Mollona, Edoardo, 2021. "Building a dynamic theory of citizens’ awareness of European Cohesion Policy interventions," European Journal of Operational Research, Elsevier, vol. 289(2), pages 758-773.
    5. Peter S. Hovmand & David F. Andersen & Etiënne Rouwette & George P. Richardson & Krista Rux & Annaliese Calhoun, 2012. "Group Model‐Building ‘Scripts’ as a Collaborative Planning Tool," Systems Research and Behavioral Science, Wiley Blackwell, vol. 29(2), pages 179-193, March.
    6. Lane, David C. & Rouwette, Etiënne A.J.A., 2023. "Towards a behavioural system dynamics: Exploring its scope and delineating its promise," European Journal of Operational Research, Elsevier, vol. 306(2), pages 777-794.
    7. Tako, Antuela A. & Kotiadis, Kathy, 2015. "PartiSim: A multi-methodology framework to support facilitated simulation modelling in healthcare," European Journal of Operational Research, Elsevier, vol. 244(2), pages 555-564.
    8. Carissa J Champlin & Johannes Flacke & Geert PMR Dewulf, 2022. "A game co-design method to elicit knowledge for the contextualization of spatial models," Environment and Planning B, , vol. 49(3), pages 1074-1090, March.
    9. Lyn M. Van Swol & Paul Hangsan Ahn & Andrew Prahl & Zhenxing Gong, 2021. "Language Use in Group Discourse and Its Relationship to Group Processes," SAGE Open, , vol. 11(1), pages 21582440211, March.
    10. Smith, Chris M. & Shaw, Duncan, 2019. "The characteristics of problem structuring methods: A literature review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 403-416.
    11. Alexandra Gheondea-Eladi, 2016. "The Evolution of Certainty in a Small Decision-Making Group by Consensus," Group Decision and Negotiation, Springer, vol. 25(1), pages 127-155, January.
    12. Natalia Ciobanu & Ali Kerem Saysel, 2021. "Using social–ecological inventory and group model building for resilience assessment to climate change in a network governance setting: a case study from Ikel watershed in Moldova," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 23(1), pages 1065-1085, January.
    13. Rodney J. Scott & Robert Y. Cavana & Donald Cameron, 2016. "Client Perceptions of Reported Outcomes of Group Model Building in the New Zealand Public Sector," Group Decision and Negotiation, Springer, vol. 25(1), pages 77-101, January.
    14. Francis Marleau Donais & Irène Abi-Zeid & E. Owen D. Waygood & Roxane Lavoie, 2021. "A Framework for Post-Project Evaluation of Multicriteria Decision Aiding Processes from the Stakeholders’ Perspective: Design and Application," Group Decision and Negotiation, Springer, vol. 30(5), pages 1161-1191, October.
    15. Sarah Gerritsen & Sophia Harré & David Rees & Ana Renker-Darby & Ann E. Bartos & Wilma E. Waterlander & Boyd Swinburn, 2020. "Community Group Model Building as a Method for Engaging Participants and Mobilising Action in Public Health," IJERPH, MDPI, vol. 17(10), pages 1-12, May.
    16. Elena Tavella & L. Alberto Franco, 2015. "Dynamics of Group Knowledge Production in Facilitated Modelling Workshops: An Exploratory Study," Group Decision and Negotiation, Springer, vol. 24(3), pages 451-475, May.
    17. Scott, Rodney J & Cavana, Robert Y & Cameron, Donald, 2016. "Recent evidence on the effectiveness of group model building," European Journal of Operational Research, Elsevier, vol. 249(3), pages 908-918.
    18. Sondoss Elsawah & Elena Bakhanova & Raimo P. Hämäläinen & Alexey Voinov, 2023. "A Competency Framework for Participatory Modeling," Group Decision and Negotiation, Springer, vol. 32(3), pages 569-601, June.
    19. Giuseppe Salvia & Irene Pluchinotta & Ioanna Tsoulou & Gemma Moore & Nici Zimmermann, 2022. "Understanding Urban Green Space Usage through Systems Thinking: A Case Study in Thamesmead, London," Sustainability, MDPI, vol. 14(5), pages 1-24, February.
    20. Khadka, Chiranjeewee & Hujala, Teppo & Wolfslehner, Bernhard & Vacik, Harald, 2013. "Problem structuring in participatory forest planning," Forest Policy and Economics, Elsevier, vol. 26(C), pages 1-11.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:sysdyn:v:34:y:2018:i:1-2:p:354-384. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1111/0883-7066 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.