IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v299y2022i2p589-599.html
   My bibliography  Save this article

Cognitive change and consensus forming in facilitated modelling: A comparison of experienced and observed outcomes

Author

Listed:
  • de Gooyert, Vincent
  • Rouwette, Etiënne
  • van Kranenburg, Hans
  • Freeman, Edward
  • van Breen, Harry

Abstract

Facilitated modelling is an approach where operational researchers act as facilitators to model an issue collaboratively with stakeholders. The potential benefits of facilitated modelling, including cognitive change and consensus forming, have been extensively described. However, the evidence that these benefits are achieved often remains anecdotical, and mainly relies on self-reported assessments. This is problematic, as self-reported measures can prove unreliable. In this study we adopted a pre-test post-test design to analyse whether the intended outcomes of eight facilitated modelling workshops were achieved. We compared the outcomes as experienced by participants of the workshops with observed outcomes. Our results show that cognitive change and consensus forming were achieved. However, experienced and observed cognitive change were not related. For consensus forming, we did find a modest correlation between experienced and observed outcomes. We discuss implications for facilitated modelling research and practice.

Suggested Citation

  • de Gooyert, Vincent & Rouwette, Etiënne & van Kranenburg, Hans & Freeman, Edward & van Breen, Harry, 2022. "Cognitive change and consensus forming in facilitated modelling: A comparison of experienced and observed outcomes," European Journal of Operational Research, Elsevier, vol. 299(2), pages 589-599.
    • Handle: RePEc:eee:ejores:v:299:y:2022:i:2:p:589-599
    DOI: 10.1016/j.ejor.2021.09.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221721007669
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2021.09.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mary Tripsas & Giovanni Gavetti, 2000. "Capabilities, cognition, and inertia: evidence from digital imaging," Strategic Management Journal, Wiley Blackwell, vol. 21(10‐11), pages 1147-1161, October.
    2. Eero Vaara & Richard Whittington, 2012. "Strategy as practice : Taking Social Practices Seriously," Post-Print hal-02276672, HAL.
    3. Junginger, M. & Agterbosch, S. & Faaij, A. & Turkenburg, W., 2004. "Renewable electricity in the Netherlands," Energy Policy, Elsevier, vol. 32(9), pages 1053-1073, June.
    4. Franco, L. Alberto & Rouwette, Etienne A.J.A., 2011. "Decision development in facilitated modelling workshops," European Journal of Operational Research, Elsevier, vol. 212(1), pages 164-178, July.
    5. Franco, L. Alberto & Greiffenhagen, Christian, 2018. "Making OR practice visible: Using ethnomethodology to analyse facilitated modelling workshops," European Journal of Operational Research, Elsevier, vol. 265(2), pages 673-684.
    6. Alberto Franco, L., 2013. "Rethinking Soft OR interventions: Models as boundary objects," European Journal of Operational Research, Elsevier, vol. 231(3), pages 720-733.
    7. Kellermanns, Franz W. & Walter, Jorge & Floyd, Steven W. & Lechner, Christoph & Shaw, John C., 2011. "To agree or not to agree? A meta-analytical review of strategic consensus and organizational performance," Journal of Business Research, Elsevier, vol. 64(2), pages 126-133, February.
    8. de Gooyert, Vincent & Rouwette, Etiënne & van Kranenburg, Hans & Freeman, Edward & van Breen, Harry, 2016. "Sustainability transition dynamics: Towards overcoming policy resistance," Technological Forecasting and Social Change, Elsevier, vol. 111(C), pages 135-145.
    9. Annielli A R Cunha & Danielle C Morais, 2016. "Analysing the use of cognitive maps in an experiment on a group decision process," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 67(12), pages 1459-1468, December.
    10. Scott, Rodney J & Cavana, Robert Y & Cameron, Donald, 2016. "Recent evidence on the effectiveness of group model building," European Journal of Operational Research, Elsevier, vol. 249(3), pages 908-918.
    11. René Kemp, 2010. "The Dutch energy transition approach," International Economics and Economic Policy, Springer, vol. 7(2), pages 291-316, August.
    12. Gerard P. Hodgkinson, 1997. "Cognitive Inertia in a Turbulent Market: the Case of UK Residential Estate Agents," Journal of Management Studies, Wiley Blackwell, vol. 34(6), pages 921-945, November.
    13. Franco, L. Alberto & Montibeller, Gilberto, 2010. "Facilitated modelling in operational research," European Journal of Operational Research, Elsevier, vol. 205(3), pages 489-500, September.
    14. E A J A Rouwette, 2011. "Facilitated modelling in strategy development: measuring the impact on communication, consensus and commitment," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(5), pages 879-887, May.
    15. Sucheta Nadkarni & V. K. Narayanan, 2007. "Strategic schemas, strategic flexibility, and firm performance: the moderating role of industry clockspeed," Strategic Management Journal, Wiley Blackwell, vol. 28(3), pages 243-270, March.
    16. Kern, Florian & Smith, Adrian, 2008. "Restructuring energy systems for sustainability? Energy transition policy in the Netherlands," Energy Policy, Elsevier, vol. 36(11), pages 4093-4103, November.
    17. Marleen McCardle-Keurentjes & Etiënne A. J. A. Rouwette, 2018. "Asking Questions: A Sine Qua Non of Facilitation in Decision Support?," Group Decision and Negotiation, Springer, vol. 27(5), pages 757-788, October.
    18. Sarah Kaplan, 2011. "Research in Cognition and Strategy: Reflections on Two Decades of Progress and a Look to the Future," Journal of Management Studies, Wiley Blackwell, vol. 48(3), pages 665-695, May.
    19. Eero Vaara & Richard Whittington, 2012. "Strategy as practice : Taking Social Practices Seriously," Post-Print hal-02312709, HAL.
    20. Rouwette, Etiënne & van Kranenburg, Hans & Freeman, Edward, 2017. "Reviewing the role of stakeholders in Operational Research: A stakeholder theory perspectiveAuthor-Name: de Gooyert, Vincent," European Journal of Operational Research, Elsevier, vol. 262(2), pages 402-410.
    21. Henao, Felipe & Franco, L. Alberto, 2016. "Unpacking multimethodology: Impacts of a community development intervention," European Journal of Operational Research, Elsevier, vol. 253(3), pages 681-696.
    22. Carolyn Hendriks, 2009. "Policy design without democracy? Making democratic sense of transition management," Policy Sciences, Springer;Society of Policy Sciences, vol. 42(4), pages 341-368, November.
    23. van Rooijen, Sascha N.M. & van Wees, Mark T., 2006. "Green electricity policies in the Netherlands: an analysis of policy decisions," Energy Policy, Elsevier, vol. 34(1), pages 60-71, January.
    24. Franco, L. Alberto & Rouwette, Etiënne A.J.A. & Korzilius, Hubert, 2016. "Different paths to consensus? The impact of need for closure on model-supported group conflict management," European Journal of Operational Research, Elsevier, vol. 249(3), pages 878-889.
    25. White, Leroy, 2016. "Behavioural operational research: Towards a framework for understanding behaviour in OR interventions," European Journal of Operational Research, Elsevier, vol. 249(3), pages 827-841.
    26. Sarah Kaplan, 2008. "Framing Contests: Strategy Making Under Uncertainty," Organization Science, INFORMS, vol. 19(5), pages 729-752, October.
    27. Laura J. Black & David F. Andersen, 2012. "Using Visual Representations as Boundary Objects to Resolve Conflict in Collaborative Model‐Building Approaches," Systems Research and Behavioral Science, Wiley Blackwell, vol. 29(2), pages 194-208, March.
    28. James P. Walsh, 1995. "Managerial and Organizational Cognition: Notes from a Trip Down Memory Lane," Organization Science, INFORMS, vol. 6(3), pages 280-321, June.
    29. Fran Ackermann & Colin Eden, 2011. "Negotiation in Strategy Making Teams: Group Support Systems and the Process of Cognitive Change," Group Decision and Negotiation, Springer, vol. 20(3), pages 293-314, May.
    30. Don Knight & Craig L. Pearce & Ken G. Smith & Judy D. Olian & Henry P. Sims & Ken A. Smith & Patrick Flood, 1999. "Top management team diversity, group process, and strategic consensus," Strategic Management Journal, Wiley Blackwell, vol. 20(5), pages 445-465, May.
    31. Elena Tavella & L. Alberto Franco, 2015. "Dynamics of Group Knowledge Production in Facilitated Modelling Workshops: An Exploratory Study," Group Decision and Negotiation, Springer, vol. 24(3), pages 451-475, May.
    32. von der Gracht, Heiko A., 2012. "Consensus measurement in Delphi studies," Technological Forecasting and Social Change, Elsevier, vol. 79(8), pages 1525-1536.
    33. Lami, Isabella M. & Tavella, Elena, 2019. "On the usefulness of soft OR models in decision making: A comparison of Problem Structuring Methods supported and self-organized workshops," European Journal of Operational Research, Elsevier, vol. 275(3), pages 1020-1036.
    34. Joldersma, Cisca & Roelofs, Ellie, 2004. "The impact of soft OR-methods on problem structuring," European Journal of Operational Research, Elsevier, vol. 152(3), pages 696-708, February.
    35. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    36. Rodney J. Scott & Robert Y. Cavana & Donald Cameron, 2016. "Client Perceptions of Reported Outcomes of Group Model Building in the New Zealand Public Sector," Group Decision and Negotiation, Springer, vol. 25(1), pages 77-101, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kuller, M. & Beutler, P. & Lienert, J., 2023. "Preference change in stakeholder group-decision processes in the public sector: Extent, causes and implications," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1268-1285.
    2. Engin, Ayşegül & Franco, L. Alberto & Rouwette, Etiënne A.J.A., 2024. "How groups manage conflict when using model-driven decision support: An epistemic motivation lens," Omega, Elsevier, vol. 129(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alexandre de A. Gomes Júnior & Vanessa B. Schramm, 2022. "Problem Structuring Methods: A Review of Advances Over the Last Decade," Systemic Practice and Action Research, Springer, vol. 35(1), pages 55-88, February.
    2. Lami, Isabella M. & Tavella, Elena, 2019. "On the usefulness of soft OR models in decision making: A comparison of Problem Structuring Methods supported and self-organized workshops," European Journal of Operational Research, Elsevier, vol. 275(3), pages 1020-1036.
    3. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    4. Edoardo Fregonese & Isabella M. Lami & Elena Todella, 2020. "Aesthetic Perspectives in Group Decision and Negotiation Practice," Group Decision and Negotiation, Springer, vol. 29(6), pages 993-1019, December.
    5. Harper, Alison & Mustafee, Navonil & Yearworth, Mike, 2021. "Facets of trust in simulation studies," European Journal of Operational Research, Elsevier, vol. 289(1), pages 197-213.
    6. Marleen McCardle-Keurentjes & Etiënne A. J. A. Rouwette, 2018. "Asking Questions: A Sine Qua Non of Facilitation in Decision Support?," Group Decision and Negotiation, Springer, vol. 27(5), pages 757-788, October.
    7. Francis Marleau Donais & Irène Abi-Zeid & E. Owen D. Waygood & Roxane Lavoie, 2021. "A Framework for Post-Project Evaluation of Multicriteria Decision Aiding Processes from the Stakeholders’ Perspective: Design and Application," Group Decision and Negotiation, Springer, vol. 30(5), pages 1161-1191, October.
    8. Scott, Rodney J & Cavana, Robert Y & Cameron, Donald, 2016. "Recent evidence on the effectiveness of group model building," European Journal of Operational Research, Elsevier, vol. 249(3), pages 908-918.
    9. Richard Ormerod, 2024. "Pragmatism as practice theory: The experience of systems and OR scholars," Systems Research and Behavioral Science, Wiley Blackwell, vol. 41(1), pages 52-81, January.
    10. Nici Zimmermann & Katherine Curran, 2023. "Dynamics of interdisciplinarity: a microlevel analysis of communication and facilitation in a group model‐building workshop," System Dynamics Review, System Dynamics Society, vol. 39(4), pages 336-370, October.
    11. White, Leroy, 2016. "Behavioural operational research: Towards a framework for understanding behaviour in OR interventions," European Journal of Operational Research, Elsevier, vol. 249(3), pages 827-841.
    12. Ormerod, Richard & Yearworth, Mike & White, Leroy, 2023. "Understanding participant actions in OR interventions using practice theories: A research agenda," European Journal of Operational Research, Elsevier, vol. 306(2), pages 810-827.
    13. Franco, L. Alberto & Greiffenhagen, Christian, 2018. "Making OR practice visible: Using ethnomethodology to analyse facilitated modelling workshops," European Journal of Operational Research, Elsevier, vol. 265(2), pages 673-684.
    14. Ian Newsome & David Lloyd, 2023. "The challenge of inclusivity, capability and change in complex, multi‐stakeholder problem situations—Practical insight from the application of participative systems methods, models and facilitation wi," Systems Research and Behavioral Science, Wiley Blackwell, vol. 40(4), pages 639-653, July.
    15. Engin, Ayşegül & Franco, L. Alberto & Rouwette, Etiënne A.J.A., 2024. "How groups manage conflict when using model-driven decision support: An epistemic motivation lens," Omega, Elsevier, vol. 129(C).
    16. Lane, David & Husemann, Elke & Holland, Darren & Khaled, Abdul, 2019. "Understanding foodborne transmission mechanisms for Norovirus: A study for the UK's Food Standards Agency," European Journal of Operational Research, Elsevier, vol. 275(2), pages 721-736.
    17. Hugo J. Herrera & Marleen H. F. McCardle-Keurentjes & Nuno Videira, 2016. "Evaluating Facilitated Modelling Processes and Outcomes: An Experiment Comparing a Single and a Multimethod Approach in Group Model Building," Group Decision and Negotiation, Springer, vol. 25(6), pages 1277-1318, November.
    18. Elena Tavella & L. Alberto Franco, 2015. "Dynamics of Group Knowledge Production in Facilitated Modelling Workshops: An Exploratory Study," Group Decision and Negotiation, Springer, vol. 24(3), pages 451-475, May.
    19. Alberto Franco, L., 2013. "Rethinking Soft OR interventions: Models as boundary objects," European Journal of Operational Research, Elsevier, vol. 231(3), pages 720-733.
    20. Franco, L. Alberto & Hämäläinen, Raimo P., 2016. "Behavioural operational research: Returning to the roots of the OR profession," European Journal of Operational Research, Elsevier, vol. 249(3), pages 791-795.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:299:y:2022:i:2:p:589-599. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.