IDEAS home Printed from https://ideas.repec.org/a/pal/jorsoc/v61y2010i9d10.1057_jors.2009.94.html
   My bibliography  Save this article

The impact of contingency factors on validation of problem structuring methods

Author

Listed:
  • D Champion

    (Loughborough University)

  • J M Wilson

    (Loughborough University)

Abstract

Although much has been written about validating Decision support systems and other ‘hard’ OR models, less has been written about validating ‘soft’ OR models. This article seeks to determine which contingency factors known to influence DSS validation are also important factors influencing problem structuring methods (PSM) validation. In addition, after consultation with PSM experts other contingency factors influencing PSM validation are proposed. Evidence from these PSM experts concerning the levels of influence of these factors is used to support proposals for a contingency approach to PSM validation.

Suggested Citation

  • D Champion & J M Wilson, 2010. "The impact of contingency factors on validation of problem structuring methods," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(9), pages 1420-1431, September.
    • Handle: RePEc:pal:jorsoc:v:61:y:2010:i:9:d:10.1057_jors.2009.94
    DOI: 10.1057/jors.2009.94
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/jors.2009.94
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1057/jors.2009.94?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. K N Papamichail & G Alves & S French & J B Yang & R Snowdon, 2007. "Facilitation practices in decision workshops," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(5), pages 614-632, May.
    2. J Rosenhead, 2006. "Past, present and future of problem structuring methods," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 759-765, July.
    3. R J Ormerod, 2008. "The transformation competence perspective," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(11), pages 1435-1448, November.
    4. G Montibeller & V Belton, 2006. "Causal maps and the evaluation of decision options—a review," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 779-791, July.
    5. M Winter, 2006. "Problem structuring in project management: an application of soft systems methodology (SSM)," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 802-812, July.
    6. Jonathan Rosenhead, 1996. "What's the Problem? An Introduction to Problem Structuring Methods," Interfaces, INFORMS, vol. 26(6), pages 117-131, December.
    7. Dery, Richard & Landry, Maurice & Banville, Claude, 1993. "Revisiting the issue of model validation in OR: An epistemological view," European Journal of Operational Research, Elsevier, vol. 66(2), pages 168-183, April.
    8. Miser, Hugh J., 1993. "A foundational concept of science appropriate for validation in operational research," European Journal of Operational Research, Elsevier, vol. 66(2), pages 204-215, April.
    9. P N Finlay & J M Wilson, 2000. "A survey of contingency factors affecting the validation of end-user spreadsheet-based decision support systems," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 51(8), pages 949-958, August.
    10. C W Olphert & J M Wilson, 2004. "Validation of decision-aiding spreadsheets: the influence of contingency factors," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(1), pages 12-22, January.
    11. P Keys, 2006. "On becoming expert in the use of problem structuring methods," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 822-829, July.
    12. D Shaw, 2006. "Journey Making group workshops as a research tool," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 830-841, July.
    13. A Morton & F Ackermann & V Belton, 2007. "Problem structuring without workshops? Experiences with distributed interaction within a PSM process," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(5), pages 547-556, May.
    14. N A D Connell, 2001. "Evaluating soft OR: some reflections on an apparently ‘unsuccessful’ implementation using a Soft Systems Methodology (SSM) based approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 52(2), pages 150-160, February.
    15. T Ritchey, 2006. "Problem structuring using computer-aided morphological analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 792-801, July.
    16. M den Hengst & G-J de Vreede & R Maghnouji, 2007. "Using soft OR principles for collaborative simulation: a case study in the Dutch airline industry," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(5), pages 669-682, May.
    17. L A Franco, 2006. "Forms of conversation and problem structuring methods: a conceptual development," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 813-821, July.
    18. L Anastasakis & C W Olphert & J M Wilson, 2008. "Experiences in using a contingency factor-based validation methodology for spreadsheet DSS," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(6), pages 756-761, June.
    19. C. West Churchman, 1970. "Operations Research as a Profession," Management Science, INFORMS, vol. 17(2), pages 37-53, October.
    20. Russell L. Ackoff, 1981. "The Art and Science of Mess Management," Interfaces, INFORMS, vol. 11(1), pages 20-26, February.
    21. L White, 2006. "Evaluating problem-structuring methods: developing an approach to show the value and effectiveness of PSMs," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 842-855, July.
    22. H V Vo & B Chae & D L Olson, 2007. "Developing unbounded systems thinking: using causal mapping with multiple stakeholders within a Vietnamese company," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(5), pages 655-668, May.
    23. S Robinson, 2008. "Conceptual modelling for simulation Part I: definition and requirements," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(3), pages 278-290, March.
    24. Landry, Maurice & Malouin, Jean-Louis & Oral, Muhittin, 1983. "Model validation in operations research," European Journal of Operational Research, Elsevier, vol. 14(3), pages 207-220, November.
    25. K Kotiadis & J Mingers, 2006. "Combining PSMs with hard OR methods: the philosophical and practical challenges," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 856-867, July.
    26. Ö Pala & J A M Vennix & T van Mullekom, 2003. "Validity in SSM: neglected areas," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(7), pages 706-712, July.
    27. J Mingers, 2003. "A classification of the philosophical assumptions of management science methods," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(6), pages 559-570, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shaw, Duncan & Smith, Chris M. & Scully, Judy, 2019. "From Brexit to Article 50: Applying Critical Realism to the design and analysis of a longitudinal causal mapping study," European Journal of Operational Research, Elsevier, vol. 276(2), pages 723-735.
    2. Mahmoud Dehghan Nayeri & Moein Khazaei & Fatemeh Alinasab-Imani, 2020. "The Critical Heuristics of Iranian Banking Credit System: Analysis of the Antithetical Opinions of the Beneficiaries," Systemic Practice and Action Research, Springer, vol. 33(3), pages 363-392, June.
    3. Alexandre de A. Gomes Júnior & Vanessa B. Schramm, 2022. "Problem Structuring Methods: A Review of Advances Over the Last Decade," Systemic Practice and Action Research, Springer, vol. 35(1), pages 55-88, February.
    4. Shaw, Duncan & Smith, Chris M. & Scully, Judy, 2017. "Why did Brexit happen? Using causal mapping to analyse secondary, longitudinal data," European Journal of Operational Research, Elsevier, vol. 263(3), pages 1019-1032.
    5. Shavindrie Cooray & Donna Champion, 2023. "A systems approach to enabling student‐led critical discussion," Systems Research and Behavioral Science, Wiley Blackwell, vol. 40(3), pages 429-436, May.
    6. Smith, Chris M. & Shaw, Duncan, 2019. "The characteristics of problem structuring methods: A literature review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 403-416.
    7. Midgley, Gerald & Cavana, Robert Y. & Brocklesby, John & Foote, Jeff L. & Wood, David R.R. & Ahuriri-Driscoll, Annabel, 2013. "Towards a new framework for evaluating systemic problem structuring methods," European Journal of Operational Research, Elsevier, vol. 229(1), pages 143-154.
    8. Gregory, Amanda J. & Atkins, Jonathan P. & Midgley, Gerald & Hodgson, Anthony M., 2020. "Stakeholder identification and engagement in problem structuring interventions," European Journal of Operational Research, Elsevier, vol. 283(1), pages 321-340.
    9. Simon Bell & Sami Mahroum & Nasser Yassin, 2017. "Towards understanding problem structuring and groups with triple task methodology ‘e’," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(2), pages 192-206, February.
    10. Annielli A R Cunha & Danielle C Morais, 2016. "Analysing the use of cognitive maps in an experiment on a group decision process," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 67(12), pages 1459-1468, December.
    11. Champion, Donna, 2018. "A case analysis for PEArL: Software on wheels," International Journal of Information Management, Elsevier, vol. 41(C), pages 93-97.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Franco, L. Alberto & Lord, Ewan, 2011. "Understanding multi-methodology: Evaluating the perceived impact of mixing methods for group budgetary decisions," Omega, Elsevier, vol. 39(3), pages 362-372, June.
    2. White, Leroy, 2016. "Behavioural operational research: Towards a framework for understanding behaviour in OR interventions," European Journal of Operational Research, Elsevier, vol. 249(3), pages 827-841.
    3. Smith, Chris M. & Shaw, Duncan, 2019. "The characteristics of problem structuring methods: A literature review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 403-416.
    4. Michael Yearworth & Gordon Edwards, 2014. "On the Desirability of Integrating Research Methods into Overall Systems Approaches in the Training of Engineers: Analysis Using SSM," Systems Research and Behavioral Science, Wiley Blackwell, vol. 31(1), pages 47-66, January.
    5. Mingers, John & White, Leroy, 2010. "A review of the recent contribution of systems thinking to operational research and management science," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1147-1161, December.
    6. Midgley, Gerald & Cavana, Robert Y. & Brocklesby, John & Foote, Jeff L. & Wood, David R.R. & Ahuriri-Driscoll, Annabel, 2013. "Towards a new framework for evaluating systemic problem structuring methods," European Journal of Operational Research, Elsevier, vol. 229(1), pages 143-154.
    7. Small, Adrian & Wainwright, David, 2018. "Privacy and security of electronic patient records – Tailoring multimethodology to explore the socio-political problems associated with Role Based Access Control systems," European Journal of Operational Research, Elsevier, vol. 265(1), pages 344-360.
    8. Ion Georgiou & Joaquim Heck, 2021. "The emergence of problem structuring methods, 1950s–1989: An atlas of the journal literature," Systems Research and Behavioral Science, Wiley Blackwell, vol. 38(6), pages 756-796, November.
    9. Durugbo, Christopher M., 2020. "Affordance-based problem structuring for workplace innovation," European Journal of Operational Research, Elsevier, vol. 284(2), pages 617-631.
    10. Yearworth, Mike & White, Leroy, 2014. "The non-codified use of problem structuring methods and the need for a generic constitutive definition," European Journal of Operational Research, Elsevier, vol. 237(3), pages 932-945.
    11. Cronin, Karen & Midgley, Gerald & Jackson, Laurie Skuba, 2014. "Issues Mapping: A problem structuring method for addressing science and technology conflicts," European Journal of Operational Research, Elsevier, vol. 233(1), pages 145-158.
    12. Ackermann, Fran, 2012. "Problem structuring methods ‘in the Dock’: Arguing the case for Soft OR," European Journal of Operational Research, Elsevier, vol. 219(3), pages 652-658.
    13. Harper, Alison & Mustafee, Navonil & Yearworth, Mike, 2021. "Facets of trust in simulation studies," European Journal of Operational Research, Elsevier, vol. 289(1), pages 197-213.
    14. William Jones & Mahesh Sooriyabandara & Mike Yearworth & Angela Doufexi & R. Eddie Wilson, 2016. "Planning For 5G: A Problem Structuring Approach for Survival in the Telecoms Industry," Systems Engineering, John Wiley & Sons, vol. 19(4), pages 301-321, July.
    15. Sydelko, Pamela & Midgley, Gerald & Espinosa, Angela, 2021. "Designing interagency responses to wicked problems: Creating a common, cross-agency understanding," European Journal of Operational Research, Elsevier, vol. 294(1), pages 250-263.
    16. Z Zhu, 2011. "After paradim: why mixing-methodology theorising fails and how to make it work again," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(4), pages 784-798, April.
    17. David Lowe & Louise Martingale & Mike Yearworth, 2016. "Guiding interventions in a multi-organisational context: combining the Viable System Model and Hierarchical Process Modelling for use as a Problem Structuring Method," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 67(12), pages 1481-1495, December.
    18. Franco, L. Alberto & Montibeller, Gilberto, 2010. "Facilitated modelling in operational research," European Journal of Operational Research, Elsevier, vol. 205(3), pages 489-500, September.
    19. Henao, Felipe & Franco, L. Alberto, 2016. "Unpacking multimethodology: Impacts of a community development intervention," European Journal of Operational Research, Elsevier, vol. 253(3), pages 681-696.
    20. Tako, Antuela A. & Kotiadis, Kathy, 2015. "PartiSim: A multi-methodology framework to support facilitated simulation modelling in healthcare," European Journal of Operational Research, Elsevier, vol. 244(2), pages 555-564.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:jorsoc:v:61:y:2010:i:9:d:10.1057_jors.2009.94. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave-journals.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.