IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v289y2021i1p197-213.html
   My bibliography  Save this article

Facets of trust in simulation studies

Author

Listed:
  • Harper, Alison
  • Mustafee, Navonil
  • Yearworth, Mike

Abstract

The purpose of a modelling and simulation (M&S) study for real-world operations management applications is to support decision-making and inform potential action, therefore investigating the aspects of the modelling process which influence trust is important. Previous work has considered the question of trust through the lens of model validation. However, whilst a simulation model may be technically well executed, stakeholders’ trust in the results may also depend upon intangible factors such as interpersonal relationships. Existing literature has also focused on the credibility of the simulation practitioner, however the credibility attribute belongs to the stakeholder, and it ignores the trust aspects that may exist between the stakeholders and the model itself. In this paper, we argue that different facets of trust emerge throughout the stages of a simulation study, and both influence, and are influenced by, the interaction between the model, the modeller and the stakeholders of the study. We present a synthesis of existing literature and extend it by proposing a formative model of trust which presents a conceptualisation of this tripartite relationship. Our contribution is the identification of the different facets of trust in the lifecycle of a modelling and simulation study. We argue that these interacting facets converge via the three-way relationship between modeller, model and stakeholders toward epistemic trust in the knowledge generated by the simulation study and ultimately model acceptability and implementation. To the best of our knowledge, ours is the first study that focuses solely on the question of trust in an M&S study.

Suggested Citation

  • Harper, Alison & Mustafee, Navonil & Yearworth, Mike, 2021. "Facets of trust in simulation studies," European Journal of Operational Research, Elsevier, vol. 289(1), pages 197-213.
  • Handle: RePEc:eee:ejores:v:289:y:2021:i:1:p:197-213
    DOI: 10.1016/j.ejor.2020.06.043
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221720306019
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2020.06.043?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. James S. Hodges, 1991. "Six (Or So) Things You Can Do with a Bad Model," Operations Research, INFORMS, vol. 39(3), pages 355-365, June.
    2. Kotiadis, K. & Tako, A.A., 2018. "Facilitated post-model coding in discrete event simulation (DES): A case study in healthcare," European Journal of Operational Research, Elsevier, vol. 266(3), pages 1120-1133.
    3. Mark Dodgson & David M. Gann & Ammon Salter, 2007. "“In Case of Fire, Please Use the Elevator”: Simulation Technology and Organization in Fire Engineering," Organization Science, INFORMS, vol. 18(5), pages 849-864, October.
    4. Mohsen Jahangirian & Simon J E Taylor & Julie Eatock & Lampros K Stergioulas & Peter M Taylor, 2015. "Causal study of low stakeholder engagement in healthcare simulation projects," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(3), pages 369-379, March.
    5. K Kotiadis & A A Tako & C Vasilakis, 2014. "A participative and facilitative conceptual modelling framework for discrete event simulation studies in healthcare," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 65(2), pages 197-213, February.
    6. Robinson, Stewart & Radnor, Zoe J. & Burgess, Nicola & Worthington, Claire, 2012. "SimLean: Utilising simulation in the implementation of lean in healthcare," European Journal of Operational Research, Elsevier, vol. 219(1), pages 188-197.
    7. R J Ormerod, 2008. "The transformation competence perspective," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(11), pages 1435-1448, November.
    8. Franco, L. Alberto & Rouwette, Etienne A.J.A., 2011. "Decision development in facilitated modelling workshops," European Journal of Operational Research, Elsevier, vol. 212(1), pages 164-178, July.
    9. Ranyard, J.C. & Fildes, R. & Hu, Tun-I, 2015. "Reassessing the scope of OR practice: The Influences of Problem Structuring Methods and the Analytics Movement," European Journal of Operational Research, Elsevier, vol. 245(1), pages 1-13.
    10. Franco, L. Alberto & Rouwette, Etiënne A.J.A. & Korzilius, Hubert, 2016. "Different paths to consensus? The impact of need for closure on model-supported group conflict management," European Journal of Operational Research, Elsevier, vol. 249(3), pages 878-889.
    11. Robinson, Stewart, 2002. "General concepts of quality for discrete-event simulation," European Journal of Operational Research, Elsevier, vol. 138(1), pages 103-117, April.
    12. P Keys, 2006. "On becoming expert in the use of problem structuring methods," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 822-829, July.
    13. Robinson, Stewart & Kotiadis, Kathy, 2016. "Can involving clients in simulation studies help them solve their future problems? A transfer of learning experimentAuthor-Name: Monks, Thomas," European Journal of Operational Research, Elsevier, vol. 249(3), pages 919-930.
    14. Ajzen, Icek, 1991. "The theory of planned behavior," Organizational Behavior and Human Decision Processes, Elsevier, vol. 50(2), pages 179-211, December.
    15. J B Jun & S H Jacobson & J R Swisher, 1999. "Application of discrete-event simulation in health care clinics: A survey," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 50(2), pages 109-123, February.
    16. Yearworth, Mike & White, Leroy, 2014. "The non-codified use of problem structuring methods and the need for a generic constitutive definition," European Journal of Operational Research, Elsevier, vol. 237(3), pages 932-945.
    17. S C Brailsford & T B Bolt & G Bucci & T M Chaussalet & N A Connell & P R Harper & J H Klein & M Pitt & M Taylor, 2013. "Overcoming the barriers: a qualitative study of simulation adoption in the NHS," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 64(2), pages 157-168, February.
    18. Alberto Franco, L., 2013. "Rethinking Soft OR interventions: Models as boundary objects," European Journal of Operational Research, Elsevier, vol. 231(3), pages 720-733.
    19. White, Leroy & Burger, Katharina & Yearworth, Mike, 2016. "Understanding behaviour in problem structuring methods interventions with activity theory," European Journal of Operational Research, Elsevier, vol. 249(3), pages 983-1004.
    20. M. Muro & P. Jeffrey, 2008. "A critical review of the theory and application of social learning in participatory natural resource management processes," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 51(3), pages 325-344.
    21. Mingers, John & Rosenhead, Jonathan, 2004. "Problem structuring methods in action," European Journal of Operational Research, Elsevier, vol. 152(3), pages 530-554, February.
    22. R Sachdeva & T Williams & J Quigley, 2007. "Mixing methodologies to enhance the implementation of healthcare operational research," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(2), pages 159-167, February.
    23. Luoma, Jukka, 2016. "Model-based organizational decision making: A behavioral lens," European Journal of Operational Research, Elsevier, vol. 249(3), pages 816-826.
    24. M den Hengst & G-J de Vreede & R Maghnouji, 2007. "Using soft OR principles for collaborative simulation: a case study in the Dutch airline industry," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(5), pages 669-682, May.
    25. Scott, Rodney J & Cavana, Robert Y & Cameron, Donald, 2016. "Recent evidence on the effectiveness of group model building," European Journal of Operational Research, Elsevier, vol. 249(3), pages 908-918.
    26. Mohsen Jahangirian & Simon J E Taylor & Terry Young & Stewart Robinson, 2017. "Key performance indicators for successful simulation projects," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(7), pages 747-765, July.
    27. Oral, Muhittin & Kettani, Ossama, 1993. "The facets of the modeling and validation process in operations research," European Journal of Operational Research, Elsevier, vol. 66(2), pages 216-234, April.
    28. L A Franco, 2006. "Forms of conversation and problem structuring methods: a conceptual development," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 813-821, July.
    29. Franco, L. Alberto & Montibeller, Gilberto, 2010. "Facilitated modelling in operational research," European Journal of Operational Research, Elsevier, vol. 205(3), pages 489-500, September.
    30. Richard Ormerod, 2017. "Writing practitioner case studies to help behavioural OR researchers ground their theories: application of the mangle perspective," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(5), pages 507-520, May.
    31. Proudlove, N.C. & Bisogno, S. & Onggo, B.S.S. & Calabrese, A. & Levialdi Ghiron, N., 2017. "Towards fully-facilitated discrete event simulation modelling: Addressing the model coding stage," European Journal of Operational Research, Elsevier, vol. 263(2), pages 583-595.
    32. G Royston, 2013. "Operational Research for the Real World: big questions from a small island☆," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 64(6), pages 793-804, June.
    33. Hämäläinen, Raimo P. & Luoma, Jukka & Saarinen, Esa, 2013. "On the importance of behavioral operational research: The case of understanding and communicating about dynamic systems," European Journal of Operational Research, Elsevier, vol. 228(3), pages 623-634.
    34. Ayten Öksüz & Nicolai Walter & Bettina Distel & Michael Räckers & Jörg Becker, 2016. "Trust in the Information Systems Discipline," Progress in IS, in: Bernd Blöbaum (ed.), Trust and Communication in a Digitized World, edition 1, pages 205-223, Springer.
    35. R Ahmed & S Robinson, 2014. "Modelling and simulation in business and industry: insights into the processes and practices of expert modellers," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 65(5), pages 660-672, May.
    36. Sandro Castaldo & Katia Premazzi & Fabrizio Zerbini, 2010. "The Meaning(s) of Trust. A Content Analysis on the Diverse Conceptualizations of Trust in Scholarly Research on Business Relationships," Journal of Business Ethics, Springer, vol. 96(4), pages 657-668, November.
    37. J H Powell & N Mustafee, 2017. "Widening requirements capture with soft methods: an investigation of hybrid M&S studies in health care," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(10), pages 1211-1222, October.
    38. Ying Tang & Andrea Moro & Sandro Sozzo & Zhiyong Li, 2018. "Modelling trust evolution within small business lending relationships," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 4(1), pages 1-18, December.
    39. Colin Eden & Fran Ackermann, 2001. "Group Decision and Negotiation in Strategy Making," Group Decision and Negotiation, Springer, vol. 10(2), pages 119-140, March.
    40. Brocklesby, John, 2016. "The what, the why and the how of behavioural operational research—An invitation to potential sceptics," European Journal of Operational Research, Elsevier, vol. 249(3), pages 796-805.
    41. Antuela A Tako & Stewart Robinson, 2015. "Is simulation in health different?," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(4), pages 602-614, April.
    42. S J E Taylor & T Eldabi & G Riley & R J Paul & M Pidd, 2009. "Simulation modelling is 50! Do we need a reality check?," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(1), pages 69-82, May.
    43. Ackermann, Fran, 2012. "Problem structuring methods ‘in the Dock’: Arguing the case for Soft OR," European Journal of Operational Research, Elsevier, vol. 219(3), pages 652-658.
    44. Antuela A. Tako & Naoum Tsioptsias & Stewart Robinson, 2020. "Can we learn from simplified simulation models? An experimental study on user learning," Journal of Simulation, Taylor & Francis Journals, vol. 14(2), pages 130-144, April.
    45. Burger, Katharina & White, Leroy & Yearworth, Mike, 2019. "Developing a smart operational research with hybrid practice theories," European Journal of Operational Research, Elsevier, vol. 277(3), pages 1137-1150.
    46. Richard M. Burton & Børge Obel, 2011. "Computational Modeling for What-Is, What-Might-Be, and What-Should-Be Studies---And Triangulation," Organization Science, INFORMS, vol. 22(5), pages 1195-1202, October.
    47. Brocklesby, John & Midgley, Gerald, 2016. "Boundary games: How teams of OR practitioners explore the boundaries of interventionAuthor-Name: Velez-Castiblanco, Jorge," European Journal of Operational Research, Elsevier, vol. 249(3), pages 968-982.
    48. Gogi, Anastasia & Tako, Antuela A. & Robinson, Stewart, 2016. "An experimental investigation into the role of simulation models in generating insights," European Journal of Operational Research, Elsevier, vol. 249(3), pages 931-944.
    49. Stephen W. Wang & Waros Ngamsiriudom & Chia-Hung Hsieh, 2015. "Trust disposition, trust antecedents, trust, and behavioral intention," The Service Industries Journal, Taylor & Francis Journals, vol. 35(10), pages 555-572, July.
    50. Rouwette, Etiënne & van Kranenburg, Hans & Freeman, Edward, 2017. "Reviewing the role of stakeholders in Operational Research: A stakeholder theory perspectiveAuthor-Name: de Gooyert, Vincent," European Journal of Operational Research, Elsevier, vol. 262(2), pages 402-410.
    51. Robinson, Stewart & Worthington, Claire & Burgess, Nicola & Radnor, Zoe J., 2014. "Facilitated modelling with discrete-event simulation: Reality or myth?," European Journal of Operational Research, Elsevier, vol. 234(1), pages 231-240.
    52. Mingers, John & Brocklesby, John, 1997. "Multimethodology: Towards a framework for mixing methodologies," Omega, Elsevier, vol. 25(5), pages 489-509, October.
    53. Colin Eden, 1982. "Management Science Process---Problem Construction and the Influence of O.R," Interfaces, INFORMS, vol. 12(2), pages 50-60, April.
    54. Hurrion, R. D., 1991. "Intelligent Visual Interactive Modelling," European Journal of Operational Research, Elsevier, vol. 54(3), pages 349-356, October.
    55. Pessôa, Leonardo Antonio Monteiro & Lins, Marcos Pereira Estellita & da Silva, Angela Cristina Moreira & Fiszman, Roberto, 2015. "Integrating soft and hard operational research to improve surgical centre management at a university hospital," European Journal of Operational Research, Elsevier, vol. 245(3), pages 851-861.
    56. Daniel Antony Kolkman & Paolo Campo & Tina Balke-Visser & Nigel Gilbert, 2016. "How to build models for government: criteria driving model acceptance in policymaking," Policy Sciences, Springer;Society of Policy Sciences, vol. 49(4), pages 489-504, December.
    57. Tako, Antuela A. & Kotiadis, Kathy, 2015. "PartiSim: A multi-methodology framework to support facilitated simulation modelling in healthcare," European Journal of Operational Research, Elsevier, vol. 244(2), pages 555-564.
    58. K Katsaliaki & N Mustafee, 2011. "Applications of simulation within the healthcare context," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(8), pages 1431-1451, August.
    59. B Lehaney & S A Clarke & R J Paul, 1999. "A case of an intervention in an outpatients department," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 50(9), pages 877-891, September.
    60. Monks, Thomas & Robinson, Stewart & Kotiadis, Kathy, 2014. "Learning from discrete-event simulation: Exploring the high involvement hypothesis," European Journal of Operational Research, Elsevier, vol. 235(1), pages 195-205.
    61. Jahangirian, Mohsen & Eldabi, Tillal & Naseer, Aisha & Stergioulas, Lampros K. & Young, Terry, 2010. "Simulation in manufacturing and business: A review," European Journal of Operational Research, Elsevier, vol. 203(1), pages 1-13, May.
    62. K Kotiadis & J Mingers, 2006. "Combining PSMs with hard OR methods: the philosophical and practical challenges," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 856-867, July.
    63. Richard J Ormerod, 2014. "The mangle of OR practice: towards more informative case studies of ‘technical’ projects," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 65(8), pages 1245-1260, August.
    64. Cornwall, Andrea & Jewkes, Rachel, 1995. "What is participatory research?," Social Science & Medicine, Elsevier, vol. 41(12), pages 1667-1676, December.
    65. Bill McEvily & Akbar Zaheer & Darcy K. Fudge Kamal, 2017. "Mutual and Exclusive: Dyadic Sources of Trust in Interorganizational Exchange," Organization Science, INFORMS, vol. 28(1), pages 74-92, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Luciano Barcellos-Paula & Iván De la Vega & Anna María Gil-Lafuente, 2021. "The Quintuple Helix of Innovation Model and the SDGs: Latin-American Countries’ Case and Its Forgotten Effects," Mathematics, MDPI, vol. 9(4), pages 1-23, February.
    2. Luciano Barcellos-Paula & Anna María Gil-Lafuente & Aline Castro-Rezende, 2023. "Algorithm Applied to SDG13: A Case Study of Ibero-American Countries," Mathematics, MDPI, vol. 11(2), pages 1-20, January.
    3. Nguyen, Le Khanh Ngan & Howick, Susan & Megiddo, Itamar, 2024. "A framework for conceptualising hybrid system dynamics and agent-based simulation models," European Journal of Operational Research, Elsevier, vol. 315(3), pages 1153-1166.
    4. Luciano Barcellos‐Paula & Carlos Agüero‐Olivos, 2022. "The strengthening of corporate governance based on applied fuzzy logic," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 29(5), pages 1736-1746, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    2. Alexandre de A. Gomes Júnior & Vanessa B. Schramm, 2022. "Problem Structuring Methods: A Review of Advances Over the Last Decade," Systemic Practice and Action Research, Springer, vol. 35(1), pages 55-88, February.
    3. Kotiadis, K. & Tako, A.A., 2018. "Facilitated post-model coding in discrete event simulation (DES): A case study in healthcare," European Journal of Operational Research, Elsevier, vol. 266(3), pages 1120-1133.
    4. Proudlove, N.C. & Bisogno, S. & Onggo, B.S.S. & Calabrese, A. & Levialdi Ghiron, N., 2017. "Towards fully-facilitated discrete event simulation modelling: Addressing the model coding stage," European Journal of Operational Research, Elsevier, vol. 263(2), pages 583-595.
    5. White, Leroy, 2016. "Behavioural operational research: Towards a framework for understanding behaviour in OR interventions," European Journal of Operational Research, Elsevier, vol. 249(3), pages 827-841.
    6. Franco, L. Alberto & Greiffenhagen, Christian, 2018. "Making OR practice visible: Using ethnomethodology to analyse facilitated modelling workshops," European Journal of Operational Research, Elsevier, vol. 265(2), pages 673-684.
    7. Lami, Isabella M. & Tavella, Elena, 2019. "On the usefulness of soft OR models in decision making: A comparison of Problem Structuring Methods supported and self-organized workshops," European Journal of Operational Research, Elsevier, vol. 275(3), pages 1020-1036.
    8. Robinson, Stewart & Kotiadis, Kathy, 2016. "Can involving clients in simulation studies help them solve their future problems? A transfer of learning experimentAuthor-Name: Monks, Thomas," European Journal of Operational Research, Elsevier, vol. 249(3), pages 919-930.
    9. Luoma, Jukka, 2016. "Model-based organizational decision making: A behavioral lens," European Journal of Operational Research, Elsevier, vol. 249(3), pages 816-826.
    10. Johnson, Michael P. & Midgley, Gerald & Chichirau, George, 2018. "Emerging trends and new frontiers in community operational research," European Journal of Operational Research, Elsevier, vol. 268(3), pages 1178-1191.
    11. Ormerod, Richard & Yearworth, Mike & White, Leroy, 2023. "Understanding participant actions in OR interventions using practice theories: A research agenda," European Journal of Operational Research, Elsevier, vol. 306(2), pages 810-827.
    12. Jorge Velez-Castiblanco & Diana Londono-Correa & Olandy Naranjo-Rivera, 2018. "The Structure of Problem Structuring Conversations: A Boundary Games Approach," Group Decision and Negotiation, Springer, vol. 27(5), pages 853-884, October.
    13. David Lowe & Louise Martingale & Mike Yearworth, 2016. "Guiding interventions in a multi-organisational context: combining the Viable System Model and Hierarchical Process Modelling for use as a Problem Structuring Method," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 67(12), pages 1481-1495, December.
    14. Smith, Chris M. & Shaw, Duncan, 2019. "The characteristics of problem structuring methods: A literature review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 403-416.
    15. Henao, Felipe & Franco, L. Alberto, 2016. "Unpacking multimethodology: Impacts of a community development intervention," European Journal of Operational Research, Elsevier, vol. 253(3), pages 681-696.
    16. Alireza Moumivand & Adel Azar & Abbas Toloie Eshlaghy, 2022. "Combined soft system methodology and agent‐based simulation for multi‐methodological modelling," Systems Research and Behavioral Science, Wiley Blackwell, vol. 39(2), pages 200-217, March.
    17. Tako, Antuela A. & Kotiadis, Kathy, 2015. "PartiSim: A multi-methodology framework to support facilitated simulation modelling in healthcare," European Journal of Operational Research, Elsevier, vol. 244(2), pages 555-564.
    18. Small, Adrian & Wainwright, David, 2018. "Privacy and security of electronic patient records – Tailoring multimethodology to explore the socio-political problems associated with Role Based Access Control systems," European Journal of Operational Research, Elsevier, vol. 265(1), pages 344-360.
    19. Baril, Chantal & Gascon, Viviane & Miller, Jonathan & Côté, Nadine, 2016. "Use of a discrete-event simulation in a Kaizen event: A case study in healthcare," European Journal of Operational Research, Elsevier, vol. 249(1), pages 327-339.
    20. Durugbo, Christopher M., 2020. "Affordance-based problem structuring for workplace innovation," European Journal of Operational Research, Elsevier, vol. 284(2), pages 617-631.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:289:y:2021:i:1:p:197-213. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.