IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v103y2024ics0149718924000132.html
   My bibliography  Save this article

Protocol for an interview-based method for mapping mental models using causal-loop diagramming and realist interviewing

Author

Listed:
  • Kenzie, Erin S.
  • Wakeland, Wayne
  • Jetter, Antonie
  • Lich, Kristen Hassmiller
  • Seater, Mellodie
  • Gunn, Rose
  • Davis, Melinda M.

Abstract

Causal-loop diagramming, a method from system dynamics, is increasingly used in evaluation to describe individuals’ understanding of how policies or programs do or could work ("mental models"). The use of qualitative interviews to inform model development is common, but guidance for how to design and conduct these interviews to elicit causal information in participant mental models is scant. A key strength of semi-structured qualitative interviews is that they let participants speak freely; they are not, however, designed to elicit causal information. Moreover, much of human communication about mental models—particularly larger causal structures such as feedback loops—is implicit. In qualitative research, part of the skill and art of effective interviewing and analysis involves listening for information that is expressed implicitly. Similarly, a skilled facilitator can recognize and inquire about implied causal structures, as is commonly done in group model building. To standardize and make accessible these approaches, we have formalized a protocol for designing and conducting semi-structured interviews tailored to eliciting mental models using causal-loop diagramming. We build on qualitative research methods, system dynamics, and realist interviewing. This novel, integrative method is designed to increase transparency and rigor in the use of interviews for system dynamics and has a variety of potential applications.

Suggested Citation

  • Kenzie, Erin S. & Wakeland, Wayne & Jetter, Antonie & Lich, Kristen Hassmiller & Seater, Mellodie & Gunn, Rose & Davis, Melinda M., 2024. "Protocol for an interview-based method for mapping mental models using causal-loop diagramming and realist interviewing," Evaluation and Program Planning, Elsevier, vol. 103(C).
  • Handle: RePEc:eee:epplan:v:103:y:2024:i:c:s0149718924000132
    DOI: 10.1016/j.evalprogplan.2024.102412
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718924000132
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2024.102412?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. J. David Tabara & Elisabet Roca & Cristina Madrid & Pieter Valkering & Patrik Wallman & Paul M. Weaver, 2008. "Integrated sustainability assessment of water systems: lessons from the Ebro River Basin," International Journal of Innovation and Sustainable Development, Inderscience Enterprises Ltd, vol. 3(1/2), pages 48-69.
    2. Nicholas Valcourt & Jeffrey Walters & Amy Javernick‐Will & Karl Linden, 2020. "Assessing the efficacy of group model building workshops in an applied setting through purposive text analysis," System Dynamics Review, System Dynamics Society, vol. 36(2), pages 135-157, April.
    3. Nkwake, Apollo M. & Morrow, Nathan, 2016. "Clarifying concepts and categories of assumptions for use in evaluation," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 97-101.
    4. Laura K. Schmitt Olabisi & Anne R. Kapuscinski & Kris A. Johnson & Peter B. Reich & Brian Stenquist & Kathryn J. Draeger, 2010. "Using Scenario Visioning and Participatory System Dynamics Modeling to Investigate the Future: Lessons from Minnesota 2050," Sustainability, MDPI, vol. 2(8), pages 1-21, August.
    5. Kaufman, Sanda & Ozawa, Connie P. & Shmueli, Deborah F., 2014. "Evaluating participatory decision processes: Which methods inform reflective practice?," Evaluation and Program Planning, Elsevier, vol. 42(C), pages 11-20.
    6. Weeks, Margaret R. & Green Montaque, Helena D. & Lounsbury, David W. & Li, Jianghong & Ferguson, Alice & Warren-Dias, Danielle, 2022. "Using participatory system dynamics learning to support Ryan White Planning Council priority setting and resource allocations," Evaluation and Program Planning, Elsevier, vol. 93(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laura Schmitt Olabisi & Amadou Sidibé, 2023. "Observations from a system dynamics modeling field school in Mali," System Dynamics Review, System Dynamics Society, vol. 39(1), pages 80-94, January.
    2. Gerard Olivar-Tost & Johnny Valencia-Calvo & Julián Andrés Castrillón-Gómez, 2020. "Towards Decision-Making for the Assessment and Prioritization of Green Projects: An Integration between System Dynamics and Participatory Modeling," Sustainability, MDPI, vol. 12(24), pages 1-23, December.
    3. Sridharan, Sanjeev & Nakaima, April, 2023. "Learning from experiences of evaluators implementing theory-driven evaluations in diverse settings: Building on the contributions of John Mayne," Evaluation and Program Planning, Elsevier, vol. 97(C).
    4. Joan David Tàbara & Francesc Cots & Simona Pedde & Katharina Hölscher & Kasper Kok & Anastasia Lovanova & Tiago Capela Lourenço & Niki Frantzeskaki & John Etherington, 2018. "Exploring Institutional Transformations to Address High-End Climate Change in Iberia," Sustainability, MDPI, vol. 10(1), pages 1-22, January.
    5. Jia Shi & Xuesong Guo & Xiangnan Hu, 2019. "Engaging Stakeholders in Urban Traffic Restriction Policy Assessment Using System Dynamics: The Case Study of Xi’an City, China," Sustainability, MDPI, vol. 11(14), pages 1-16, July.
    6. Laura Schmitt Olabisi & Saweda Liverpool-Tasie & Louie Rivers & Arika Ligmann-Zielinska & Jing Du & Riva Denny & Sandra Marquart-Pyatt & Amadou Sidibé, 2018. "Using participatory modeling processes to identify sources of climate risk in West Africa," Environment Systems and Decisions, Springer, vol. 38(1), pages 23-32, March.
    7. Gerlak, Andrea K. & Guido, Zack & Owen, Gigi & McGoffin, Mariana Sofia Rodriguez & Louder, Elena & Davies, Julia & Smith, Kelly Jay & Zimmer, Andy & Murveit, Anna M. & Meadow, Alison & Shrestha, Padme, 2023. "Stakeholder engagement in the co-production of knowledge for environmental decision-making," World Development, Elsevier, vol. 170(C).
    8. Richard John Ormerod, 2023. "The logic of semiotics applied to mathematical and social interaction in operational research consulting practice: Towards a foundational view," Systems Research and Behavioral Science, Wiley Blackwell, vol. 40(1), pages 16-42, January.
    9. Bruce Tonn & Paul Frymier & Jared Graves & Jessa Meyers, 2010. "A Sustainable Energy Scenario for the United States: Year 2050," Sustainability, MDPI, vol. 2(12), pages 1-31, November.
    10. Peter R. Mulvihill & Victoria Kramkowski, 2010. "Extending the Influence of Scenario Development in Sustainability Planning and Strategy," Sustainability, MDPI, vol. 2(8), pages 1-18, July.
    11. Daniel Vujcich & Meagan Roberts & Tyler Selway & Barbara Nattabi, 2023. "The Application of Systems Thinking to the Prevention and Control of Sexually Transmissible Infections among Adolescents and Adults: A Scoping Review," IJERPH, MDPI, vol. 20(9), pages 1-27, May.
    12. Nuno Videira & Rita Lopes & Paula Antunes & Rui Santos & José Luís Casanova, 2012. "Mapping Maritime Sustainability Issues with Stakeholder Groups," Systems Research and Behavioral Science, Wiley Blackwell, vol. 29(6), pages 596-619, November.
    13. Darren Nel & Araz Taeihagh, 2024. "The soft underbelly of complexity science adoption in policymaking: towards addressing frequently overlooked non-technical challenges," Policy Sciences, Springer;Society of Policy Sciences, vol. 57(2), pages 403-436, June.
    14. Ormerod, Richard & Yearworth, Mike & White, Leroy, 2023. "Understanding participant actions in OR interventions using practice theories: A research agenda," European Journal of Operational Research, Elsevier, vol. 306(2), pages 810-827.
    15. Mark, Melvin M., 2023. "Surfacing, as well as testing, “elliptical assumptions” in a theory of change: Principled discovery," Evaluation and Program Planning, Elsevier, vol. 97(C).
    16. Pluchinotta, Irene & Salvia, Giuseppe & Zimmermann, Nici, 2022. "The importance of eliciting stakeholders’ system boundary perceptions for problem structuring and decision-making," European Journal of Operational Research, Elsevier, vol. 302(1), pages 280-293.
    17. McGookin, Connor & Ó Gallachóir, Brian & Byrne, Edmond, 2021. "Participatory methods in energy system modelling and planning – A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 151(C).
    18. Ellis Ballard & Kelsey Werner & Pratiti Priyadarshini, 2021. "Boundary objects in translation: the role of language in participatory system dynamics modeling," System Dynamics Review, System Dynamics Society, vol. 37(4), pages 310-332, October.
    19. Onyinye Prince Choko & Laura Schmitt Olabisi & Robert Ugochukwu Onyeneke & Stella Nwawulu Chiemela & Lenis Saweda O. Liverpool-Tasie & Louie Rivers, 2019. "A Resilience Approach to Community-Scale Climate Adaptation," Sustainability, MDPI, vol. 11(11), pages 1-16, June.
    20. Kraaijvanger, Richard & Veldkamp, Tom & Almekinders, Conny, 2016. "Considering change: Evaluating four years of participatory experimentation with farmers in Tigray (Ethiopia) highlighting both functional and human–social aspects," Agricultural Systems, Elsevier, vol. 147(C), pages 38-50.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:103:y:2024:i:c:s0149718924000132. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.