IDEAS home Printed from https://ideas.repec.org/a/eee/anture/v100y2023ics0160738323000452.html
   My bibliography  Save this article

Evaluating policy complexity with Causal Loop Diagrams

Author

Listed:
  • Crabolu, Gloria
  • Font, Xavier
  • Eker, Sibel

Abstract

Methods to capture the complexity of using policy instruments would allow us to better evaluate the reasons for their effectiveness. Drawing from complexity science, we produce a Causal Loop Diagram to analyse the implementation of two informational policy instruments in a tourism destination: the Global Sustainable Tourism Council criteria and the European Tourism Indicator Scheme. To interpret the emerging system structure, we use complexity theory concepts of emergence; interdependence and interconnectivity; co-evolution; self-organisation; feedback; historicity and path dependence. This qualitative methodology sheds light on the interplay of factors that facilitate and impede the continuous use of these policy instruments. It shows how adopting a complexity science approach to evaluation studies can be invaluable to making tourism policy interventions more impactful.

Suggested Citation

  • Crabolu, Gloria & Font, Xavier & Eker, Sibel, 2023. "Evaluating policy complexity with Causal Loop Diagrams," Annals of Tourism Research, Elsevier, vol. 100(C).
    • Handle: RePEc:eee:anture:v:100:y:2023:i:c:s0160738323000452
    DOI: 10.1016/j.annals.2023.103572
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160738323000452
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.annals.2023.103572?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jari Lyytimäki & Hanna Salo & Robert Lepenies & Leonie Büttner & Jyri Mustajoki, 2020. "Risks of producing and using indicators of sustainable development goals," Sustainable Development, John Wiley & Sons, Ltd., vol. 28(6), pages 1528-1538, November.
    2. Christopher Ansell & Robert Geyer, 2017. "‘Pragmatic complexity’ a new foundation for moving beyond ‘evidence-based policy making’?," Policy Studies, Taylor & Francis Journals, vol. 38(2), pages 149-167, March.
    3. Paul Cairney, 2012. "Complexity Theory in Political Science and Public Policy," Political Studies Review, Political Studies Association, vol. 10(3), pages 346-358, September.
    4. Marco Valeri & Rodolfo Baggio, 2021. "Italian tourism intermediaries: a social network analysis exploration," Current Issues in Tourism, Taylor & Francis Journals, vol. 24(9), pages 1270-1283, May.
    5. Cairney,Paul & Heikkila,Tanya & Wood,Matthew, 2019. "Making Policy in a Complex World," Cambridge Books, Cambridge University Press, number 9781108729109, October.
    6. Michael A. Levy & Mark N. Lubell & Neil McRoberts, 2018. "The structure of mental models of sustainable agriculture," Nature Sustainability, Nature, vol. 1(8), pages 413-420, August.
    7. Patrizia Modica & Alessandro Capocchi & Ilaria Foroni & Mariangela Zenga, 2018. "An Assessment of the Implementation of the European Tourism Indicator System for Sustainable Destinations in Italy," Sustainability, MDPI, vol. 10(9), pages 1-21, September.
    8. Boulton, Jean G. & Allen, Peter M. & Bowman, Cliff, 2015. "Embracing Complexity: Strategic Perspectives for an Age of Turbulence," OUP Catalogue, Oxford University Press, number 9780199565269.
    9. Mihalic, Tanja, 2020. "Conceptualising overtourism: A sustainability approach," Annals of Tourism Research, Elsevier, vol. 84(C).
    10. Spyros Niavis & Theodora Papatheochari & Yannis Psycharis & Josep Rodriguez & Xavier Font & Anna Martinez Codina, 2019. "Conceptualising Tourism Sustainability and Operationalising Its Assessment: Evidence from a Mediterranean Community of Projects," Sustainability, MDPI, vol. 11(15), pages 1-18, July.
    11. Suno Wu, Jenny & Barbrook-Johnson, Pete & Font, Xavier, 2021. "Participatory complexity in tourism policy: Understanding sustainability programmes with participatory systems mapping," Annals of Tourism Research, Elsevier, vol. 90(C).
    12. Julian Burton & Sam Mockett, 2018. "The art of complexity: using visual artefacts and dialogue to bridge the gap between strategic plans and local actions in organisations," Chapters, in: Eve Mitleton-Kelly & Alexandros Paraskevas & Christopher Day (ed.), Handbook of Research Methods in Complexity Science, chapter 8, pages 137-156, Edward Elgar Publishing.
    13. Åžerban Scrieciu & Liz Varga & Nici Zimmermann & Zaid Chalabi & Rachel Freeman & Tom Dolan & Dmitry E. Borisoglebsky & Mike Davies & Ana Teixeira de Melo, 2022. "An Inquiry into Model Validity When Addressing Complex Sustainability Challenges," Complexity, Hindawi, vol. 2022, pages 1-17, September.
    14. Dredge, Dianne & Jamal, Tazim, 2015. "Progress in tourism planning and policy: A post-structural perspective on knowledge production," Tourism Management, Elsevier, vol. 51(C), pages 285-297.
    15. Ian Sanderson, 2009. "Intelligent Policy Making for a Complex World: Pragmatism, Evidence and Learning," Political Studies, Political Studies Association, vol. 57(4), pages 699-719, December.
    16. Ian Sanderson, 2009. "Intelligent Policy Making for a Complex World: Pragmatism, Evidence and Learning," Political Studies, Political Studies Association, vol. 57, pages 699-719, December.
    17. Yearworth, Mike & White, Leroy, 2013. "The uses of qualitative data in multimethodology: Developing causal loop diagrams during the coding process," European Journal of Operational Research, Elsevier, vol. 231(1), pages 151-161.
    18. Blackstock, K.L. & Novo, P. & Byg, A. & Creaney, R. & Juarez Bourke, A. & Maxwell, J.L. & Tindale, S.J. & Waylen, K.A., 2021. "Policy instruments for environmental public goods: Interdependencies and hybridity," Land Use Policy, Elsevier, vol. 107(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Crabolu, Gloria & Font, Xavier & Eker, Sibel, 2023. "Evaluating Policy Instrument Complexity With Causal Loop Diagrams," SocArXiv 2c83b, Center for Open Science.
    2. Yi Yang, 2021. "Critical realism and complexity theory: Building a nonconstructivist systems research framework for effective governance analysis," Systems Research and Behavioral Science, Wiley Blackwell, vol. 38(1), pages 177-183, January.
    3. O’Connor John, 2022. "Strengthening the science–policy interface in Ireland," Administration, Sciendo, vol. 70(4), pages 29-52, December.
    4. Paul Cairney, 2015. "Debate: What is complex government and what can we do about it?," Public Money & Management, Taylor & Francis Journals, vol. 35(1), pages 3-6, January.
    5. Ansell, Christopher K. & Bartenberger, Martin, 2016. "Varieties of experimentalism," Ecological Economics, Elsevier, vol. 130(C), pages 64-73.
    6. Claire A Dunlop, 2014. "The Possible Experts: How Epistemic Communities Negotiate Barriers to Knowledge Use in Ecosystems Services Policy," Environment and Planning C, , vol. 32(2), pages 208-228, April.
    7. Srinivasa Vittal Katikireddi & Shona Hilton & Chris Bonell & Lyndal Bond, 2014. "Understanding the Development of Minimum Unit Pricing of Alcohol in Scotland: A Qualitative Study of the Policy Process," PLOS ONE, Public Library of Science, vol. 9(3), pages 1-10, March.
    8. Jessica H. Phoenix & Lucy G. Atkinson & Hannah Baker, 2019. "Creating and communicating social research for policymakers in government," Palgrave Communications, Palgrave Macmillan, vol. 5(1), pages 1-11, December.
    9. Walton, Mat, 2014. "Applying complexity theory: A review to inform evaluation design," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 119-126.
    10. Stucki, Iris, 2018. "Evidence-based arguments in direct democracy: The case of smoking bans in Switzerland," Evaluation and Program Planning, Elsevier, vol. 69(C), pages 148-156.
    11. Deas, L. & Mattu, L. & Gnich, W., 2013. "Intelligent policy making? Key actors' perspectives on the development and implementation of an early years' initiative in Scotland's public health arena," Social Science & Medicine, Elsevier, vol. 96(C), pages 1-8.
    12. Nguyen, Sun V. & Langston, Nancy & Wellstead, Adam & Howlett, Michael, 2020. "Mining the evidence: Public comments and evidence-based policymaking in the controversial Minnesota PolyMet mining project," Resources Policy, Elsevier, vol. 69(C).
    13. Willis, Cameron David & Corrigan, Crystal & Stockton, Lisa & Greene, Julie Kathryn & Riley, Barbara Lyn, 2017. "Exploring the unanticipated effects of multi-sectoral partnerships in chronic disease prevention," Health Policy, Elsevier, vol. 121(2), pages 158-168.
    14. Belinda McFadgen & Dave Huitema, 2018. "Experimentation at the interface of science and policy: a multi-case analysis of how policy experiments influence political decision-makers," Policy Sciences, Springer;Society of Policy Sciences, vol. 51(2), pages 161-187, June.
    15. Plante, Charles, 2018. "Policy or Window Dressing? Exploring the Impact of Poverty Reduction Strategies on Poverty Rates among the Canadian Provinces," SocArXiv xtnfg, Center for Open Science.
    16. Paul Lewis, 2021. "The innovation systems approach: an Austrian and Ostromian perspective," The Review of Austrian Economics, Springer;Society for the Development of Austrian Economics, vol. 34(1), pages 97-114, March.
    17. Greenhalgh, Trisha & Engebretsen, Eivind, 2022. "The science-policy relationship in times of crisis: An urgent call for a pragmatist turn," Social Science & Medicine, Elsevier, vol. 306(C).
    18. Pierre-Olivier Bédard, 2015. "The Mobilization of Scientific Evidence by Public Policy Analysts," SAGE Open, , vol. 5(3), pages 21582440156, September.
    19. Gates, Emily F., 2016. "Making sense of the emerging conversation in evaluation about systems thinking and complexity science," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 62-73.
    20. William Ascher, 2021. "Coping with intelligence deficits in poverty-alleviation policies in low-income countries," Policy Sciences, Springer;Society of Policy Sciences, vol. 54(2), pages 345-370, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:anture:v:100:y:2023:i:c:s0160738323000452. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/annals-of-tourism-research/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.