IDEAS home Printed from https://ideas.repec.org/a/bla/srbeha/v33y2016i5p662-673.html
   My bibliography  Save this article

Towards Systemic Evaluation

Author

Listed:
  • Martin Reynolds
  • Emily Gates
  • Richard Hummelbrunner
  • Mita Marra
  • Bob Williams

Abstract

Problems of conventional evaluation models can be understood as an impoverished ‘conversation’ between realities (of non‐linearity, indeterminate attributes, and ever‐changing context), and models of evaluating such realities. Meanwhile, ideas of systems thinking and complexity science—grouped here under the acronym STCS—struggle to gain currency in the big ‘E’ world of institutionalized evaluation. Four evaluation practitioners familiar with evaluation tools associated with STCS offer perspectives on issues regarding mainstream uptake of STCS in the big ‘E’ world. The perspectives collectively suggest three features of practicing systemic evaluation: (i) developing value in conversing between bounded values (evaluations) and unbounded reality (evaluand), with humility; (ii) developing response‐ability with evaluand stakeholders based on reflexivity, with empathy; and (iii) developing adaptive rather than mere contingent use(fulness) of STCS ‘tools’ as part of evaluation praxis, with inevitable fallibility and an orientation towards bricolage (adaptive use). The features hint towards systemic evaluation as core to a reconfigured notion of developmental evaluation. Copyright © 2016 John Wiley & Sons, Ltd.

Suggested Citation

  • Martin Reynolds & Emily Gates & Richard Hummelbrunner & Mita Marra & Bob Williams, 2016. "Towards Systemic Evaluation," Systems Research and Behavioral Science, Wiley Blackwell, vol. 33(5), pages 662-673, September.
    • Handle: RePEc:bla:srbeha:v:33:y:2016:i:5:p:662-673
    DOI: 10.1002/sres.2423
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/sres.2423
    Download Restriction: no
    File URL: https://libkey.io/10.1002/sres.2423?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bonell, Christopher & Hargreaves, James & Strange, Vicki & Pronyk, Paul & Porter, John, 2006. "Should structural interventions be evaluated using RCTs? The case of HIV prevention," Social Science & Medicine, Elsevier, vol. 63(5), pages 1135-1142, September.
    2. Merry-Jo D. Levers, 2013. "Philosophical Paradigms, Grounded Theory, and Perspectives on Emergence," SAGE Open, , vol. 3(4), pages 21582440135, December.
    3. Lanham, Holly Jordan & Leykum, Luci K. & Taylor, Barbara S. & McCannon, C. Joseph & Lindberg, Curt & Lester, Richard T., 2013. "How complexity science can inform scale-up and spread in health care: Understanding the role of self-organization in variation across local contexts," Social Science & Medicine, Elsevier, vol. 93(C), pages 194-202.
    4. Martin Reynolds, 2015. "(Breaking) The Iron Triangle of Evaluation," IDS Bulletin, Blackwell Publishing, vol. 46(1), pages 71-86, January.
    5. Bob Williams, 2015. "Prosaic or Profound? The Adoption of Systems Ideas by Impact Evaluation," IDS Bulletin, Blackwell Publishing, vol. 46(1), pages 7-16, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Luis Arturo Pinzon‐Salcedo & María Alejandra Torres‐Cuello, 2022. "Systems thinking concepts within a collaborative programme evaluation methodology: The Hermes Programme evaluation," Systems Research and Behavioral Science, Wiley Blackwell, vol. 39(4), pages 708-722, July.
    2. Foote, J. & Midgley, G. & Ahuriri-Driscoll, A. & Hepi, M. & Earl-Goulet, J., 2021. "Systemic evaluation of community environmental management programmes," European Journal of Operational Research, Elsevier, vol. 288(1), pages 207-224.
    3. Bustamante, María & Rillo, Carlota & Niang, Ibrahima & Baker, Lauren & Vidueira, Pablo, 2024. "Harvesting insights for transformation: Developing and testing a participatory food systems modeling framework in Southern Senegal's poultry system," Agricultural Systems, Elsevier, vol. 217(C).
    4. Michael C. Jackson, 2023. "Critical systems practice 4: Check—Evaluating and reflecting on a multimethodological intervention," Systems Research and Behavioral Science, Wiley Blackwell, vol. 40(4), pages 617-632, July.
    5. Marra, Mita, 2022. "Productive interactions in digital training partnerships: Lessons learned for regional development and university societal impact assessment," Evaluation and Program Planning, Elsevier, vol. 95(C).
    6. Gerald Midgley & Erik Lindhult, 2021. "A systems perspective on systemic innovation," Systems Research and Behavioral Science, Wiley Blackwell, vol. 38(5), pages 635-670, October.
    7. Shiell, Alan & Hawe, Penelope & Kavanagh, Shane, 2020. "Evidence suggests a need to rethink social capital and social capital interventions," Social Science & Medicine, Elsevier, vol. 257(C).
    8. Watson Manduna & Roelien Goede & Lynette Drevin, 2022. "Incorporating various perspectives in using instant messages in teaching programming: A critical system thinking perspective," Systems Research and Behavioral Science, Wiley Blackwell, vol. 39(5), pages 947-961, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. daSilva, Madelyn & Dissanayake, Melanie & Sibbald, Shannon L., 2024. "Beyond implementation: A collective case study exploring the conceptions and facilitators of sustainability in a quality improvement collaborative," Evaluation and Program Planning, Elsevier, vol. 102(C).
    2. West, Robert M. & House, Allan O. & Keen, Justin & Ward, Vicky L., 2015. "Using the structure of social networks to map inter-agency relationships in public health services," Social Science & Medicine, Elsevier, vol. 145(C), pages 107-114.
    3. Hunsmann, Moritz, 2012. "Limits to evidence-based health policymaking: Policy hurdles to structural HIV prevention in Tanzania," Social Science & Medicine, Elsevier, vol. 74(10), pages 1477-1485.
    4. Mohajan, Devajit & Mohajan, Haradhan, 2023. "Families of Grounded Theory: A Theoretical Structure for Novel Researchers," MPRA Paper 116752, University Library of Munich, Germany, revised 24 Jan 2023.
    5. Dickson-Gomez, Julia & Corbett, A. Michelle & Bodnar, Gloria & Rodriguez, Karla & Guevara, Carmen E., 2010. "Resources and obstacles to developing and implementing a structural intervention to prevent HIV in San Salvador, El Salvador," Social Science & Medicine, Elsevier, vol. 70(3), pages 351-359, February.
    6. Emily Ryan & Matthew Pepper & Albert Munoz, 2021. "Causal Loop Diagram Aggregation Towards Model Completeness," Systemic Practice and Action Research, Springer, vol. 34(1), pages 37-51, February.
    7. Stephen Case, 2021. "Challenging the Reductionism of “Evidence-Based” Youth Justice," Sustainability, MDPI, vol. 13(4), pages 1-18, February.
    8. Rohanna, Kristen L. & Christie, Christina A., 2023. "A problem-bound evaluation approach," Evaluation and Program Planning, Elsevier, vol. 96(C).
    9. Ballet, Jérôme & Bazin, Damien Jérôme Albert & Komena, Boniface K., 2020. "Unequal capabilities and natural resource management: The case of Côte d’Ivoire," World Development, Elsevier, vol. 134(C).
    10. Gates, Emily F. & Madres, Joseph & Hall, Jori N. & Alvarez, Kayla Benitez, 2022. "It takes an ecosystem: Socioecological factors influencing equity-oriented evaluation in New England, U.S., 2021," Evaluation and Program Planning, Elsevier, vol. 92(C).
    11. C. M. Bhuvaneswari & K. Maruthamuthu, 2024. "Analysing the Art of Service Quality and Customer Satisfaction of Digital Banking Services: A SEM Approach," International Review of Management and Marketing, Econjournals, vol. 14(4), pages 202-209, July.
    12. Galai, Noya & Sirirojn, Bangorn & Aramrattana, Apinun & Srichan, Kamolrawee & Thomson, Nicholas & Golozar, Asieh & Flores, Jose M. & Willard, Nancy & Ellen, Jonathan M. & Sherman, Susan G. & Celentano, 2018. "A cluster randomized trial of community mobilization to reduce methamphetamine use and HIV risk among youth in Thailand: Design, implementation and results," Social Science & Medicine, Elsevier, vol. 211(C), pages 216-223.
    13. Kalyani Subbiah & Arima Mishra & Jaya A. R. Dantas, 2023. "Gynaecological Cancers in India: The Less Heard Perspectives of Healthcare Providers," IJERPH, MDPI, vol. 20(3), pages 1-16, January.
    14. Steve Waddell & Sandra Waddock & Simone Martino & Jonny Norton, 2023. "Emerging Economic Operating Infrastructure to Support Wellbeing Economies," Humanistic Management Journal, Springer, vol. 8(1), pages 63-88, April.
    15. Senier, Laura & Smollin, Leandra & Lee, Rachael & Nicoll, Lauren & Shields, Michael & Tan, Catherine, 2018. "Navigating the evidentiary turn in public health: Sensemaking strategies to integrate genomics into state-level chronic disease prevention programs," Social Science & Medicine, Elsevier, vol. 211(C), pages 207-215.
    16. Sartas, Murat & Schut, Marc & Proietti, Claudio & Thiele, Graham & Leeuwis, Cees, 2020. "Scaling Readiness: Science and practice of an approach to enhance impact of research for development," Agricultural Systems, Elsevier, vol. 183(C).
    17. Szijarto, Barbara & Bradley Cousins, J., 2019. "Mapping the practice of developmental evaluation: Insights from a concept mapping study," Evaluation and Program Planning, Elsevier, vol. 76(C), pages 1-1.
    18. Perez Jolles, Monica & McBeath, Bowen & Collins-Camargo, Crystal & Chuang, Emmeline, 2022. "Organizational complexity within private child welfare agencies in the United States and impact on agency performance outlook," Children and Youth Services Review, Elsevier, vol. 143(C).
    19. Zoe Zon Be Lim & Mumtaz Mohamed Kadir & Mimaika Luluina Ginting & Hubertus Johannes Maria Vrijhoef & Joanne Yoong & Chek Hooi Wong, 2021. "Early Implementation of a Patient-Centered Medical Home in Singapore: A Qualitative Study Using Theory on Diffusion of Innovations," IJERPH, MDPI, vol. 18(21), pages 1-20, October.
    20. Fregidou-Malama, Maria & Hyder, Akmal S., 2021. "Multilevel trust in international marketing of healthcare services: A five-country comparative study," International Business Review, Elsevier, vol. 30(6).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:srbeha:v:33:y:2016:i:5:p:662-673. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1111/1092-7026 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.