IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v97y2023ics0149718923000344.html
   My bibliography  Save this article

Learning from experiences of evaluators implementing theory-driven evaluations in diverse settings: Building on the contributions of John Mayne

Author

Listed:
  • Sridharan, Sanjeev
  • Nakaima, April

Abstract

The papers in this volume grapple with various issues related to the use of theories of change in program evaluation. This introductory paper reviews some of the critical challenges that arise in developing and learning from theory-driven evaluations. These challenges include the relationship between theories of change and ecologies of evidence, the need for epistemic fluency in learning, and coming to terms with the initial incompleteness of knowledge in program mechanisms. The nine papers that follow, which represent a geographically diverse set of evaluations and evaluators (including Scotland, India, Canada, USA), help develop these and other themes. This volume of papers also serves as a celebration of the work of John Mayne, one of the foremost theory-driven evaluators of the last few decades. John passed away in December of 2020. This volume is intended to honor his legacy while also identifying challenging issues that call for further development.

Suggested Citation

  • Sridharan, Sanjeev & Nakaima, April, 2023. "Learning from experiences of evaluators implementing theory-driven evaluations in diverse settings: Building on the contributions of John Mayne," Evaluation and Program Planning, Elsevier, vol. 97(C).
    • Handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718923000344
    DOI: 10.1016/j.evalprogplan.2023.102257
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718923000344
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2023.102257?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sridharan, Sanjeev & Nakaima, April, 2011. "Ten steps to making evaluation matter," Evaluation and Program Planning, Elsevier, vol. 34(2), pages 135-146, May.
    2. Nkwake, Apollo M. & Morrow, Nathan, 2016. "Clarifying concepts and categories of assumptions for use in evaluation," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 97-101.
    3. Michael Woolcock, 2009. "Toward a plurality of methods in project evaluation: a contextualised approach to understanding impact trajectories and efficacy," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 1(1), pages 1-14.
    4. Sridharan, Sanjeev & Jones, Bobby & Caudill, Barry & Nakaima, April, 2016. "Steps towards incorporating heterogeneities into program theory: A case study of a data-driven approach," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 88-97.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tannahill, Carol & Sridharan, Sanjeev, 2013. "Getting real about policy and practice needs: Evaluation as a bridge between the problem and solution space," Evaluation and Program Planning, Elsevier, vol. 36(1), pages 157-164.
    2. Sridharan, Sanjeev & Jones, Bobby & Caudill, Barry & Nakaima, April, 2016. "Steps towards incorporating heterogeneities into program theory: A case study of a data-driven approach," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 88-97.
    3. Clark, Alexander M., 2013. "What are the components of complex interventions in healthcare? Theorizing approaches to parts, powers and the whole intervention," Social Science & Medicine, Elsevier, vol. 93(C), pages 185-193.
    4. Cornwall, Andrea & Aghajanian, Alia, 2017. "How to Find out What’s Really Going On: Understanding Impact through Participatory Process Evaluation," World Development, Elsevier, vol. 99(C), pages 173-185.
    5. Sara Nadel and Lant Pritchett, 2016. "Searching for the Devil in the Details: Learning about Development Program Design," Working Papers 434, Center for Global Development.
    6. David McKenzie & Christopher Woodruff, 2014. "What Are We Learning from Business Training and Entrepreneurship Evaluations around the Developing World?," The World Bank Research Observer, World Bank, vol. 29(1), pages 48-82.
    7. Juan, Parra, 2017. "¿Qué Funciona, Para Quién, En Qué Aspectos, Hasta Qué Punto, En Qué Contexto Y Cómo? Una Introducción A La Evaluación Realista Y Sus Métodos [What Works, For Whom, In What Respects, To What Extent,," MPRA Paper 81137, University Library of Munich, Germany.
    8. Maru, Yiheyis Taddele & Sparrow, Ashley & Butler, James R.A. & Banerjee, Onil & Ison, Ray & Hall, Andy & Carberry, Peter, 2018. "Towards appropriate mainstreaming of “Theory of Change” approaches into agricultural research for development: Challenges and opportunities," Agricultural Systems, Elsevier, vol. 165(C), pages 344-353.
    9. Mehdipanah, Roshanak & Manzano, Ana & Borrell, Carme & Malmusi, Davide & Rodriguez-Sanz, Maica & Greenhalgh, Joanne & Muntaner, Carles & Pawson, Ray, 2015. "Exploring complex causal pathways between urban renewal, health and health inequality using a theory-driven realist approach," Social Science & Medicine, Elsevier, vol. 124(C), pages 266-274.
    10. Kenzie, Erin S. & Wakeland, Wayne & Jetter, Antonie & Lich, Kristen Hassmiller & Seater, Mellodie & Gunn, Rose & Davis, Melinda M., 2024. "Protocol for an interview-based method for mapping mental models using causal-loop diagramming and realist interviewing," Evaluation and Program Planning, Elsevier, vol. 103(C).
    11. Mendoza Alcantara, Alejandra & Woolcock, Michael, 2014. "Integrating qualitative methods into investment climate impact evaluations," Policy Research Working Paper Series 7145, The World Bank.
    12. McKenzie, David, 2012. "Beyond baseline and follow-up: The case for more T in experiments," Journal of Development Economics, Elsevier, vol. 99(2), pages 210-221.
    13. Rao, Vijayendra & Ananthpur, Kripa & Malik, Kabir, 2017. "The Anatomy of Failure: An Ethnography of a Randomized Trial to Deepen Democracy in Rural India," World Development, Elsevier, vol. 99(C), pages 481-497.
    14. Rao, Vijayendra, 2020. "Evidence-based development needs a diversity of tools, with a bottom-up process of “embedded” dialogue," World Development, Elsevier, vol. 127(C).
    15. Nordhagen, Stella & Nielsen, Jennifer & van Mourik, Tom & Smith, Erin & Klemm, Rolf, 2019. "Fostering CHANGE: Lessons from implementing a multi-country, multi-sector nutrition-sensitive agriculture project," Evaluation and Program Planning, Elsevier, vol. 77(C).
    16. Sridharan, Sanjeev & Nakaima, April, 2020. "Valuing and embracing complexity: How an understanding of complex interventions needs to shape our evaluation capacities building initiatives," Evaluation and Program Planning, Elsevier, vol. 80(C).
    17. Nakaima, April & Sridharan, Sanjeev & Gibson, Rachael, 2023. "Towards an evolutionary approach to learning from assumptions: Lessons from the evaluation of Dancing with Parkinson’s," Evaluation and Program Planning, Elsevier, vol. 97(C).
    18. Arasanz, Carla & Nylen, Kirk, 2020. "The theory of change of the evaluation support program: Enhancing the role of community organizations in providing an ecology of care for neurological disorders," Evaluation and Program Planning, Elsevier, vol. 80(C).
    19. Okwaro, Ferdinand M. & Chandler, Clare I.R. & Hutchinson, Eleanor & Nabirye, Christine & Taaka, Lilian & Kayendeke, Miriam & Nayiga, Susan & Staedke, Sarah G., 2015. "Challenging logics of complex intervention trials: Community perspectives of a health care improvement intervention in rural Uganda," Social Science & Medicine, Elsevier, vol. 131(C), pages 10-17.
    20. Daoud, Adel & Herlitz, Anders & Subramanian, S.V., 2022. "IMF fairness: Calibrating the policies of the International Monetary Fund based on distributive justice," World Development, Elsevier, vol. 157(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718923000344. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.