IDEAS home Printed from https://ideas.repec.org/a/pal/eurjdr/v35y2023i2d10.1057_s41287-023-00577-x.html
   My bibliography  Save this article

Evaluating Research for Development: Innovation to Navigate Complexity

Author

Listed:
  • Marina Apgar

    (Institute of Development Studies)

  • Mieke Snijder

    (Institute of Development Studies)

  • Grace Lyn Higdon

    (Independent)

  • Sylvia Szabo

    (Dongguk University)

Abstract

Large publicly funded programmes of research continue to receive increased investment as interventions aiming to produce impact for the world’s poorest and most marginalized populations. At this intersection of research and development, research is expected to contribute to complex processes of societal change. Embracing a co-produced view of impact as emerging along uncertain causal pathways often without predefined outcomes calls for innovation in the use of complexity-aware approaches to evaluation. The papers in this special issue present rich experiences of authors working across sectors and geographies, employing methodological innovation and navigating power as they reconcile tensions. They illustrate the challenges with (i) evaluating performance to meet accountability demands while fostering learning for adaptation; (ii) evaluating prospective theories of change while capturing emergent change; (iii) evaluating internal relational dimensions while measuring external development outcomes; (iv) evaluating across scales: from measuring local level end impact to understanding contributions to systems level change. Taken as a whole, the issue illustrates how the research for development evaluation field is maturing through the experiences of a growing and diverse group of researchers and evaluators as they shift from using narrow accountability instruments to appreciating emergent causal pathways within research for development.

Suggested Citation

  • Marina Apgar & Mieke Snijder & Grace Lyn Higdon & Sylvia Szabo, 2023. "Evaluating Research for Development: Innovation to Navigate Complexity," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 35(2), pages 241-259, April.
  • Handle: RePEc:pal:eurjdr:v:35:y:2023:i:2:d:10.1057_s41287-023-00577-x
    DOI: 10.1057/s41287-023-00577-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41287-023-00577-x
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1057/s41287-023-00577-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Reetta Muhonen & Paul Benneworth & Julia Olmos-Peñuela, 2020. "From productive interactions to impact pathways: Understanding the key dimensions in developing SSH research societal impact," Research Evaluation, Oxford University Press, vol. 29(1), pages 34-47.
    2. Rick Davies, 2018. "Representing theories of change: technical challenges with evaluation consequences," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 10(4), pages 438-461, October.
    3. Luisa Veras de Sandes-Guimarães & Raquel Velho & Guilherme Ary Plonski, 2022. "Interdisciplinary research and policy impacts: Assessing the significance of knowledge coproduction," Research Evaluation, Oxford University Press, vol. 31(3), pages 344-354.
    4. Jean Lebel & Robert McLean, 2018. "A better measure of research from the global south," Nature, Nature, vol. 559(7712), pages 23-26, July.
    5. repec:mpr:mprres:7320 is not listed on IDEAS
    6. Michael J. Hatton & Kent Schroeder, 2007. "Results-based management: friend or foe?," Development in Practice, Taylor & Francis Journals, vol. 17(3), pages 426-432, June.
    7. Lutz Bornmann, 2013. "What is societal impact of research and how can it be assessed? a literature survey," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(2), pages 217-233, February.
    8. Karl Aiginger, 2016. "New Dynamics for Europe: Reaping the Benefits of Socio-ecological Transition – Part I: Synthesis. WWWforEurope Deliverable No. 11," WIFO Studies, WIFO, number 58791, March.
    9. Maru, Yiheyis Taddele & Sparrow, Ashley & Butler, James R.A. & Banerjee, Onil & Ison, Ray & Hall, Andy & Carberry, Peter, 2018. "Towards appropriate mainstreaming of “Theory of Change” approaches into agricultural research for development: Challenges and opportunities," Agricultural Systems, Elsevier, vol. 165(C), pages 344-353.
    10. Neil McCulloch & Laure‐Hélène Piron, 2019. "Thinking and Working Politically: Learning from practice. Overview to Special Issue," Development Policy Review, Overseas Development Institute, vol. 37(S1), pages 1-15, June.
    11. Mehmet Pinar & Timothy J Horne, 2022. "Assessing research excellence: Evaluating the Research Excellence Framework," Research Evaluation, Oxford University Press, vol. 31(2), pages 173-187.
    12. Horton, Douglas & Mackay, Ronald, 2003. "Using evaluation to enhance institutional learning and change: recent experiences with agricultural research and development," Agricultural Systems, Elsevier, vol. 78(2), pages 127-142, November.
    13. Thornton, PK & Schuetz, T & Förch, W & Cramer, L & Abreu, D & Vermeulen, S & Campbell, BM, 2017. "Responding to global change: A theory of change approach to making agricultural research for development outcome-based," Agricultural Systems, Elsevier, vol. 152(C), pages 145-153.
    14. Ludovic Temple & Danielle Barret & Genowefa Blundo Canto & Marie-Hélène Dabat & Agathe Devaux-Spatarakis & Guy Faure & Etienne Hainzelin & Syndhia Mathé & Aurelie Toillier & Bernard Triomphe, 2018. "Assessing impacts of agricultural research for development: A systemic model focusing on outcomes," Research Evaluation, Oxford University Press, vol. 27(2), pages 157-170.
    15. Linden E Higgins & Julia M Smith, 2022. "Documenting development of interdisciplinary collaboration among researchers by visualizing connections," Research Evaluation, Oxford University Press, vol. 31(1), pages 159-172.
    16. Barbara Befani & Chris Barnett & Elliot Stern, 2014. "Introduction – Rethinking Impact Evaluation for Development," IDS Bulletin, Blackwell Publishing, vol. 45(6), pages 1-5, November.
    17. Brian M Belcher & Karl Hughes, 2021. "Understanding and evaluating the impact of integrated problem-oriented research programmes: Concepts and considerations," Research Evaluation, Oxford University Press, vol. 30(2), pages 154-168.
    18. Irene Guijt & Chris Roche, 2014. "Does Impact Evaluation in Development Matter? Well, It Depends What It’s For!," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 26(1), pages 46-54, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marina Apgar & Guillaume Fournie & Barbara Haesler & Grace Lyn Higdon & Leah Kenny & Annalena Oppel & Evelyn Pauls & Matthew Smith & Mieke Snijder & Daan Vink & Mazeda Hossain, 2023. "Revealing the Relational Mechanisms of Research for Development Through Social Network Analysis," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 35(2), pages 323-350, April.
    2. Juha-Pekka Lauronen, 2022. "Tension in Interpretations of the Social Impact of the Social Sciences: Walking a Tightrope Between Divergent Conceptualizations of Research Utilization," SAGE Open, , vol. 12(2), pages 21582440221, April.
    3. Sarah Chapman & Adiilah Boodhoo & Carren Duffy & Suki Goodman & Maria Michalopoulou, 2023. "Theory of Change in Complex Research for Development Programmes: Challenges and Solutions from the Global Challenges Research Fund," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 35(2), pages 298-322, April.
    4. Alba Viana Lora & Marta Gemma Nel-lo Andreu, 2020. "Alternative Metrics for Assessing the Social Impact of Tourism Research," Sustainability, MDPI, vol. 12(10), pages 1-12, May.
    5. Bornmann, Lutz & Haunschild, Robin & Adams, Jonathan, 2019. "Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK research excellence framework (REF)," Journal of Informetrics, Elsevier, vol. 13(1), pages 325-340.
    6. Juha-Pekka Lauronen, 2022. "The epistemic, production, and accountability prospects of social impact: An analysis of strategic research proposals," Research Evaluation, Oxford University Press, vol. 31(2), pages 214-225.
    7. Maru, Yiheyis Taddele, 2018. "Editorial Introduction: critical reflection on and learning from Agricultural Innovation Systems (AIS) Approaches and emerging Agricultural Research for Development (AR4D) practice," Agricultural Systems, Elsevier, vol. 165(C), pages 294-295.
    8. van der Heijden, Jeroen, 2024. "Unravelling programme success and complex causation in Agricultural Research for Development (AR4D): A systematic and comprehensive literature review," Agricultural Systems, Elsevier, vol. 215(C).
    9. Helka Kalliomäki & Sampo Ruoppila & Jenni Airaksinen, 2021. "It takes two to tango: Examining productive interactions in urban research collaboration [Generating Research Questions through Problematization]," Research Evaluation, Oxford University Press, vol. 30(4), pages 529-539.
    10. Faure, Guy & Barret, Danielle & Blundo-Canto, Genowefa & Dabat, Marie-Hélène & Devaux-Spatarakis, Agathe & Le Guerroué, Jean Louis & Marquié, Catherine & Mathé, Syndhia & Temple, Ludovic & Toillier, A, 2018. "How different agricultural research models contribute to impacts: Evidence from 13 case studies in developing countries," Agricultural Systems, Elsevier, vol. 165(C), pages 128-136.
    11. Marra, Mita, 2022. "Productive interactions in digital training partnerships: Lessons learned for regional development and university societal impact assessment," Evaluation and Program Planning, Elsevier, vol. 95(C).
    12. Jorrit P Smit & Laurens K Hessels, 2021. "The production of scientific and societal value in research evaluation: a review of societal impact assessment methods [Systems Thinking, Knowledge and Action: Towards Better Models and Methods]," Research Evaluation, Oxford University Press, vol. 30(3), pages 323-335.
    13. Gates, Emily & Rohn, Kathy Chau & Murugaiah, Kiruba, 2024. "Equity-related ‘knots’ in theory of change development: Conceptualization and case illustrations," Evaluation and Program Planning, Elsevier, vol. 103(C).
    14. Paget, Nicolas & Le Gal, Pierre-Yves & Goulet, Frédéric, 2024. "Motivations and challenges of intrapreneurship in research organizations. The case of decision support systems in agricultural research for development," Technovation, Elsevier, vol. 130(C).
    15. Kroll, Henning & Hansmeier, Hendrik & Hufnagl, Miriam, 2022. "Productive interactions in basic research an enquiry into impact pathways at the DESY synchrotron," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    16. Cook, Brian R. & Satizábal, Paula & Curnow, Jayne, 2021. "Humanising agricultural extension: A review," World Development, Elsevier, vol. 140(C).
    17. Andrea Bonaccorsi & Filippo Chiarello & Gualtiero Fantoni, 2021. "Impact for whom? Mapping the users of public research with lexicon-based text mining," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1745-1774, February.
    18. Thornton, Philip & Dijkman, Jeroen & Herrero, Mario & Szilagyi, Lili & Cramer, Laura, 2022. "Viewpoint: Aligning vision and reality in publicly funded agricultural research for development: A case study of CGIAR," Food Policy, Elsevier, vol. 107(C).
    19. Dotti, Nicola Francesco & Walczyk, Julia, 2022. "What is the societal impact of university research? A policy-oriented review to map approaches, identify monitoring methods and success factors," Evaluation and Program Planning, Elsevier, vol. 95(C).
    20. Genowefa Blundo-Canto & Bernard Triomphe & Guy Faure & Danielle Barret & Aurelle de Romemont & Etienne Hainzelin, 2019. "Building a culture of impact in an international agricultural research organization: Process and reflective learning," Research Evaluation, Oxford University Press, vol. 28(2), pages 136-144.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:eurjdr:v:35:y:2023:i:2:d:10.1057_s41287-023-00577-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave-journals.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.