IDEAS home Printed from https://ideas.repec.org/a/taf/jdevef/v6y2014i4p337-349.html
   My bibliography  Save this article

Measuring results in development: the role of impact evaluation in agency-wide performance measurement systems

Author

Listed:
  • Richard Manning
  • Howard White

Abstract

The need to demonstrate results has been growing over the last two decades. There is a growing recognition that outcome monitoring only tells us what happened, not why it happened, and so outcome monitoring cannot give useful information about the effectiveness of development interventions. Many agencies are turning to impact evaluations to assess the change in outcomes which may be attributed to their interventions. As more impact evaluations are produced, the question arises as to how these studies can be used to assess how the agency as a whole is performing. We discuss the 'triple A' principles for an Agency Wide Performance Measurement System (AWPMS) - alignment, attribution, and aggregation - as well as several other challenges faced in designing and implementing such systems: the balance between lesson learning and accountability, independence versus influence, modifying incentive structures for results, determining how many impact evaluations to conduct and of what, and ensuring the use of these studies. We conclude by urging greater cooperation between those charged with measuring results and those conducting impact evaluations in order to develop AWPMS which can meaningfully report on agency performance.

Suggested Citation

  • Richard Manning & Howard White, 2014. "Measuring results in development: the role of impact evaluation in agency-wide performance measurement systems," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 6(4), pages 337-349, December.
    • Handle: RePEc:taf:jdevef:v:6:y:2014:i:4:p:337-349
    DOI: 10.1080/19439342.2014.989673
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/19439342.2014.989673
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/19439342.2014.989673?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Howard White, 2005. "Challenges in Evaluating Development Effectiveness," Development and Comp Systems 0504014, University Library of Munich, Germany.
    2. Drew B. Cameron & Anjini Mishra & Annette N. Brown, 2016. "The growth of impact evaluation for international development: how much have we learned?," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 8(1), pages 1-21, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Funk, Evelyn & Groß, Lisa & Leininger, Julia & von Schiller, Armin, 2018. "Lessons learnt from impact-oriented accompanying research: potentials and limitations to rigorously assessing the impact of governance programmes," IDOS Discussion Papers 28/2018, German Institute of Development and Sustainability (IDOS).
    2. Funk, Evelyn & Groß, Lisa & Leininger, Julia & von Schiller, Armin, 2019. "Erkenntnisse aus der wirkungsorientierten Begleitforschung: Potential und Grenzen der rigorosen Wirkungsanalyse von Governance-Programmen," IDOS Discussion Papers 13/2019, German Institute of Development and Sustainability (IDOS).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christopher J. Ruhm, 2019. "Shackling the Identification Police?," Southern Economic Journal, John Wiley & Sons, vol. 85(4), pages 1016-1026, April.
    2. Julia Fischer-Mackey, 2024. "What Do Practitioners Want from Research? Exploring Ugandan and American Development Practitioners’ Interest in Research," Progress in Development Studies, , vol. 24(1), pages 27-47, January.
    3. Larry L. Orr, 2018. "The Role of Evaluation in Building Evidence-Based Policy," The ANNALS of the American Academy of Political and Social Science, , vol. 678(1), pages 51-59, July.
    4. Salazar, Lina & Aramburu, Julián & González-Flores, Mario & Winters, Paul, 2016. "Sowing for food security: A case study of smallholder farmers in Bolivia," Food Policy, Elsevier, vol. 65(C), pages 32-52.
    5. Ruth Alsop & Mette Bertelsen & Jeremy Holland, 2006. "Empowerment in Practice : From Analysis to Implementation," World Bank Publications - Books, The World Bank Group, number 6980.
    6. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Documents de travail du Centre d'Economie de la Sorbonne 22008, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    7. Benjamin D K Wood & Rui Müller & Annette N Brown, 2018. "Push button replication: Is impact evaluation evidence for international development verifiable?," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-15, December.
    8. Rizwana Siddiqui, 2013. "Impact Evaluation of Remittances for Pakistan: Propensity Score Matching Approach," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 52(1), pages 17-44.
    9. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Post-Print halshs-03623394, HAL.
    10. Richard Manning & Ian Goldman & Gonzalo Hernández Licona, 2020. "The impact of impact evaluation: Are impact evaluation and impact evaluation synthesis contributing to evidence generation and use in low- and middle-income countries?," WIDER Working Paper Series wp-2020-20, World Institute for Development Economic Research (UNU-WIDER).
    11. Marschall, Paul, 2018. "Evidence-oriented approaches in development cooperation: experiences, potential and key issues," IDOS Discussion Papers 8/2018, German Institute of Development and Sustainability (IDOS).
    12. Vivalt, Eva & Coville, Aidan, 2023. "How do policymakers update their beliefs?," Journal of Development Economics, Elsevier, vol. 165(C).
    13. Jason Corburn & Alice Sverdlik, 2017. "Slum Upgrading and Health Equity," IJERPH, MDPI, vol. 14(4), pages 1-12, March.
    14. Boris E. Bravo‐Ureta & Mario González‐Flores & William Greene & Daniel Solís, 2021. "Technology and Technical Efficiency Change: Evidence from a Difference in Differences Selectivity Corrected Stochastic Production Frontier Model," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(1), pages 362-385, January.
    15. Obie Porteous, 2022. "Research Deserts and Oases: Evidence from 27 Thousand Economics Journal Articles on Africa," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(6), pages 1235-1258, December.
    16. Muñiz Castillo, M.R. & Gasper, D.R., 2011. "Human autonomy effectiveness and development projects," ISS Working Papers - General Series 22692, International Institute of Social Studies of Erasmus University Rotterdam (ISS), The Hague.
    17. Sebastian Haug & Jack Taggart, 2024. "Global Development Governance 2.0: Fractured accountabilities in a divided governance complex," Global Policy, London School of Economics and Political Science, vol. 15(1), pages 128-134, February.
    18. O’Leary, Susan & Smith, David, 2020. "Moments of resistance: An internally persuasive view of performance and impact reports in non-governmental organizations," Accounting, Organizations and Society, Elsevier, vol. 85(C).
    19. Carrie B Dolan & Kaci Kennedy McDade, 2020. "Pulling the purse strings: Are there sectoral differences in political preferencing of Chinese aid to Africa?," PLOS ONE, Public Library of Science, vol. 15(4), pages 1-18, April.
    20. Darius Erlangga & Marc Suhrcke & Shehzad Ali & Karen Bloor, 2019. "The impact of public health insurance on health care utilisation, financial protection and health status in low- and middle-income countries: A systematic review," PLOS ONE, Public Library of Science, vol. 14(8), pages 1-20, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jdevef:v:6:y:2014:i:4:p:337-349. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/RJDE20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.