IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/7157.html
   My bibliography  Save this paper

Impact evaluation helps deliver development projects

Author

Listed:
  • Legovini, Arianna
  • Di Maro, Vincenzo
  • Piza, Caio

Abstract

Does research add value to aid? Specifically, does impact evaluation research help or hinder the delivery of development projects? This paper analyzes the question by constructing a new data set of 100 impact evaluations and 1,135 projects approved by the World Bank between 2005 and 2011. The analysis finds that the delivery of projects with impact evaluation is significantly timelier: common delays are avoided and the gap between planned and actual disbursements is reduced by half. Evidence-based mid-course corrections, a clearer implementation road map, strengthened capacity on the ground, and observer effects are possible channels to explain the results. Hopefully, this analysis will stimulate discussion over the optimal balance between project financing and the impact evaluation research needed to deliver development outcomes.

Suggested Citation

  • Legovini, Arianna & Di Maro, Vincenzo & Piza, Caio, 2015. "Impact evaluation helps deliver development projects," Policy Research Working Paper Series 7157, The World Bank.
  • Handle: RePEc:wbk:wbrwps:7157
    as

    Download full text from publisher

    File URL: http://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/2015/01/06/000158349_20150106152246/Rendered/PDF/WPS7157.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. World Bank, 2012. "The World Bank Annual Report 2012," World Bank Publications - Books, The World Bank Group, number 11845.
    2. Kilby, Christopher, 2013. "The political economy of project preparation: An empirical analysis of World Bank projects," Journal of Development Economics, Elsevier, vol. 105(C), pages 211-225.
    3. Inder Ruprah & Luis Marcano, 2009. "Does technical assistance matter? An impact evaluation approach to estimate its value added," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 1(4), pages 507-528.
    4. Edoardo Masset & Marie Gaarder & Penelope Beynon & Christelle Chapoy, 2013. "What is the impact of a policy brief? Results of an experiment in research dissemination," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 5(1), pages 50-63, March.
    5. Kilby, Christopher, 2000. "Supervision and performance: the case of World Bank projects," Journal of Development Economics, Elsevier, vol. 62(1), pages 233-259, June.
    6. Denizer, Cevdet & Kaufmann, Daniel & Kraay, Aart, 2013. "Good countries or good projects? Macro and micro correlates of World Bank project performance," Journal of Development Economics, Elsevier, vol. 105(C), pages 288-302.
    7. World Bank, 2012. "The World Bank Annual Report 2012," World Bank Publications - Books, The World Bank Group, number 11846.
    8. Inder Ruprah & Luis Marcano, 2009. "Does technical assistance matter? An impact evaluation approach to estimate its value added," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 1(4), pages 507-528.
    9. World Bank, 2009. "Annual Review of Development Effectiveness 2009 : Achieving Sustainable Development," World Bank Publications - Reports 10533, The World Bank Group.
    10. Brune, Lasse & Gine, Xavier & Goldberg, Jessica & Yang, Dean, 2011. "Commitments to save : a field experiment in rural Malawi," Policy Research Working Paper Series 5748, The World Bank.
    11. World Bank, 2012. "The World Bank Annual Report 2012," World Bank Publications - Books, The World Bank Group, number 11844.
    12. Iqbal Dhaliwal & Caitlin Tulloch, 2012. "From research to policy: using evidence from impact evaluations to inform development policy," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 4(4), pages 515-536, December.
    13. Vinod Thomas & Jiro Tominaga, 2010. "Evaluation for better development results," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 2(3), pages 371-386.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Post-Print halshs-03623394, HAL.
    2. Daniel L. Nielson & Bradley Parks & Michael J. Tierney, 2017. "International organizations and development finance: Introduction to the special issue," The Review of International Organizations, Springer, vol. 12(2), pages 157-169, June.
    3. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-03623394, HAL.
    4. Puri, Jyotsna & Rastogi, Archi & Prowse, Martin & Asfaw, Solomon, 2020. "Good will hunting: Challenges of theory-based impact evaluations for climate investments in a multilateral setting," World Development, Elsevier, vol. 127(C).
    5. Victor Orozco-Olvera & Fuyuan Shen & Lucie Cluver, 2019. "The effectiveness of using entertainment education narratives to promote safer sexual behaviors of youth: A meta-analysis, 1985-2017," PLOS ONE, Public Library of Science, vol. 14(2), pages 1-14, February.
    6. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Documents de travail du Centre d'Economie de la Sorbonne 22008, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    7. Richard Manning & Ian Goldman & Gonzalo Hernández Licona, 2020. "The impact of impact evaluation: Are impact evaluation and impact evaluation synthesis contributing to evidence generation and use in low- and middle-income countries?," WIDER Working Paper Series wp-2020-20, World Institute for Development Economic Research (UNU-WIDER).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Charyulu, Kumara D. & Singh, N.P. & Shyam, Moses D. & Bantilan, C., 2014. "Development and Diffusion of Dryland Cereals in Semi-Arid Tropics of India — Role of Partnerships," Agricultural Economics Research Review, Agricultural Economics Research Association (India), vol. 27(Conferenc).
    2. Surabhi Singh & Moushumi Basu, 2014. "A Subaltern Reading of International Organisations and Issues of Order, Disorder and Marginality," South Asian Survey, , vol. 21(1-2), pages 164-179, March.
    3. Lodewijk Smets & Stephen Knack & Nadia Molenaers, 2013. "Political ideology, quality at entry and the success of economic reform programs," The Review of International Organizations, Springer, vol. 8(4), pages 447-476, December.
    4. Mukherjee, Swayambhu & Kar, Saibal, 2020. "Leveraging Non-Farm Income: Micro-evidence of Occupational Choice for Rural Households in India," MPRA Paper 109940, University Library of Munich, Germany.
    5. Ochia, Stevenson Enemuwa (Doctorial Student) & Bobmanuel, Karibi Benson PhD & Umunnah, Blessing Onyinyechukwu PhD, 2022. "Port Harcourt Residents’ Perception of Energyplatform Programme on Nigeria Info 92.3FM," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 6(12), pages 794-802, December.
    6. Kilby, Christopher, 2015. "Assessing the impact of World Bank preparation on project outcomes," Journal of Development Economics, Elsevier, vol. 115(C), pages 111-123.
    7. Robert G. Blanton & Shannon Lindsey Blanton, 2015. "Is Foreign Direct Investment "Gender Blind"? Women's Rights as a Determinant of US FDI," Feminist Economics, Taylor & Francis Journals, vol. 21(4), pages 61-88, October.
    8. Xhoxhi, Orjon & Pedersen, Søren Marcus & Lind, Kim Martin & Yazar, Attila, 2014. "The Determinants of Intermediaries’ Power over Farmers’ Margin-Related Activities: Evidence from Adana, Turkey," World Development, Elsevier, vol. 64(C), pages 815-827.
    9. Jaber, J.O. & Elkarmi, Fawwaz & Alasis, Emil & Kostas, Anagnostopoulos, 2015. "Employment of renewable energy in Jordan: Current status, SWOT and problem analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 49(C), pages 490-499.
    10. Rachel Wolfgramm & Sian Flynn-Coleman & Denise Conroy, 2015. "Dynamic Interactions of Agency in Leadership (DIAL): An Integrative Framework for Analysing Agency in Sustainability Leadership," Journal of Business Ethics, Springer, vol. 126(4), pages 649-662, February.
    11. Kent Matthews, 2014. "Cost Inefficiency in the Pakistan Banking Sector 2002-2009," SBP Research Bulletin, State Bank of Pakistan, Research Department, vol. 10, pages 1-20.
    12. Mirko Heinzel & Andrea Liese, 2021. "Managing performance and winning trust: how World Bank staff shape recipient performance," The Review of International Organizations, Springer, vol. 16(3), pages 625-653, July.
    13. Lee, Chien-Chiang & Lin, Chun-Wei & Zeng, Jhih-Hong, 2016. "Financial liberalization, insurance market, and the likelihood of financial crises," Journal of International Money and Finance, Elsevier, vol. 62(C), pages 25-51.
    14. Chileshe Ng’andu Musaba & Emmanuel C. Musaba & Simon I.R. Hoabeb, 2014. "Employee Perceptions of Service Quality in the Namibian Hotel Industry: A SERVQUAL Approach," International Journal of Asian Social Science, Asian Economic and Social Society, vol. 4(4), pages 533-543, April.
    15. Samuel Egyakwa Ankomah & Adam Fusheini & Christy Ballard & Emmanuel Kumah & Gagan Gurung & Sarah Derrett, 2021. "Patient–public engagement interventions for health system improvement in Sub‐Saharan Africa: A systematic scoping review protocol," International Journal of Health Planning and Management, Wiley Blackwell, vol. 36(2), pages 273-281, March.
    16. Guido de Blasio & Stefania De Mitri & Alessio D'Ignazio & Paolo Finaldi Russo & Lavina Stoppani, 2017. "Public guarantees on loans to SMEs: an RDD evaluation," Temi di discussione (Economic working papers) 1111, Bank of Italy, Economic Research and International Relations Area.
    17. Josef Brechler & Vaclav Hausenblas & Zlatuse Komarkova & Miroslav Plasil, 2014. "Similarity and Clustering of Banks: Application to the Credit Exposures of the Czech Banking Sector," Research and Policy Notes 2014/04, Czech National Bank.
    18. Christopher Kilby, 2012. "Assessing the contribution of donor agencies to aid effectiveness: The impact of World Bank preparation on project outcomes," Villanova School of Business Department of Economics and Statistics Working Paper Series 20, Villanova School of Business Department of Economics and Statistics.
    19. David Bulman & Walter Kolkma & Aart Kraay, 2017. "Good countries or good projects? Comparing macro and micro correlates of World Bank and Asian Development Bank project performance," The Review of International Organizations, Springer, vol. 12(3), pages 335-363, September.
    20. Geli,Patricia & Kraay,Aart C. & Nobakht,Hoveida, 2014. "Predicting World Bank project outcome ratings," Policy Research Working Paper Series 7001, The World Bank.

    More about this item

    Keywords

    Banks&Banking Reform; Housing&Human Habitats; Poverty Monitoring&Analysis; Development Economics&Aid Effectiveness; Rural Portfolio Improvement;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:7157. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.