IDEAS home Printed from https://ideas.repec.org/a/eee/wdevel/v144y2021ics0305750x21001182.html
   My bibliography  Save this article

Caught between winning repeat business and learning: Reactivity to output indicators in international development

Author

Listed:
  • Springer, Emily

Abstract

Recent sociological scholarship posits that performance metrics alter professional and organizational behavior, meaning performance indicators may recreate rather than empirically measure phenomena of interest. This perverse effect of measurement is at odds with the goals of international development monitoring and evaluation (M&E) practices, which promote learning “what works” to hone financial stewardship and route funds toward the most evidence-based, high-impact projects. Focusing on the internal, mandated, and standardized M&E system of a large bilateral agricultural development initiative, this article examines whether perverse reactions occur in this case study and how they impact the process of informal learning “what works” by professionals. Although the M&E system under study is standardized across multiple recipient countries, I utilize the experiences of multiple organizations and projects in a single East African country, and interview 58 development professionals. Using this case study, the article demonstrates that the perverse effects of measurement are initiated by the vertical managerial structure of a single project, forming the status quo of everyday development work. It then shows that the status quo is reinforced by the horizontal comparisons at each tier made possible by standardized M&E systems, including comparisons of performance between implementing organizations or donor field offices. Such comparison quiets professionals and organizations that attempt to introduce more empirical forms of learning “what works.” The article suggests that high stakes measurement practices create M&E systems that, instead of enabling learning about “what works” in projects, produce evidence to garner repeat business, what development professionals colloquially term “rebiz.”

Suggested Citation

  • Springer, Emily, 2021. "Caught between winning repeat business and learning: Reactivity to output indicators in international development," World Development, Elsevier, vol. 144(C).
  • Handle: RePEc:eee:wdevel:v:144:y:2021:i:c:s0305750x21001182
    DOI: 10.1016/j.worlddev.2021.105506
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305750X21001182
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.worlddev.2021.105506?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    2. Fukuda-Parr, Sakiko & Greenstein, Joshua & Stewart, David, 2013. "How Should MDG Success and Failure be Judged: Faster Progress or Achieving the Targets?," World Development, Elsevier, vol. 41(C), pages 19-30.
    3. Schurman, Rachel, 2018. "Micro(soft) managing a ‘green revolution’ for Africa: The new donor culture and international agricultural development," World Development, Elsevier, vol. 112(C), pages 180-192.
    4. Nogueira, Roberto Martinez, 1987. "Life cycle and learning in grassroots development organizations," World Development, Elsevier, vol. 15(1, Supple), pages 169-177.
    5. Peterson, Christina & Skolits, Gary, 2020. "Value for money: A utilization-focused approach to extending the foundation and contribution of economic evaluation," Evaluation and Program Planning, Elsevier, vol. 80(C).
    6. Susan M. Roberts, 2014. "Development Capital: USAID and the Rise of Development Contractors," Annals of the American Association of Geographers, Taylor & Francis Journals, vol. 104(5), pages 1030-1051, September.
    7. Frederik Claeye & Véronique Flambard & W.H. Van Zyl, 2018. "Money, people or mission ? Accountability in local and non-local NGOs," Post-Print hal-01913745, HAL.
    8. Lant Pritchett, 2002. "It pays to be ignorant: A simple political economy of rigorous program evaluation," Journal of Economic Policy Reform, Taylor & Francis Journals, vol. 5(4), pages 251-269.
    9. Høyland, Bjørn & Moene, Karl & Willumsen, Fredrik, 2012. "The tyranny of international index rankings," Journal of Development Economics, Elsevier, vol. 97(1), pages 1-14.
    10. Bali Swain, Ranjula & Ranganathan, Shyam, 2021. "Modeling interlinkages between sustainable development goals using network analysis," World Development, Elsevier, vol. 138(C).
    11. Laura Camfield & Maren Duvendack & Richard Palmer‐Jones, 2014. "Things you Wanted to Know about Bias in Evaluations but Never Dared to Think," IDS Bulletin, Blackwell Publishing, vol. 45(6), pages 49-64, November.
    12. Béné, Christophe & Chowdhury, Fahim S. & Rashid, Mamun & Dhali, Sabbir A. & Jahan, Ferdous, 2017. "Squaring the Circle: Reconciling the Need for Rigor with the Reality on the Ground in Resilience Impact Assessment," World Development, Elsevier, vol. 97(C), pages 212-231.
    13. Sakiko Fukuda-Parr, 2014. "Global Goals as a Policy Tool: Intended and Unintended Consequences," Journal of Human Development and Capabilities, Taylor & Francis Journals, vol. 15(2-3), pages 118-131, July.
    14. Vallejo, Bertha & Wehn, Uta, 2016. "Capacity Development Evaluation: The Challenge of the Results Agenda and Measuring Return on Investment in the Global South," World Development, Elsevier, vol. 79(C), pages 1-13.
    15. Krause, Monika, 2014. "The Good Project," University of Chicago Press Economics Books, University of Chicago Press, number 9780226131221, December.
    16. Vallejo, B. & Wehn, U., 2016. "Capacity development evaluation : The challenge of the results agenda and measuring return on investment in the global south," Other publications TiSEM d22bbdd5-5e29-404a-9ca8-8, Tilburg University, School of Economics and Management.
    17. Brass, Jennifer N., 2012. "Why Do NGOs Go Where They Go? Evidence from Kenya," World Development, Elsevier, vol. 40(2), pages 387-401.
    18. Ebrahim, Alnoor, 2003. "Accountability In Practice: Mechanisms for NGOs," World Development, Elsevier, vol. 31(5), pages 813-829, May.
    19. Easterly, William, 2009. "How the Millennium Development Goals are Unfair to Africa," World Development, Elsevier, vol. 37(1), pages 26-35, January.
    20. Hoey, Lesli, 2015. "“Show me the Numbers”: Examining the Dynamics Between Evaluation and Government Performance in Developing Countries," World Development, Elsevier, vol. 70(C), pages 1-12.
    21. Venugopal, Rajesh, 2018. "Ineptitude, ignorance, or intent: The social construction of failure in development," World Development, Elsevier, vol. 106(C), pages 238-247.
    22. Schot, Johan & Steinmueller, W. Edward, 2018. "Three frames for innovation policy: R&D, systems of innovation and transformative change," Research Policy, Elsevier, vol. 47(9), pages 1554-1567.
    23. David Hulme, 2010. "Lessons from the Making of the MDGs: Human Development Meets Results‐based Management in an Unfair World," IDS Bulletin, Blackwell Publishing, vol. 41(1), pages 15-25, January.
    24. Banks, Nicola & Hulme, David & Edwards, Michael, 2015. "NGOs, States, and Donors Revisited: Still Too Close for Comfort?," World Development, Elsevier, vol. 66(C), pages 707-718.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dang, Hai-Anh H. & Serajuddin, Umar, 2020. "Tracking the sustainable development goals: Emerging measurement challenges and further reflections," World Development, Elsevier, vol. 127(C).
    2. Brendan Whitty & Jessica Sklair & Paul Robert Gilbert & Emma Mawdsley & Jo‐Anna Russon & Olivia Taylor, 2023. "Outsourcing the Business of Development: The Rise of For‐profit Consultancies in the UK Aid Sector," Development and Change, International Institute of Social Studies, vol. 54(4), pages 892-917, July.
    3. William Joe & Udaya Shankar Mishra, 2015. "On Reckoning Level Differentials in the Measurement of Progress: An Illustration in the Context of Deliveries Assisted by Skilled Health Personnel," IEG Working Papers 352, Institute of Economic Growth.
    4. Sampson Addo Yeboah, 2022. "Solving Local Problems or Looking Good: An Ethnography of the Field Practices of Foreign Sponsored NGOs in Rural African Communities," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 34(3), pages 1645-1661, June.
    5. Saroj Kumar & Abhishek Kumar & Rakesh Kumar & William Joe, 2021. "Social Demographics and Health Achievements An Ecological Analysis of Institutional Delivery and Immunization Coverage in India," IEG Working Papers 427, Institute of Economic Growth.
    6. Maria Lo Bue & Stephan Klasen, 2013. "Identifying Synergies and Complementarities Between MDGs: Results from Cluster Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 113(2), pages 647-670, September.
    7. Sakiko Fukuda-Parr, 2013. "Global Development Goal Setting as a Policy Tool for Global Governance: Intended and Unintended Consequences," Working Papers 108, International Policy Centre for Inclusive Growth.
    8. Faraz Usmani & Marc Jeuland & Subhrendu K. Pattanayak, 2018. "NGOs and the effectiveness of interventions," WIDER Working Paper Series wp-2018-59, World Institute for Development Economic Research (UNU-WIDER).
    9. Jacob, Arun, 2017. "Mind the Gap: Analyzing the Impact of Data Gap in Millennium Development Goals’ (MDGs) Indicators on the Progress toward MDGs," World Development, Elsevier, vol. 93(C), pages 260-278.
    10. Aga, Deribe Assefa, 2016. "Factors affecting the success of development projects : A behavioral perspective," Other publications TiSEM 867ae95e-d53d-4a68-ad46-6, Tilburg University, School of Economics and Management.
    11. Banks, Nicola & Hulme, David & Edwards, Michael, 2015. "NGOs, States, and Donors Revisited: Still Too Close for Comfort?," World Development, Elsevier, vol. 66(C), pages 707-718.
    12. Yehyun An & Ralph P. Hall & Taekwan Yoon, 2021. "The Complex Relationship between Capacity and Infrastructure Project Delivery: The Case of the Indian National Urban Renewal Mission," Sustainability, MDPI, vol. 13(16), pages 1-15, August.
    13. Nicola Banks & Tony Brockington, 2019. "Mapping the UK’s development NGOs: income, geography and contributions to international development," Global Development Institute Working Paper Series 352019, GDI, The University of Manchester.
    14. Martinez, Daniel E. & Cooper, David J., 2019. "Assembling performance measurement through engagement," Accounting, Organizations and Society, Elsevier, vol. 78(C).
    15. Gani ALDASHEV & Cecilia NAVARRA, 2018. "Development Ngos: Basic Facts," Annals of Public and Cooperative Economics, Wiley Blackwell, vol. 89(1), pages 125-155, March.
    16. William F. Shughart & Diana W. Thomas & Michael D. Thomas, 2020. "Institutional Change and the Importance of Understanding Shared Mental Models," Kyklos, Wiley Blackwell, vol. 73(3), pages 371-391, August.
    17. Dorine E. Norren, 2020. "The Sustainable Development Goals viewed through Gross National Happiness, Ubuntu, and Buen Vivir," International Environmental Agreements: Politics, Law and Economics, Springer, vol. 20(3), pages 431-458, September.
    18. Stephan Klasen & Simon Lange, 2011. "Getting Progress Right: Measuring Progress Towards the MDGs Against Historical Trends," Courant Research Centre: Poverty, Equity and Growth - Discussion Papers 87, Courant Research Centre PEG, revised 20 Feb 2012.
    19. repec:bla:annpce:v:89:y:2018:i:1:p:125-155 is not listed on IDEAS
    20. William Joe & Suresh Sharma & Jyotsna Sharma & Y Manasa Shanta & B Subha Sri, 2015. "Maternal Mortality in India: A Review of Trends and Patterns," IEG Working Papers 353, Institute of Economic Growth.
    21. Alisa Moldavanova & Tamaki Onishi & Stefan Toepler, 2023. "Civil society and democratization: The role of service‐providing organizations amid closing civic spaces," Public Administration & Development, Blackwell Publishing, vol. 43(1), pages 3-13, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:wdevel:v:144:y:2021:i:c:s0305750x21001182. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/worlddev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.