IDEAS home Printed from https://ideas.repec.org/a/eee/wdevel/v144y2021ics0305750x21001182.html
   My bibliography  Save this article

Caught between winning repeat business and learning: Reactivity to output indicators in international development

Author

Listed:
  • Springer, Emily

Abstract

Recent sociological scholarship posits that performance metrics alter professional and organizational behavior, meaning performance indicators may recreate rather than empirically measure phenomena of interest. This perverse effect of measurement is at odds with the goals of international development monitoring and evaluation (M&E) practices, which promote learning “what works” to hone financial stewardship and route funds toward the most evidence-based, high-impact projects. Focusing on the internal, mandated, and standardized M&E system of a large bilateral agricultural development initiative, this article examines whether perverse reactions occur in this case study and how they impact the process of informal learning “what works” by professionals. Although the M&E system under study is standardized across multiple recipient countries, I utilize the experiences of multiple organizations and projects in a single East African country, and interview 58 development professionals. Using this case study, the article demonstrates that the perverse effects of measurement are initiated by the vertical managerial structure of a single project, forming the status quo of everyday development work. It then shows that the status quo is reinforced by the horizontal comparisons at each tier made possible by standardized M&E systems, including comparisons of performance between implementing organizations or donor field offices. Such comparison quiets professionals and organizations that attempt to introduce more empirical forms of learning “what works.” The article suggests that high stakes measurement practices create M&E systems that, instead of enabling learning about “what works” in projects, produce evidence to garner repeat business, what development professionals colloquially term “rebiz.”

Suggested Citation

  • Springer, Emily, 2021. "Caught between winning repeat business and learning: Reactivity to output indicators in international development," World Development, Elsevier, vol. 144(C).
  • Handle: RePEc:eee:wdevel:v:144:y:2021:i:c:s0305750x21001182
    DOI: 10.1016/j.worlddev.2021.105506
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305750X21001182
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.worlddev.2021.105506?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Schurman, Rachel, 2018. "Micro(soft) managing a ‘green revolution’ for Africa: The new donor culture and international agricultural development," World Development, Elsevier, vol. 112(C), pages 180-192.
    2. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    3. Nogueira, Roberto Martinez, 1987. "Life cycle and learning in grassroots development organizations," World Development, Elsevier, vol. 15(1, Supple), pages 169-177.
    4. Vallejo, Bertha & Wehn, Uta, 2016. "Capacity Development Evaluation: The Challenge of the Results Agenda and Measuring Return on Investment in the Global South," World Development, Elsevier, vol. 79(C), pages 1-13.
    5. Peterson, Christina & Skolits, Gary, 2020. "Value for money: A utilization-focused approach to extending the foundation and contribution of economic evaluation," Evaluation and Program Planning, Elsevier, vol. 80(C).
    6. Fukuda-Parr, Sakiko & Greenstein, Joshua & Stewart, David, 2013. "How Should MDG Success and Failure be Judged: Faster Progress or Achieving the Targets?," World Development, Elsevier, vol. 41(C), pages 19-30.
    7. Krause, Monika, 2014. "The Good Project," University of Chicago Press Economics Books, University of Chicago Press, number 9780226131221, October.
    8. Susan M. Roberts, 2014. "Development Capital: USAID and the Rise of Development Contractors," Annals of the American Association of Geographers, Taylor & Francis Journals, vol. 104(5), pages 1030-1051, September.
    9. Vallejo, B. & Wehn, U., 2016. "Capacity development evaluation : The challenge of the results agenda and measuring return on investment in the global south," Other publications TiSEM d22bbdd5-5e29-404a-9ca8-8, Tilburg University, School of Economics and Management.
    10. Venugopal, Rajesh, 2018. "Ineptitude, ignorance, or intent: The social construction of failure in development," World Development, Elsevier, vol. 106(C), pages 238-247.
    11. Brass, Jennifer N., 2012. "Why Do NGOs Go Where They Go? Evidence from Kenya," World Development, Elsevier, vol. 40(2), pages 387-401.
    12. Schot, Johan & Steinmueller, W. Edward, 2018. "Three frames for innovation policy: R&D, systems of innovation and transformative change," Research Policy, Elsevier, vol. 47(9), pages 1554-1567.
    13. Ebrahim, Alnoor, 2003. "Accountability In Practice: Mechanisms for NGOs," World Development, Elsevier, vol. 31(5), pages 813-829, May.
    14. Sakiko Fukuda-Parr, 2014. "Global Goals as a Policy Tool: Intended and Unintended Consequences," Journal of Human Development and Capabilities, Taylor & Francis Journals, vol. 15(2-3), pages 118-131, July.
    15. Easterly, William, 2009. "How the Millennium Development Goals are Unfair to Africa," World Development, Elsevier, vol. 37(1), pages 26-35, January.
    16. David Hulme, 2010. "Lessons from the Making of the MDGs: Human Development Meets Results‐based Management in an Unfair World," IDS Bulletin, Blackwell Publishing, vol. 41(1), pages 15-25, January.
    17. Frederik Claeye & Véronique Flambard & W.H. Van Zyl, 2018. "Money, people or mission ? Accountability in local and non-local NGOs," Post-Print hal-01913745, HAL.
    18. Lant Pritchett, 2002. "It pays to be ignorant: A simple political economy of rigorous program evaluation," Journal of Economic Policy Reform, Taylor & Francis Journals, vol. 5(4), pages 251-269.
    19. Banks, Nicola & Hulme, David & Edwards, Michael, 2015. "NGOs, States, and Donors Revisited: Still Too Close for Comfort?," World Development, Elsevier, vol. 66(C), pages 707-718.
    20. Hoey, Lesli, 2015. "“Show me the Numbers”: Examining the Dynamics Between Evaluation and Government Performance in Developing Countries," World Development, Elsevier, vol. 70(C), pages 1-12.
    21. Høyland, Bjørn & Moene, Karl & Willumsen, Fredrik, 2012. "The tyranny of international index rankings," Journal of Development Economics, Elsevier, vol. 97(1), pages 1-14.
    22. Bali Swain, Ranjula & Ranganathan, Shyam, 2021. "Modeling interlinkages between sustainable development goals using network analysis," World Development, Elsevier, vol. 138(C).
    23. Laura Camfield & Maren Duvendack & Richard Palmer‐Jones, 2014. "Things you Wanted to Know about Bias in Evaluations but Never Dared to Think," IDS Bulletin, Blackwell Publishing, vol. 45(6), pages 49-64, November.
    24. Béné, Christophe & Chowdhury, Fahim S. & Rashid, Mamun & Dhali, Sabbir A. & Jahan, Ferdous, 2017. "Squaring the Circle: Reconciling the Need for Rigor with the Reality on the Ground in Resilience Impact Assessment," World Development, Elsevier, vol. 97(C), pages 212-231.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ronelle Burger & Canh Thien Dang & Trudy Owens, 2017. "Better performing NGOs do report more accurately: Evidence from investigating Ugandan NGO financial accounts," Discussion Papers 2017-10, University of Nottingham, CREDIT.
    2. Boomsma, Roel & O'Dwyer, Brendan, 2019. "Constituting the governable NGO: The correlation between conduct and counter-conduct in the evolution of funder-NGO accountability relations," Accounting, Organizations and Society, Elsevier, vol. 72(C), pages 1-20.
    3. Dang, Hai-Anh H. & Serajuddin, Umar, 2020. "Tracking the sustainable development goals: Emerging measurement challenges and further reflections," World Development, Elsevier, vol. 127(C).
    4. Fukuda-Parr, Sakiko & Greenstein, Joshua & Stewart, David, 2013. "How Should MDG Success and Failure be Judged: Faster Progress or Achieving the Targets?," World Development, Elsevier, vol. 41(C), pages 19-30.
    5. Brendan Whitty & Jessica Sklair & Paul Robert Gilbert & Emma Mawdsley & Jo‐Anna Russon & Olivia Taylor, 2023. "Outsourcing the Business of Development: The Rise of For‐profit Consultancies in the UK Aid Sector," Development and Change, International Institute of Social Studies, vol. 54(4), pages 892-917, July.
    6. Cristina Corduneanu-Huci & Michael T. Dorsch & Paul Maarek, 2017. "Learning to constrain: Political competition and randomized controlled trials in development," THEMA Working Papers 2017-24, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
    7. William Joe & Udaya Shankar Mishra, 2015. "On Reckoning Level Differentials in the Measurement of Progress: An Illustration in the Context of Deliveries Assisted by Skilled Health Personnel," IEG Working Papers 352, Institute of Economic Growth.
    8. Sampson Addo Yeboah, 2022. "Solving Local Problems or Looking Good: An Ethnography of the Field Practices of Foreign Sponsored NGOs in Rural African Communities," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 34(3), pages 1645-1661, June.
    9. Nichols, Carly, 2020. "Nutrition sensitive agriculture: An equity-based analysis from India," World Development, Elsevier, vol. 133(C).
    10. Saroj Kumar & Abhishek Kumar & Rakesh Kumar & William Joe, 2021. "Social Demographics and Health Achievements An Ecological Analysis of Institutional Delivery and Immunization Coverage in India," IEG Working Papers 427, Institute of Economic Growth.
    11. Maria Lo Bue & Stephan Klasen, 2013. "Identifying Synergies and Complementarities Between MDGs: Results from Cluster Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 113(2), pages 647-670, September.
    12. Sakiko Fukuda-Parr, 2013. "Global Development Goal Setting as a Policy Tool for Global Governance: Intended and Unintended Consequences," Working Papers 108, International Policy Centre for Inclusive Growth.
    13. Dewi, Miranti Kartika & Manochin, Melina & Belal, Ataur, 2021. "Towards a conceptual framework of beneficiary accountability by NGOs: An Indonesian case study," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 80(C).
    14. Faraz Usmani & Marc Jeuland & Subhrendu K. Pattanayak, 2018. "NGOs and the effectiveness of interventions," WIDER Working Paper Series wp-2018-59, World Institute for Development Economic Research (UNU-WIDER).
    15. Jacob, Arun, 2017. "Mind the Gap: Analyzing the Impact of Data Gap in Millennium Development Goals’ (MDGs) Indicators on the Progress toward MDGs," World Development, Elsevier, vol. 93(C), pages 260-278.
    16. Alkire, Sabina & Nogales, Ricardo & Quinn, Natalie Naïri & Suppa, Nicolai, 2023. "On track or not? Projecting the global Multidimensional Poverty Index," Journal of Development Economics, Elsevier, vol. 165(C).
    17. Willem Elbers & Lau Schulpen & Emma Frobisher, 2022. "Stuck in a “Catch-22”: Why Donors Fail to Include Grassroots Perspectives on CSO Legitimacy," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 34(2), pages 921-939, April.
    18. Eger, Claudia & Miller, Graham & Scarles, Caroline, 2018. "Gender and capacity building: A multi-layered study of empowerment," World Development, Elsevier, vol. 106(C), pages 207-219.
    19. Aga, Deribe Assefa, 2016. "Factors affecting the success of development projects : A behavioral perspective," Other publications TiSEM 867ae95e-d53d-4a68-ad46-6, Tilburg University, School of Economics and Management.
    20. Dorine E. Norren, 0. "The Sustainable Development Goals viewed through Gross National Happiness, Ubuntu, and Buen Vivir," International Environmental Agreements: Politics, Law and Economics, Springer, vol. 0, pages 1-28.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:wdevel:v:144:y:2021:i:c:s0305750x21001182. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/worlddev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.