IDEAS home Printed from https://ideas.repec.org/a/eee/wdevel/v127y2020ics0305750x19304711.html
   My bibliography  Save this article

Randomized controlled trials of multi-sectoral programs: Lessons from development research

Author

Listed:
  • Quisumbing, Agnes R.
  • Ahmed, Akhter
  • Gilligan, Daniel O.
  • Hoddinott, John
  • Kumar, Neha
  • Leroy, Jef L.
  • Menon, Purnima
  • Olney, Deanna K.
  • Roy, Shalini
  • Ruel, Marie

Abstract

Development is a multi-faceted process; achieving development goals thus requires a multi-sectoral approach. For over two decades, our research group of economists and nutritionists has designed and implemented randomized trials to assess the effectiveness of multisectoral programs in improving nutrition, food security, and other measures of well-being, largely at the request of developing country governments, development partners, and non-governmental organizations. Our approach addresses three perceived pitfalls of RCTs: the “black box” nature of RCTs, limited external validity, and challenges in translation of results to impacts at scale. We address these concerns by identifying and assessing programmatic pathways to impact with quantitative and qualitative methods; studying similar programs implemented by different organizations across various settings; and working closely with implementing partners in the design, research, and dissemination processes to inform adaptation and scale-up of programs and policies.

Suggested Citation

  • Quisumbing, Agnes R. & Ahmed, Akhter & Gilligan, Daniel O. & Hoddinott, John & Kumar, Neha & Leroy, Jef L. & Menon, Purnima & Olney, Deanna K. & Roy, Shalini & Ruel, Marie, 2020. "Randomized controlled trials of multi-sectoral programs: Lessons from development research," World Development, Elsevier, vol. 127(C).
    • Handle: RePEc:eee:wdevel:v:127:y:2020:i:c:s0305750x19304711
    DOI: 10.1016/j.worlddev.2019.104822
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305750X19304711
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.worlddev.2019.104822?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hidrobo, Melissa & Hoddinott, John & Peterman, Amber & Margolies, Amy & Moreira, Vanessa, 2014. "Cash, food, or vouchers? Evidence from a randomized experiment in northern Ecuador," Journal of Development Economics, Elsevier, vol. 107(C), pages 144-156.
    2. John Hoddinott & Susanna Sandström & Joanna Upton, 2018. "The Impact of Cash and Food Transfers: Evidence from a Randomized Intervention in Niger," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(4), pages 1032-1049.
    3. Alan de Brauw & Patrick Eozenou & Daniel O Gilligan & Christine Hotz & Neha Kumar & J V Meenakshi, 2018. "Biofortification, Crop Adoption and Health Information: Impact Pathways in Mozambique and Uganda," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(3), pages 906-930.
    4. Ana Maria Buller & Amber Peterman & Meghna Ranganathan & Alexandra Bleile & Melissa Hidrobo & Lori Heise, 2018. "A Mixed-Method Review of Cash Transfers and Intimate Partner Violence in Low- and Middle-Income Countries," The World Bank Research Observer, World Bank, vol. 33(2), pages 218-258.
    5. Skoufias, Emmanuel, 2005. "PROGRESA and its impacts on the welfare of rural households in Mexico:," Research reports 139, International Food Policy Research Institute (IFPRI).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. James R. Stevenson & Karen Macours & Douglas Gollin, 2023. "The Rigor Revolution: New Standards of Evidence for Impact Assessment of International Agricultural Research," Annual Review of Resource Economics, Annual Reviews, vol. 15(1), pages 495-515, October.
    2. Arne Henningsen & Guy Low & David Wuepper & Tobias Dalhaus & Hugo Storm & Dagim Belay & Stefan Hirsch, 2024. "Estimating Causal Effects with Observational Data: Guidelines for Agricultural and Applied Economists," IFRO Working Paper 2024/03, University of Copenhagen, Department of Food and Resource Economics.
    3. Koppenberg, Maximilian & Mishra, Ashok K. & Hirsch, Stefan, 2023. "Food aid and violent conflict: A review and Empiricist’s companion," Food Policy, Elsevier, vol. 121(C).
    4. Roelen, Keetie & Saha, Amrita, 2021. "Pathways to stronger futures? The role of social protection in reducing psychological risk factors for child development in Haiti," World Development, Elsevier, vol. 142(C).
    5. Raghunathan, Kalyani & Kumar, Neha & Gupta, Shivani & Chauhan, Tarana & Kathuria, Ashi Kohli & Menon, Purnima, 2023. "Learning together: Experimental evidence on the impact of group-based nutrition interventions in rural Bihar," World Development, Elsevier, vol. 168(C).
    6. Koppenberg, Maximilian & Mishra, Ashok K. & Hirsch, Stefan, 2023. "Food Aid and Violent Conflict: A Review of Literature," IZA Discussion Papers 16574, Institute of Labor Economics (IZA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nelson, Suzanne & Brown, Vicky & Presnall, Carrie & Downen, Jeanne & Frankenberger, Timothy R., 2015. "Ex-Post impact assessment review of IFPRI’s research program on social protection, 2000–2012," Impact assessments 40, International Food Policy Research Institute (IFPRI).
    2. Lehmann, M. Christian & Matarazzo, Hellen, 2019. "Voters’ response to in-kind transfers: Quasi-experimental evidence from prescription drug cost-sharing in Brazil," Economics Letters, Elsevier, vol. 184(C).
    3. Lara Cockx & Nathalie Francken, 2016. "Evolution and impact of EU aid for food and nutrition security: a review," Working Papers of LICOS - Centre for Institutions and Economic Performance 572519, KU Leuven, Faculty of Economics and Business (FEB), LICOS - Centre for Institutions and Economic Performance.
    4. Higgins, Sean & Lustig, Nora, 2016. "Can a poverty-reducing and progressive tax and transfer system hurt the poor?," Journal of Development Economics, Elsevier, vol. 122(C), pages 63-75.
    5. Sudhanshu Handa & Silvio Daidone & Amber Peterman & Benjamin Davis & Audrey Pereira & Tia Palermo & Jennifer Yablonski, 2018. "Myth-Busting? Confronting Six Common Perceptions about Unconditional Cash Transfers as a Poverty Reduction Strategy in Africa," The World Bank Research Observer, World Bank, vol. 33(2), pages 259-298.
    6. Стукач Виктор Федорович, 2011. "Инфраструктура Производственных Услуг: Новые Тенденции," Экономика региона, CyberLeninka;Федеральное государственное бюджетное учреждение науки «Институт экономики Уральского отделения Российской академии наук», issue 4, pages 133-142.
    7. Claire MacPherson & Olivier Sterck, 2019. "Humanitarian vs. Development Aid for Refugees: Evidence from a Regression Discontinuity Design," CSAE Working Paper Series 2019-15, Centre for the Study of African Economies, University of Oxford.
    8. Аникина, Надежда & Стукач, Виктор, 2012. "Неформальные Институты Трансакционного Сектора Региона: Агроэкономический Аспект [Informal institutions transaction sector of the region: the agro-economic aspect]," MPRA Paper 74171, University Library of Munich, Germany, revised Feb 2016.
    9. World Bank Group, 2016. "Cash Transfers in Humanitarian Contexts," World Bank Publications - Reports 24699, The World Bank Group.
    10. McIntosh, Craig & Zeitlin, Andrew, 2022. "Using household grants to benchmark the cost effectiveness of a USAID workforce readiness program," Journal of Development Economics, Elsevier, vol. 157(C).
    11. Ghulam Mustafa & Nasir Iqbal & Faiz Ur Rehman, 2022. "Evaluating the Short Run and Long Run Impacts of Unconditional Cash Transfers on Food-Seeking Behaviour: New Insights from BISP, Pakistan (Article)," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 61(1), pages 85-102.
    12. Michael Callen & Miguel Fajardo-Steinhäuser & Michael G. Findley & Tarek Ghani & Michael J. Callen, 2025. "Can Digital Aid Deliver During Humanitarian Crises?," CESifo Working Paper Series 11670, CESifo.
    13. Quattrochi, John & Aker, Jenny C. & van der Windt, Peter & Voors, Maarten, 2020. "Contributions of experimental approaches to development and poverty alleviation: Field experiments and humanitarian assistance," World Development, Elsevier, vol. 127(C).
    14. Upton, Joanna B., 2014. "Resolving the Puzzle of the Conditional Superiority of In-kind versus Cash Food Assistance: Evidence from Niger," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 172942, Agricultural and Applied Economics Association.
    15. Hailemariam Teklewold & Tagel Gebrehiwot & Mintewab Bezabih, 2022. "Social protection and vulnerability to nutrition security: empirical evidence from Ethiopia," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 14(5), pages 1191-1205, October.
    16. Samuel Berlinski & Norbert Schady, 2015. "Daycare Services: It’s All about Quality," Palgrave Macmillan Books, in: Samuel Berlinski & Norbert Schady (ed.), The Early Years, chapter 4, pages 91-119, Palgrave Macmillan.
    17. Benjamin Schwab, 2020. "In the Form of Bread? A Randomized Comparison of Cash and Food Transfers in Yemen," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(1), pages 91-113, January.
    18. Harris-Fry, Helen & Saville, Naomi M. & Paudel, Puskar & Manandhar, Dharma S. & Cortina-Borja, Mario & Skordis, Jolene, 2022. "Relative power: Explaining the effects of food and cash transfers on allocative behaviour in rural Nepalese households," Journal of Development Economics, Elsevier, vol. 154(C).
    19. Gentilini,Ugo, 2016. "The revival of the"cash versus food"debate : new evidence for an old quandary ?," Policy Research Working Paper Series 7584, The World Bank.
    20. Bhanot, Syon P. & Han, Jiyoung & Jang, Chaning, 2018. "Workfare, wellbeing and consumption: Evidence from a field experiment with Kenya’s urban poor," Journal of Economic Behavior & Organization, Elsevier, vol. 149(C), pages 372-388.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:wdevel:v:127:y:2020:i:c:s0305750x19304711. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/worlddev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.