IDEAS home Printed from https://ideas.repec.org/a/eee/wdevel/v127y2020ics0305750x19304711.html
   My bibliography  Save this article

Randomized controlled trials of multi-sectoral programs: Lessons from development research

Author

Listed:
  • Quisumbing, Agnes R.
  • Ahmed, Akhter
  • Gilligan, Daniel O.
  • Hoddinott, John
  • Kumar, Neha
  • Leroy, Jef L.
  • Menon, Purnima
  • Olney, Deanna K.
  • Roy, Shalini
  • Ruel, Marie

Abstract

Development is a multi-faceted process; achieving development goals thus requires a multi-sectoral approach. For over two decades, our research group of economists and nutritionists has designed and implemented randomized trials to assess the effectiveness of multisectoral programs in improving nutrition, food security, and other measures of well-being, largely at the request of developing country governments, development partners, and non-governmental organizations. Our approach addresses three perceived pitfalls of RCTs: the “black box” nature of RCTs, limited external validity, and challenges in translation of results to impacts at scale. We address these concerns by identifying and assessing programmatic pathways to impact with quantitative and qualitative methods; studying similar programs implemented by different organizations across various settings; and working closely with implementing partners in the design, research, and dissemination processes to inform adaptation and scale-up of programs and policies.

Suggested Citation

  • Quisumbing, Agnes R. & Ahmed, Akhter & Gilligan, Daniel O. & Hoddinott, John & Kumar, Neha & Leroy, Jef L. & Menon, Purnima & Olney, Deanna K. & Roy, Shalini & Ruel, Marie, 2020. "Randomized controlled trials of multi-sectoral programs: Lessons from development research," World Development, Elsevier, vol. 127(C).
  • Handle: RePEc:eee:wdevel:v:127:y:2020:i:c:s0305750x19304711
    DOI: 10.1016/j.worlddev.2019.104822
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305750X19304711
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.worlddev.2019.104822?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hidrobo, Melissa & Hoddinott, John & Peterman, Amber & Margolies, Amy & Moreira, Vanessa, 2014. "Cash, food, or vouchers? Evidence from a randomized experiment in northern Ecuador," Journal of Development Economics, Elsevier, vol. 107(C), pages 144-156.
    2. John Hoddinott & Susanna Sandström & Joanna Upton, 2018. "The Impact of Cash and Food Transfers: Evidence from a Randomized Intervention in Niger," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(4), pages 1032-1049.
    3. Alan de Brauw & Patrick Eozenou & Daniel O Gilligan & Christine Hotz & Neha Kumar & J V Meenakshi, 2018. "Biofortification, Crop Adoption and Health Information: Impact Pathways in Mozambique and Uganda," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(3), pages 906-930.
    4. Ana Maria Buller & Amber Peterman & Meghna Ranganathan & Alexandra Bleile & Melissa Hidrobo & Lori Heise, 2018. "A Mixed-Method Review of Cash Transfers and Intimate Partner Violence in Low- and Middle-Income Countries," The World Bank Research Observer, World Bank, vol. 33(2), pages 218-258.
    5. Skoufias, Emmanuel, 2005. "PROGRESA and its impacts on the welfare of rural households in Mexico:," Research reports 139, International Food Policy Research Institute (IFPRI).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. James R. Stevenson & Karen Macours & Douglas Gollin, 2023. "The Rigor Revolution: New Standards of Evidence for Impact Assessment of International Agricultural Research," Annual Review of Resource Economics, Annual Reviews, vol. 15(1), pages 495-515, October.
    2. Arne Henningsen & Guy Low & David Wuepper & Tobias Dalhaus & Hugo Storm & Dagim Belay & Stefan Hirsch, 2024. "Estimating Causal Effects with Observational Data: Guidelines for Agricultural and Applied Economists," IFRO Working Paper 2024/03, University of Copenhagen, Department of Food and Resource Economics.
    3. Koppenberg, Maximilian & Mishra, Ashok K. & Hirsch, Stefan, 2023. "Food aid and violent conflict: A review and Empiricist’s companion," Food Policy, Elsevier, vol. 121(C).
    4. Roelen, Keetie & Saha, Amrita, 2021. "Pathways to stronger futures? The role of social protection in reducing psychological risk factors for child development in Haiti," World Development, Elsevier, vol. 142(C).
    5. Raghunathan, Kalyani & Kumar, Neha & Gupta, Shivani & Chauhan, Tarana & Kathuria, Ashi Kohli & Menon, Purnima, 2023. "Learning together: Experimental evidence on the impact of group-based nutrition interventions in rural Bihar," World Development, Elsevier, vol. 168(C).
    6. Koppenberg, Maximilian & Mishra, Ashok K. & Hirsch, Stefan, 2023. "Food Aid and Violent Conflict: A Review of Literature," IZA Discussion Papers 16574, Institute of Labor Economics (IZA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nelson, Suzanne & Frakenberger, Tim & Brown, Vicky & Presnall, Carrie & Downen, Jeanne, 2015. "Ex-Post impact assessment review of IFPRI’s research program on social protection, 2000–2012," Impact assessments 40, International Food Policy Research Institute (IFPRI).
    2. Lara Cockx & Nathalie Francken, 2016. "Evolution and impact of EU aid for food and nutrition security: a review," Working Papers of LICOS - Centre for Institutions and Economic Performance 572519, KU Leuven, Faculty of Economics and Business (FEB), LICOS - Centre for Institutions and Economic Performance.
    3. Стукач Виктор Федорович, 2011. "Инфраструктура Производственных Услуг: Новые Тенденции," Экономика региона, CyberLeninka;Федеральное государственное бюджетное учреждение науки «Институт экономики Уральского отделения Российской академии наук», issue 4, pages 133-142.
    4. Claire MacPherson & Olivier Sterck, 2019. "Humanitarian vs. Development Aid for Refugees: Evidence from a Regression Discontinuity Design," CSAE Working Paper Series 2019-15, Centre for the Study of African Economies, University of Oxford.
    5. World Bank Group, 2016. "Cash Transfers in Humanitarian Contexts," World Bank Publications - Reports 24699, The World Bank Group.
    6. Upton, Joanna B., 2014. "Resolving the Puzzle of the Conditional Superiority of In-kind versus Cash Food Assistance: Evidence from Niger," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 172942, Agricultural and Applied Economics Association.
    7. Samuel Berlinski & Norbert Schady, 2015. "Daycare Services: It’s All about Quality," Palgrave Macmillan Books, in: Samuel Berlinski & Norbert Schady (ed.), The Early Years, chapter 4, pages 91-119, Palgrave Macmillan.
    8. Gentilini,Ugo, 2016. "The revival of the"cash versus food"debate : new evidence for an old quandary ?," Policy Research Working Paper Series 7584, The World Bank.
    9. Bhanot, Syon P. & Han, Jiyoung & Jang, Chaning, 2018. "Workfare, wellbeing and consumption: Evidence from a field experiment with Kenya’s urban poor," Journal of Economic Behavior & Organization, Elsevier, vol. 149(C), pages 372-388.
    10. Verónica Amarante & Martín Lavalleja & Luana Méndez, 2023. "Tarjeta Uruguay Social: diseño, implementación y posibles efectos," Documentos de Trabajo (working papers) 23-11, Instituto de Economía - IECON.
    11. Siu, Jade & Sterck, Olivier & Rodgers, Cory, 2023. "The freedom to choose: Theory and quasi-experimental evidence on cash transfer restrictions," Journal of Development Economics, Elsevier, vol. 161(C).
    12. McIntosh, Craig & Zeitlin, Andrew, 2022. "Using household grants to benchmark the cost effectiveness of a USAID workforce readiness program," Journal of Development Economics, Elsevier, vol. 157(C).
    13. Hirvonen, Kalle & Hoddinott, John F., 2018. "Payment modality preferences: Evidence from Ethiopia’s Productive Safety Net Programme," ESSP working papers 125, International Food Policy Research Institute (IFPRI).
    14. Omotilewa, Oluwatoba J. & Ricker-Gilbert, Jacob & Ainembabazi, John Herbert & Shively, Gerald E., 2018. "Does improved storage technology promote modern input use and food security? Evidence from a randomized trial in Uganda," Journal of Development Economics, Elsevier, vol. 135(C), pages 176-198.
    15. Michael Callen & Miguel Fajardo-Steinhauser & Michael G. Findley & Tarek Ghani, 2023. "Can Digital Aid Deliver During Humanitarian Crises?," Papers 2312.13432, arXiv.org, revised Oct 2024.
    16. Sarthak Agarwal & Neeraj Katewa, 2024. "Improving Women’s Position in the Household: Evidence from a Maternity Cash Transfer Programme in India," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 36(6), pages 1471-1518, December.
    17. Higgins, Sean & Lustig, Nora, 2016. "Can a poverty-reducing and progressive tax and transfer system hurt the poor?," Journal of Development Economics, Elsevier, vol. 122(C), pages 63-75.
    18. Wei Fu & Chen Huang & Feng Liu, 2023. "Unemployment benefits, food insecurity, and supplemental nutrition assistance program spending," American Journal of Agricultural Economics, John Wiley & Sons, vol. 105(2), pages 479-502, March.
    19. MacPherson, Claire & Sterck, Olivier, 2021. "Empowering refugees through cash and agriculture: A regression discontinuity design," Journal of Development Economics, Elsevier, vol. 149(C).
    20. Lehmann, M. Christian & Matarazzo, Hellen, 2019. "Voters’ response to in-kind transfers: Quasi-experimental evidence from prescription drug cost-sharing in Brazil," Economics Letters, Elsevier, vol. 184(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:wdevel:v:127:y:2020:i:c:s0305750x19304711. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/worlddev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.