IDEAS home Printed from https://ideas.repec.org/a/eee/wdevel/v127y2020ics0305750x1930436x.html
   My bibliography  Save this article

Randomized control trial as social observatory: A case study

Author

Listed:
  • Baird, Sarah
  • Hamory Hicks, Joan
  • Ozier, Owen

Abstract

Critics of randomized control trials (RCTs) in development economics argue that this methodology lends itself to ‘smaller’ questions with limited relevance to policy or economics. Using the seminal work of Miguel and Kremer (2004) on a school-based deworming intervention in Kenya as a case study, we argue that RCTs can spearhead policy change, serve as a laboratory to test economic theories and develop cutting-edge empirical methods, or do both. This does not happen in a vacuum, but through thoughtful design embedded in a broader research and policy agenda. Here, we describe a family of studies built on Miguel and Kremer (2004), shedding light on factors that supported the generation of evidence and insights far beyond the near-term RCT result. As in any piece of social sciences research, this descriptive evidence may not be externally valid in all settings. We nevertheless hope the lessons it offers will inspire others to examine these possibilities in their own research.

Suggested Citation

  • Baird, Sarah & Hamory Hicks, Joan & Ozier, Owen, 2020. "Randomized control trial as social observatory: A case study," World Development, Elsevier, vol. 127(C).
    • Handle: RePEc:eee:wdevel:v:127:y:2020:i:c:s0305750x1930436x
    DOI: 10.1016/j.worlddev.2019.104787
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305750X1930436X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.worlddev.2019.104787?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Michael Kremer & Edward Miguel, 2007. "The Illusion of Sustainability," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1007-1065.
    2. Amrita Ahuja & Sarah Baird & Joan Hamory Hicks & Michael Kremer & Edward Miguel & Shawn Powers, 2015. "When Should Governments Subsidize Health? The Case of Mass Deworming," The World Bank Economic Review, World Bank, vol. 29(suppl_1), pages 9-24.
    3. Pamela Jakiela & Owen Ozier, 2019. "The Impact of Violence on Individual Risk Preferences: Evidence from a Natural Experiment," The Review of Economics and Statistics, MIT Press, vol. 101(3), pages 547-559, July.
    4. Ozier,Owen, 2019. "Replication Redux : The Reproducibility Crisis and the Case of Deworming," Policy Research Working Paper Series 8835, The World Bank.
    5. Sarah Baird & Joan Hamory Hicks & Michael Kremer & Edward Miguel, 2016. "Worms at Work: Long-run Impacts of a Child Health Investment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1637-1680.
    6. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    7. Owen Ozier, 2018. "The Impact of Secondary Schooling in Kenya: A Regression Discontinuity Analysis," Journal of Human Resources, University of Wisconsin Press, vol. 53(1), pages 157-188.
    8. Christopher B. Barrett & Michael R. Carter, 2010. "The Power and Pitfalls of Experiments in Development Economics: Some Non-random Reflections," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 32(4), pages 515-548.
    9. Knudsen, Eric I. & Heckman, James J. & Cameron, Judy L. & Shonkoff, Jack P., 2006. "Economic, Neurobiological and Behavioral Perspectives on Building America's Future Workforce," IZA Discussion Papers 2190, Institute of Labor Economics (IZA).
    10. Eric Knudsen & James J. Heckman & Judy Cameron & Jack P. Shonkoff, 2006. "Economic, Neurobiological and Behavioral Perspectives on Building America’s Future Workforce," World Economics, World Economics, 1 Ivory Square, Plantation Wharf, London, United Kingdom, SW11 3UE, vol. 7(3), pages 17-41, July.
    11. Sarah Baird & J. Aislinn Bohren & Craig McIntosh & Berk Özler, 2018. "Optimal Design of Experiments in the Presence of Interference," The Review of Economics and Statistics, MIT Press, vol. 100(5), pages 844-860, December.
    12. Owen Ozier, 2018. "Exploiting Externalities to Estimate the Long-Term Effects of Early Childhood Deworming," American Economic Journal: Applied Economics, American Economic Association, vol. 10(3), pages 235-262, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. De La O, Ana L. & González, Lucas I. & Weitz-Shapiro, Rebecca, 2023. "Voluntary audits: Experimental evidence on a new approach to monitoring front-line bureaucrats," World Development, Elsevier, vol. 162(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hoffmann, Bridget, 2018. "Do non-monetary prices target the poor? Evidence from a field experiment in India," Journal of Development Economics, Elsevier, vol. 133(C), pages 15-32.
    2. Joan Hamory Hicks & Michael Kremer & Edward Miguel, 2015. "The Case for Mass Treatment of Intestinal Helminths in Endemic Areas," PLOS Neglected Tropical Diseases, Public Library of Science, vol. 9(10), pages 1-5, October.
    3. Meredith, Jennifer & Robinson, Jonathan & Walker, Sarah & Wydick, Bruce, 2013. "Keeping the doctor away: Experimental evidence on investment in preventative health products," Journal of Development Economics, Elsevier, vol. 105(C), pages 196-210.
    4. Sarah Baird & Joan Hamory Hicks & Michael Kremer & Edward Miguel, 2016. "Worms at Work: Long-run Impacts of a Child Health Investment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1637-1680.
    5. Anett John & Kate Orkin, 2022. "Can Simple Psychological Interventions Increase Preventive Health Investment?," Journal of the European Economic Association, European Economic Association, vol. 20(3), pages 1001-1047.
    6. Cameron, Lisa & Chase, Claire & Haque, Sabrina & Joseph, George & Pinto, Rebekah & Wang, Qiao, 2021. "Childhood stunting and cognitive effects of water and sanitation in Indonesia," Economics & Human Biology, Elsevier, vol. 40(C).
    7. Jan-Walter De Neve & Rija L Andriantavison & Kevin Croke & Johannes Krisam & Voahirana H Rajoela & Rary A Rakotoarivony & Valérie Rambeloson & Linda Schultz & Jumana Qamruddin & Stéphane Verguet, 2018. "Health, financial, and education gains of investing in preventive chemotherapy for schistosomiasis, soil-transmitted helminthiases, and lymphatic filariasis in Madagascar: A modeling study," PLOS Neglected Tropical Diseases, Public Library of Science, vol. 12(12), pages 1-17, December.
    8. Madeline Duhon & Lia Fernald & Joan Hamory & Edward Miguel & Eric Ochieng & Michael W. Walker, 2024. "Intergenerational Human Capital Impacts and Complementarities in Kenya," NBER Working Papers 32617, National Bureau of Economic Research, Inc.
    9. Owen Ozier, 2021. "Replication Redux: The Reproducibility Crisis and the Case of Deworming [Economics of Mass Deworming Programs]," The World Bank Research Observer, World Bank, vol. 36(1), pages 101-130.
    10. Baldwin, Kate & Bhavnani, Rikhil R., 2013. "Ancillary Experiments: Opportunities and Challenges," WIDER Working Paper Series 024, World Institute for Development Economic Research (UNU-WIDER).
    11. Pascaline Dupas & Edward Miguel, 2016. "Impacts and Determinants of Health Levels in Low-Income Countries," NBER Working Papers 22235, National Bureau of Economic Research, Inc.
    12. Das, Jishnu, 2020. "Zen and the art of experiments: A note on preventive healthcare and the 2019 nobel prize in economics," World Development, Elsevier, vol. 127(C).
    13. Baldwin Kate & Bhavnani Rikhil R., 2015. "Ancillary Studies of Experiments: Opportunities and Challenges," Journal of Globalization and Development, De Gruyter, vol. 6(1), pages 113-146, June.
    14. Orazio Attanasio & Sarah Cattan & Emla Fitzsimons & Costas Meghir & Marta Rubio-Codina, 2020. "Estimating the Production Function for Human Capital: Results from a Randomized Controlled Trial in Colombia," American Economic Review, American Economic Association, vol. 110(1), pages 48-85, January.
    15. Janet Currie & Tom Vogl, 2013. "Early-Life Health and Adult Circumstance in Developing Countries," Annual Review of Economics, Annual Reviews, vol. 5(1), pages 1-36, May.
    16. LaFave, Daniel & Thomas, Duncan, 2017. "Extended families and child well-being," Journal of Development Economics, Elsevier, vol. 126(C), pages 52-65.
    17. Baylis, Kathy & Ham, Andres, 2015. "How important is spatial correlation in randomized controlled trials?," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205586, Agricultural and Applied Economics Association.
    18. Jacobus de Hoop & Jed Friedman & Eeshani Kandpal & Furio C. Rosati, 2019. "Child Schooling and Child Work in the Presence of a Partial Education Subsidy," Journal of Human Resources, University of Wisconsin Press, vol. 54(2), pages 503-531.
    19. Barnow, Burt S. & Greenberg, David, 2013. "Replication issues in social experiments: lessons from US labor market programs," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 46(3), pages 239-252.
    20. Kevin Croke & Joan Hamory Hicks & Eric Hsu & Michael Kremer & Ricardo Maertens & Edward Miguel & Witold Więcek, 2016. "Meta-Analysis and Public Policy: Reconciling the Evidence on Deworming," NBER Working Papers 22382, National Bureau of Economic Research, Inc.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:wdevel:v:127:y:2020:i:c:s0305750x1930436x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/worlddev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.