IDEAS home Printed from https://ideas.repec.org/a/eee/socmed/v299y2022ics0277953621007449.html
   My bibliography  Save this article

Promising careers? A critical analysis of a randomised control trial in community health worker recruitment in Zambia

Author

Listed:
  • Wintrup, James

Abstract

This paper examines an influential randomised control trial (RCT) that aimed to identify how to recruit the best community health workers (CHWs) in Zambia. The economists who designed the RCT found that when they used job advertisement posters that emphasised future career prospects, they attracted applicants who were more “effective” health workers (according to various quantitative measures). The Zambian government accepted this policy advice and recruited thousands of new CHWs using posters that highlighted the career path available. However, since rolling out the programme nationally, the Zambian government has not built a career ladder into this position and the recruitment process has offered false hope to those who were selected. While acknowledging the responsibility of the Zambian government, this paper analyses the role of the RCT in this outcome. Drawing on ethnographic research and interviews conducted between 2019 and 2020, the paper shows how the RCT was flawed. The economists who designed the RCT framed it as a study of “bureaucrats” and “civil servants” and therefore overlooked crucial academic and policy debates about the distinctive role of CHWs – including the well-documented reluctance of governments to offer them careers. By failing to consider the political context of the CHW programme, the economists who designed the RCT provided policy advice that “worked” for the Zambian government in the short-term but which has ultimately been harmful to CHWs. Drawing on this case study, the paper contributes to the growing critical scholarship on RCTs and raises questions about whether these studies objectively improve policymaking, as many of their proponents claim.

Suggested Citation

  • Wintrup, James, 2022. "Promising careers? A critical analysis of a randomised control trial in community health worker recruitment in Zambia," Social Science & Medicine, Elsevier, vol. 299(C).
    • Handle: RePEc:eee:socmed:v:299:y:2022:i:c:s0277953621007449
    DOI: 10.1016/j.socscimed.2021.114412
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0277953621007449
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.socscimed.2021.114412?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Warren Pearce & Sujatha Raman, 2014. "The new randomised controlled trials (RCT) movement in public policy: challenges of epistemic governance," Policy Sciences, Springer;Society of Policy Sciences, vol. 47(4), pages 387-402, December.
    2. Druckman, James N. & Green, Donald P. & Kuklinski, James H. & Lupia, Arthur, 2006. "The Growth and Development of Experimental Research in Political Science," American Political Science Review, Cambridge University Press, vol. 100(4), pages 627-635, November.
    3. Edward P. Lazear & Paul Oyer, 2012. "Personnel Economics [The Handbook of Organizational Economics]," Introductory Chapters,, Princeton University Press.
    4. Florent Bédécarrats & Isabelle Guérin & François Roubaud, 2019. "All that Glitters is not Gold. The Political Economy of Randomized Evaluations in Development," Development and Change, International Institute of Social Studies, vol. 50(3), pages 735-762, May.
    5. repec:feb:artefa:0087 is not listed on IDEAS
    6. Duflo, Esther, 2017. "The Economist as Plumber," CEPR Discussion Papers 11881, C.E.P.R. Discussion Papers.
    7. Naila Kabeer, 2019. "Randomized Control Trials and Qualitative Evaluations of a Multifaceted Programme for Women in Extreme Poverty: Empirical Findings and Methodological Reflections," Journal of Human Development and Capabilities, Taylor & Francis Journals, vol. 20(2), pages 197-217, April.
    8. Abhijit V. Banerjee & Esther Duflo, 2009. "The Experimental Approach to Development Economics," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 151-178, May.
    9. Sophie Webber & Carolyn Prouse, 2018. "The New Gold Standard: The Rise of Randomized Control Trials and Experimental Development," Economic Geography, Taylor & Francis Journals, vol. 94(2), pages 166-187, March.
    10. Levitt, Steven D. & List, John A., 2009. "Field experiments in economics: The past, the present, and the future," European Economic Review, Elsevier, vol. 53(1), pages 1-18, January.
    11. Jessica Cohen & Pascaline Dupas, 2010. "Free Distribution or Cost-Sharing? Evidence from a Randomized Malaria Prevention Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(1), pages 1-45.
    12. Esther Duflo, 2017. "Richard T. Ely Lecture: The Economist as Plumber," American Economic Review, American Economic Association, vol. 107(5), pages 1-26, May.
    13. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    14. Nava Ashraf & Oriana Bandiera & Edward Davenport & Scott S. Lee, 2020. "Losing Prosociality in the Quest for Talent? Sorting, Selection, and Productivity in the Delivery of Public Services," American Economic Review, American Economic Association, vol. 110(5), pages 1355-1394, May.
    15. Drèze, Jean, 2020. "Policy beyond evidence," World Development, Elsevier, vol. 127(C).
    16. Maes, Kenneth & Kalofonos, Ippolytos, 2013. "Becoming and remaining community health workers: Perspectives from Ethiopia and Mozambique," Social Science & Medicine, Elsevier, vol. 87(C), pages 52-59.
    17. Maes, Kenneth C. & Kohrt, Brandon A. & Closser, Svea, 2010. "Culture, status and context in community health worker pay: Pitfalls and opportunities for policy research. A commentary on Glenton et al. (2010)," Social Science & Medicine, Elsevier, vol. 71(8), pages 1375-1378, October.
    18. Glenton, Claire & Scheel, Inger B. & Pradhan, Sabina & Lewin, Simon & Hodgins, Stephen & Shrestha, Vijaya, 2010. "The female community health volunteer programme in Nepal: Decision makers' perceptions of volunteerism, payment and other incentives," Social Science & Medicine, Elsevier, vol. 70(12), pages 1920-1927, June.
    19. Esther Duflo, 2017. "The Economist as Plumber," NBER Working Papers 23213, National Bureau of Economic Research, Inc.
    20. Cueto, M., 2004. "The origins of primary health care and selective primary health care," American Journal of Public Health, American Public Health Association, vol. 94(11), pages 1864-1874.
    21. Donovan, Kevin P., 2018. "The rise of the randomistas: on the experimental turn in international aid," SocArXiv xygzb, Center for Open Science.
    22. Lazear, Edward P., 2012. "Leadership: A personnel economics approach," Labour Economics, Elsevier, vol. 19(1), pages 92-101.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wintrup, James, 2023. "Health by the people, again? The lost lessons of Alma-Ata in a community health worker programme in Zambia," Social Science & Medicine, Elsevier, vol. 319(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wintrup, James, 2023. "Health by the people, again? The lost lessons of Alma-Ata in a community health worker programme in Zambia," Social Science & Medicine, Elsevier, vol. 319(C).
    2. Vikram Tyagi & Sophie Webber, 2021. "A rusting gold standard: Failures in an Indonesian RCT, and the implications for poverty reduction," Environment and Planning A, , vol. 53(5), pages 992-1011, August.
    3. John Gibson, 2021. "The micro‐geography of academic research: How distinctive is economics?," Scottish Journal of Political Economy, Scottish Economic Society, vol. 68(4), pages 467-484, September.
    4. Alice Nicole Sindzingre, 2021. "Truth vs justification: contrasting heterodox and mainstream thinking on development via the example of austerity in Africa," CEPN Working Papers hal-03139457, HAL.
    5. Boris Salazar-Trujillo & Daniel Otero Robles, 2019. "La revolución empírica en economía," Apuntes del Cenes, Universidad Pedagógica y Tecnológica de Colombia, vol. 38(68), pages 15-48, July.
    6. Justman, Moshe, 2018. "Randomized controlled trials informing public policy: Lessons from project STAR and class size reduction," European Journal of Political Economy, Elsevier, vol. 54(C), pages 167-174.
    7. Rao, Vijayendra, 2020. "Evidence-based development needs a diversity of tools, with a bottom-up process of “embedded” dialogue," World Development, Elsevier, vol. 127(C).
    8. Alice Nicole Sindzingre, 2021. "Truth vs justification: contrasting heterodox and mainstream thinking on development via the example of austerity in Africa," Working Papers hal-03139457, HAL.
    9. Drèze, Jean, 2020. "Policy beyond evidence," World Development, Elsevier, vol. 127(C).
    10. Sindzingre, Alice, 2021. "Truth vs. justification: Contrasting heterodox and mainstream thinking on development via the example of austerity in Africa," IPE Working Papers 155/2021, Berlin School of Economics and Law, Institute for International Political Economy (IPE).
    11. Maibom, Jonas, 2021. "The Danish Labor Market Experiments: Methods and Findings," Nationaløkonomisk tidsskrift, Nationaløkonomisk Forening, vol. 2021(1), pages 1-21.
    12. Dina Pomeranz & José Vila-Belda, 2019. "Taking State-Capacity Research to the Field: Insights from Collaborations with Tax Authorities," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 755-781, August.
    13. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    14. Krause, Philipp & Hernández Licona, Gonzalo, 2020. "From experimental findings to evidence-based policy," World Development, Elsevier, vol. 127(C).
    15. Ingrid Harvold Kvangraven & Surbhi Kesar, 2021. "Standing in the Way of Rigor? Economics’ Meeting with the Decolonizing Agenda," Working Papers 2110, New School for Social Research, Department of Economics.
    16. Alem, Mauro & Jorge Elias, Julio, 2018. "Allocating production risks through credit cum insurance contracts: the design and implementation of a fund for small cotton growers to access market finance," International Food and Agribusiness Management Review, International Food and Agribusiness Management Association, vol. 21(2), March.
    17. B. James Deaton, 2019. "Agricultural economics: Key commitments and institutional alertness," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 67(1), pages 5-14, March.
    18. Rehse, Dominik & Tremöhlen, Felix, 2020. "Fostering participation in digital public health interventions: The case of digital contact tracing," ZEW Discussion Papers 20-076, ZEW - Leibniz Centre for European Economic Research.
    19. Wei Yang Tham & Joseph Staudt & Elisabeth Ruth Perlman & Stephanie D. Cheng, 2024. "Scientific Talent Leaks Out of Funding Gaps," Working Papers 24-08, Center for Economic Studies, U.S. Census Bureau.
    20. Peter Boettke & John Kroencke, 2020. "The real purpose of the program: a case study in James M. Buchanan’s efforts at academic entrepreneurship to “save the books” in economics," Public Choice, Springer, vol. 183(3), pages 227-245, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:socmed:v:299:y:2022:i:c:s0277953621007449. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/315/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.