IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/28664.html
   My bibliography  Save this paper

Do Workfare Programs Live Up to Their Promises? Experimental Evidence from Cote D’Ivoire

Author

Listed:
  • Marianne Bertrand
  • Bruno Crépon
  • Alicia Marguerie
  • Patrick Premand

Abstract

Workfare programs are one of the most popular social protection and employment policy instruments in the developing world. They evoke the promise of efficient targeting, as well as immediate and lasting impacts on participants’ employment, earnings, skills and behaviors. This paper evaluates contemporaneous and post-program impacts of a public works intervention in Côte d’Ivoire. The program was randomized among urban youths who self-selected to participate and provided seven months of employment at the formal minimum wage. Randomized subsets of beneficiaries also received complementary training on basic entrepreneurship or job search skills. During the program, results show limited impacts on the likelihood of employment, but a shift toward wage jobs, higher earnings and savings, as well as changes in work habits and behaviors. Fifteen months after the program ended, savings stock remain higher, but there are no lasting impacts on employment or behaviors, and only limited impacts on earnings. Machine learning techniques are applied to assess whether program targeting can improve. Significant heterogeneity in impacts on earnings is found during the program but not post-program. Departing from self-targeting improves performance: a range of practical targeting mechanisms achieve impacts close to a machine learning benchmark by maximizing contemporaneous impacts without reducing post-program impacts. Impacts on earnings remain substantially below program costs even under improved targeting.

Suggested Citation

  • Marianne Bertrand & Bruno Crépon & Alicia Marguerie & Patrick Premand, 2021. "Do Workfare Programs Live Up to Their Promises? Experimental Evidence from Cote D’Ivoire," NBER Working Papers 28664, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:28664
    Note: DEV LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w28664.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 487-535.
    2. Gehrke, Esther & Hartwig, Renate, 2018. "Productive effects of public works programs: What do we know? What should we know?," World Development, Elsevier, vol. 107(C), pages 111-124.
    3. Toru Kitagawa & Aleksey Tetenov, 2018. "Who Should Be Treated? Empirical Welfare Maximization Methods for Treatment Choice," Econometrica, Econometric Society, vol. 86(2), pages 591-616, March.
    4. Vivi Alatas & Abhijit Banerjee & Rema Hanna & Benjamin A. Olken & Julia Tobias, 2012. "Targeting the Poor: Evidence from a Field Experiment in Indonesia," American Economic Review, American Economic Association, vol. 102(4), pages 1206-1240, June.
    5. Kuhn, Max, 2008. "Building Predictive Models in R Using the caret Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 28(i05).
    6. Clément Imbert & John Papp, 2015. "Labor Market Effects of Social Programs: Evidence from India's Employment Guarantee," American Economic Journal: Applied Economics, American Economic Association, vol. 7(2), pages 233-263, April.
    7. McKenzie, David & Sansone, Dario, 2019. "Predicting entrepreneurial success is hard: Evidence from a business plan competition in Nigeria," Journal of Development Economics, Elsevier, vol. 141(C).
    8. Emanuela Galasso & Martin Ravallion, 2004. "Social Protection in a Crisis: Argentina's Plan Jefes y Jefas," The World Bank Economic Review, World Bank, vol. 18(3), pages 367-399.
    9. Victor Chernozhukov & Mert Demirer & Esther Duflo & Iv'an Fern'andez-Val, 2017. "Fisher-Schultz Lecture: Generic Machine Learning Inference on Heterogenous Treatment Effects in Randomized Experiments, with an Application to Immunization in India," Papers 1712.04802, arXiv.org, revised Oct 2023.
    10. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2006. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," American Economic Review, American Economic Association, vol. 96(4), pages 988-1012, September.
    11. Basurto, Maria Pia & Dupas, Pascaline & Robinson, Jonathan, 2020. "Decentralization and efficiency of subsidy targeting: Evidence from chiefs in rural Malawi," Journal of Public Economics, Elsevier, vol. 185(C).
    12. Ugo Gentilini & Margaret Grosh & Jamele Rigolini & Ruslan Yemtsov, 2020. "Exploring Universal Basic Income," World Bank Publications - Books, The World Bank Group, number 32677.
    13. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    14. Rema Hanna & Benjamin A. Olken, 2018. "Universal Basic Incomes versus Targeted Transfers: Anti-Poverty Programs in Developing Countries," Journal of Economic Perspectives, American Economic Association, vol. 32(4), pages 201-226, Fall.
    15. Hanna, Rema & Olken, Benjamin A., 2018. "Universal Basic Incomes vs. Targeted Transfers: Anti-Poverty Programs in Developing Countries," Working Paper Series rwp18-024, Harvard University, John F. Kennedy School of Government.
    16. Besley, Timothy & Coate, Stephen, 1992. "Workfare versus Welfare Incentive Arguments for Work Requirements in Poverty-Alleviation Programs," American Economic Review, American Economic Association, vol. 82(1), pages 249-261, March.
    17. Daniel Gilligan & John Hoddinott & Alemayehu Seyoum Taffesse, 2009. "The Impact of Ethiopia's Productive Safety Net Programme and its Linkages," Journal of Development Studies, Taylor & Francis Journals, vol. 45(10), pages 1684-1706.
    18. Crepon,Bruno Jacques Jean Philippe & Premand,Patrick, 2018. "Creating new positions ? direct and indirect effects of a subsidized apprenticeship program," Policy Research Working Paper Series 8561, The World Bank.
    19. Deon Filmer & Louise Fox, 2014. "Youth Employment in Sub-Saharan Africa [L’emploi des jeunes en Afrique subsaharienne - Rapport complet]," World Bank Publications - Books, The World Bank Group, number 16608.
    20. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, July.
    21. Ravi, Shamika & Engler, Monika, 2015. "Workfare as an Effective Way to Fight Poverty: The Case of India’s NREGS," World Development, Elsevier, vol. 67(C), pages 57-71.
    22. Katherine Casey & Rachel Glennerster & Edward Miguel, 2012. "Reshaping Institutions: Evidence on Aid Impacts Using a Preanalysis Plan," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(4), pages 1755-1812.
    23. Jalan, Jyotsna & Ravallion, Martin, 2003. "Estimating the Benefit Incidence of an Antipoverty Program by Propensity-Score Matching," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(1), pages 19-30, January.
    24. Jonathan M.V. Davis & Sara B. Heller, 2017. "Using Causal Forests to Predict Treatment Heterogeneity: An Application to Summer Jobs," American Economic Review, American Economic Association, vol. 107(5), pages 546-550, May.
    25. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    26. Ravallion, Martin, 1991. "Reaching the Rural Poor through Public Employment: Arguments, Evidence, and Lessons from South Asia," The World Bank Research Observer, World Bank, vol. 6(2), pages 153-175, July.
    27. Bhattacharya, Debopam & Dupas, Pascaline, 2012. "Inferring welfare maximizing treatment assignment under budget constraints," Journal of Econometrics, Elsevier, vol. 167(1), pages 168-196.
    28. Emanuela Galasso & Martin Ravallion & Agustin Salvia, 2004. "Assisting the Transition from Workfare to Work: A Randomized Experiment," ILR Review, Cornell University, ILR School, vol. 58(1), pages 128-142, October.
    29. Sofia Amaral & Siddhartha Bandyopadhyay & Rudra Sensarma, 2015. "Employment Programmes for the Poor and Female Empowerment: The Effect of NREGS on Gender-based Violence in India," Journal of Interdisciplinary Economics, , vol. 27(2), pages 199-218, July.
    30. Djebbari, Habiba & Smith, Jeffrey, 2008. "Heterogeneous impacts in PROGRESA," Journal of Econometrics, Elsevier, vol. 145(1-2), pages 64-80, July.
    31. Athey, Susan & Wager, Stefan, 2017. "Efficient Policy Learning," Research Papers 3506, Stanford University, Graduate School of Business.
    32. Datt, Gaurav & Ravallion, Martin, 1994. "Transfer Benefits from Public-Works Employment: Evidence for Rural India," Economic Journal, Royal Economic Society, vol. 104(427), pages 1346-1369, November.
    33. Alik-Lagrange, Arthur & Ravallion, Martin, 2018. "Workfare versus transfers in rural India," World Development, Elsevier, vol. 112(C), pages 244-258.
    34. Karthik Muralidharan & Paul Niehaus & Sandip Sukhtankar, 2016. "Building State Capacity: Evidence from Biometric Smartcards in India," American Economic Review, American Economic Association, vol. 106(10), pages 2895-2929, October.
    35. Benjamin A. Olken, 2015. "Promises and Perils of Pre-analysis Plans," Journal of Economic Perspectives, American Economic Association, vol. 29(3), pages 61-80, Summer.
    36. Almeida, Rita K. & Galasso, Emanuela, 2010. "Jump-starting Self-employment? Evidence for Welfare Participants in Argentina," World Development, Elsevier, vol. 38(5), pages 742-755, May.
    37. Vivi Alatas & Abhijit Banerjee & Rema Hanna & Benjamin A. Olken & Ririn Purnamasari & Matthew Wai-Poi, 2016. "Self-Targeting: Evidence from a Field Experiment in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 124(2), pages 371-427.
    38. Abhijit Banerjee & Paul Niehaus & Tavneet Suri, 2019. "Universal Basic Income in the Developing World," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 959-983, August.
    39. Blair, Graeme & Imai, Kosuke, 2012. "Statistical Analysis of List Experiments," Political Analysis, Cambridge University Press, vol. 20(1), pages 47-77, January.
    40. Martin Ravallion & Emanuela Galasso & Teodoro Lazo & Ernesto Philipp, 2005. "What Can Ex-Participants Reveal about a Program’s Impact?," Journal of Human Resources, University of Wisconsin Press, vol. 40(1).
    41. Breda, Thomas & Grenet, Julien & Monnet, Marion & Van Effenterre, Clémentine, 2020. "Do Female Role Models Reduce the Gender Gap in Science? Evidence from French High Schools," IZA Discussion Papers 13163, Institute of Labor Economics (IZA).
    42. Beegle, Kathleen & Galasso, Emanuela & Goldberg, Jessica, 2017. "Direct and indirect effects of Malawi's public works program on food security," Journal of Development Economics, Elsevier, vol. 128(C), pages 1-23.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mesplé-Somps, Sandrine & Nilsson, Björn, 2023. "Role models, aspirations and desire to migrate," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 819-839.
    2. Borga, Liyousew G. & D’Ambrosio, Conchita, 2021. "Social protection and multidimensional poverty: Lessons from Ethiopia, India and Peru," World Development, Elsevier, vol. 147(C).
    3. Michael Lechner & Jana Mareckova, 2024. "Comprehensive Causal Machine Learning," Papers 2405.10198, arXiv.org.
    4. Jules Gazeaud & Victor Stephane, 2023. "Productive Workfare? Evidence from Ethiopia's Productive Safety Net Program," American Journal of Agricultural Economics, John Wiley & Sons, vol. 105(1), pages 265-290, January.
    5. repec:wbk:wbrwps:10251 is not listed on IDEAS
    6. Blimpo, Moussa P. & Pugatch, Todd, 2023. "Unintended Consequences of Youth Entrepreneurship Programs: Experimental Evidence from Rwanda," GLO Discussion Paper Series 1332, Global Labor Organization (GLO).
    7. Patrick Premand & Dominic Rohner, 2024. "Cash and Conflict: Large-Scale Experimental Evidence from Niger," American Economic Review: Insights, American Economic Association, vol. 6(1), pages 137-153, March.
    8. Simon Franklin & Clément Imbert & Girum Abebe & Carolina Mejia-Mantilla, 2024. "Urban Public Works in Spatial Equilibrium: Experimental Evidence from Ethiopia," American Economic Review, American Economic Association, vol. 114(5), pages 1382-1414, May.
    9. Hirvonen, Kalle & Machado, Elia Axinia & Simons, Andrew M., 2024. "Do social protection programs reduce conflict risk? Evidence from a large-scale safety net program in rural Ethiopia," 2024 Annual Meeting, July 28-30, New Orleans, LA 343590, Agricultural and Applied Economics Association.
    10. Alik-Lagrange, Arthur & Buehren, Niklas & Goldstein, Markus & Hoogeveen, Johannes, 2023. "Welfare impacts of public works in fragile and conflict affected economies: The Londö public works in the Central African Republic," Labour Economics, Elsevier, vol. 81(C).
    11. Lafortune, Jeanne & Pugatch, Todd & Tessada, José & Ubfal, Diego, 2022. "Can interactive online training make high school students more entrepreneurial? Experimental evidence from Rwanda," GLO Discussion Paper Series 1041, Global Labor Organization (GLO).
    12. Baird, Sarah & McIntosh, Craig & Özler, Berk & Pape, Utz, 2024. "Asset transfers and anti-poverty programs: Experimental evidence from Tanzania," Journal of Development Economics, Elsevier, vol. 166(C).
    13. Michael Lechner & Jana Mareckova, 2022. "Modified Causal Forest," Papers 2209.03744, arXiv.org.
    14. Bryan, Gharad & Karlan, Dean & Osman, Adam, 2024. "Big loans to small businesses: predicting winners and losers in an entrepreneurial lending experiment," LSE Research Online Documents on Economics 120637, London School of Economics and Political Science, LSE Library.
    15. Yu, Li & Ma, Tiemeng & Wu, Sirong & Lyu, Zhuoyang, 2023. "How does broadband internet affect firm-level labor misallocation: The role of information frictions," China Economic Review, Elsevier, vol. 82(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jules Gazeaud & Victor Stephane, 2023. "Productive Workfare? Evidence from Ethiopia's Productive Safety Net Program," American Journal of Agricultural Economics, John Wiley & Sons, vol. 105(1), pages 265-290, January.
    2. Ravallion, Martin, 2019. "Guaranteed employment or guaranteed income?," World Development, Elsevier, vol. 115(C), pages 209-221.
    3. Johannes Haushofer & Paul Niehaus & Carlos Paramo & Edward Miguel & Michael W. Walker, 2022. "Targeting Impact versus Deprivation," NBER Working Papers 30138, National Bureau of Economic Research, Inc.
    4. Haseeb, Muhammad & Vyborny, Kate, 2022. "Data, discretion and institutional capacity: Evidence from cash transfers in Pakistan," Journal of Public Economics, Elsevier, vol. 206(C).
    5. Alik-Lagrange, Arthur & Buehren, Niklas & Goldstein, Markus & Hoogeveen, Johannes, 2023. "Welfare impacts of public works in fragile and conflict affected economies: The Londö public works in the Central African Republic," Labour Economics, Elsevier, vol. 81(C).
    6. Bjorkegren, Dan & Blumenstock, Joshua & Knight, Samsun, 2022. "(Machine) Learning What Policies Value," CEPR Discussion Papers 17364, C.E.P.R. Discussion Papers.
    7. Gehrke, Esther & Hartwig, Renate, 2018. "Productive effects of public works programs: What do we know? What should we know?," World Development, Elsevier, vol. 107(C), pages 111-124.
    8. Zimmermann, Laura, 2020. "Why Guarantee Employment? Evidence from a Large Indian Public-Works Program," GLO Discussion Paper Series 504, Global Labor Organization (GLO).
    9. Borga, Liyousew G. & D’Ambrosio, Conchita, 2021. "Social protection and multidimensional poverty: Lessons from Ethiopia, India and Peru," World Development, Elsevier, vol. 147(C).
    10. Firpo, Sergio & Galvao, Antonio F. & Kobus, Martyna & Parker, Thomas & Rosa-Dias, Pedro, 2020. "Loss Aversion and the Welfare Ranking of Policy Interventions," IZA Discussion Papers 13176, Institute of Labor Economics (IZA).
    11. Michael C Knaus, 2022. "Double machine learning-based programme evaluation under unconfoundedness [Econometric methods for program evaluation]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 602-627.
    12. Kock, Anders Bredahl & Preinerstorfer, David & Veliyev, Bezirgen, 2023. "Treatment recommendation with distributional targets," Journal of Econometrics, Elsevier, vol. 234(2), pages 624-646.
    13. Steven F. Lehrer & R. Vincent Pohl & Kyungchul Song, 2022. "Multiple Testing and the Distributional Effects of Accountability Incentives in Education," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(4), pages 1552-1568, October.
    14. Augustine Denteh & Helge Liebert, 2022. "Who Increases Emergency Department Use? New Insights from the Oregon Health Insurance Experiment," Working Papers 2201, Tulane University, Department of Economics.
    15. Parantap Basu & Rajesh Raj Natarajan & Kunal Sen, 2020. "Administrative failures in anti-poverty programmes and household welfare: An investigation of India's employment guarantee programme," WIDER Working Paper Series wp-2020-41, World Institute for Development Economic Research (UNU-WIDER).
    16. Della Guardia, Anne & Lake, Milli & Schnitzer, Pascale, 2022. "Selective inclusion in cash transfer programs: Unintended consequences for social cohesion," World Development, Elsevier, vol. 157(C).
    17. Anthony Strittmatter, 2018. "What Is the Value Added by Using Causal Machine Learning Methods in a Welfare Experiment Evaluation?," Papers 1812.06533, arXiv.org, revised Dec 2021.
    18. Klonner, Stefan & Oldiges, Christian, 2022. "The welfare effects of India’s rural employment guarantee," Journal of Development Economics, Elsevier, vol. 157(C).
    19. Davide Viviano, 2019. "Policy Targeting under Network Interference," Papers 1906.10258, arXiv.org, revised Apr 2024.
    20. Gehrke, Esther & Hartwig, Renate, 2015. "How can public works programmes create sustainable employment?," IDOS Discussion Papers 11/2015, German Institute of Development and Sustainability (IDOS).

    More about this item

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • H53 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Welfare Programs
    • I38 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Government Programs; Provision and Effects of Welfare Programs
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:28664. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.