IDEAS home Printed from https://ideas.repec.org/p/avg/wpaper/en16321.html
   My bibliography  Save this paper

Methods for Credible Evaluation of Programme Stimulus Effects in South Africa

Author

Listed:
  • Ihsaan BASSIER
  • Joshua BUDLENDER

Abstract

In response to the effects of the COVID-19 pandemic, in 2020-2021 the South African government instituted various economic relief and stimulus programmes. These included substantial increases to social grant disbursements, and a large new targeted jobs programme. Potential “spillover” or “multiplier” effects of these programmes are an important part of prospective policy evaluation, and are of particular interest during a period of fiscal constraints. This review considers approaches for quantitatively evaluating stimulus effects of government programmes, with particular reference to the South African pandemic response. After discussing the general approach of random and quasi-random programme evaluation methods, we review the existing international literature evaluating stimulus effects of jobs programmes and cash transfers. We highlight key lessons in terms of methods, data requirements, and the necessity of rigorous local evaluations. We also describe the South African programmes, and discuss local data sources. We suggest that the social grant top-ups and jobs programme present an exciting opportunity to credibly measure programme stimulus effects in South Africa.

Suggested Citation

  • Ihsaan BASSIER & Joshua BUDLENDER, 2024. "Methods for Credible Evaluation of Programme Stimulus Effects in South Africa," Working Paper 53315978-8164-44f9-8141-5, Agence française de développement.
  • Handle: RePEc:avg:wpaper:en16321
    as

    Download full text from publisher

    File URL: https://www.afd.fr/sites/afd/files/2024-01-04-00-09/Methods-for-Credible-Evaluation-of-Programme-Stimulus-Effects-in-South-Africa.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jensen, Robert T., 2004. "Do private transfers 'displace' the benefits of public transfers? Evidence from South Africa," Journal of Public Economics, Elsevier, vol. 88(1-2), pages 89-112, January.
    2. Card, David & Krueger, Alan B, 1994. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania," American Economic Review, American Economic Association, vol. 84(4), pages 772-793, September.
    3. Christina D. Romer & David H. Romer, 2010. "The Macroeconomic Effects of Tax Changes: Estimates Based on a New Measure of Fiscal Shocks," American Economic Review, American Economic Association, vol. 100(3), pages 763-801, June.
    4. Karthik Muralidharan & Paul Niehaus & Sandip Sukhtankar, 2016. "Building State Capacity: Evidence from Biometric Smartcards in India," American Economic Review, American Economic Association, vol. 106(10), pages 2895-2929, October.
    5. Barro, Robert J, 1981. "Output Effects of Government Purchases," Journal of Political Economy, University of Chicago Press, vol. 89(6), pages 1086-1121, December.
    6. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    7. Andrew Mountford & Harald Uhlig, 2009. "What are the effects of fiscal policy shocks?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(6), pages 960-992.
    8. Peter Ganong & Pascal Noel, 2019. "Consumer Spending during Unemployment: Positive and Normative Implications," American Economic Review, American Economic Association, vol. 109(7), pages 2383-2424, July.
    9. Esther Duflo, 2003. "Grandmothers and Granddaughters: Old-Age Pensions and Intrahousehold Allocation in South Africa," The World Bank Economic Review, World Bank, vol. 17(1), pages 1-25, June.
    10. Valerie A. Ramey, 2019. "Ten Years after the Financial Crisis: What Have We Learned from the Renaissance in Fiscal Research?," Journal of Economic Perspectives, American Economic Association, vol. 33(2), pages 89-114, Spring.
    11. Manuela Angelucci & Giacomo De Giorgi, 2009. "Indirect Effects of an Aid Program: How Do Cash Transfers Affect Ineligibles' Consumption?," American Economic Review, American Economic Association, vol. 99(1), pages 486-508, March.
    12. Emi Nakamura & J?n Steinsson, 2014. "Fiscal Stimulus in a Monetary Union: Evidence from US Regions," American Economic Review, American Economic Association, vol. 104(3), pages 753-792, March.
    13. Karthik Muralidharan & Paul Niehaus & Sandip Sukhtankar, 2023. "General Equilibrium Effects of (Improving) Public Employment Programs: Experimental Evidence From India," Econometrica, Econometric Society, vol. 91(4), pages 1261-1295, July.
    14. Seán M. Muller, 2015. "Causal Interaction and External Validity: Obstacles to the Policy Relevance of Randomized Evaluations," The World Bank Economic Review, World Bank, vol. 29(suppl_1), pages 217-225.
    15. Dennis Egger & Johannes Haushofer & Edward Miguel & Paul Niehaus & Michael Walker, 2022. "General Equilibrium Effects of Cash Transfers: Experimental Evidence From Kenya," Econometrica, Econometric Society, vol. 90(6), pages 2603-2643, November.
    16. Hamoudi, Amar & Thomas, Duncan, 2014. "Endogenous coresidence and program incidence: South Africa's Old Age Pension," Journal of Development Economics, Elsevier, vol. 109(C), pages 30-37.
    17. Kate Ambler, 2016. "Bargaining with Grandma: The Impact of the South African Pension on Household Decision-Making," Journal of Human Resources, University of Wisconsin Press, vol. 51(4), pages 900-932.
    18. Arindrajit Dube & T. William Lester & Michael Reich, 2010. "Minimum Wage Effects Across State Borders: Estimates Using Contiguous Counties," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 945-964, November.
    19. Anna McCord & Dirk Ernst van Seventer, 2004. "The economy-wide impacts of the labour intensification of infrastructure expenditure in South Africa," SALDRU/CSSR Working Papers 093, Southern Africa Labour and Development Research Unit, University of Cape Town.
    20. Vimal Ranchhod, 2006. "The Effect Of The South African Old Age Pension On Labour Supply Of The Elderly," South African Journal of Economics, Economic Society of South Africa, vol. 74(4), pages 725-744, December.
    21. Beegle, Kathleen & Galasso, Emanuela & Goldberg, Jessica, 2017. "Direct and indirect effects of Malawi's public works program on food security," Journal of Development Economics, Elsevier, vol. 128(C), pages 1-23.
    22. Olivier Blanchard & Roberto Perotti, 2002. "An Empirical Characterization of the Dynamic Effects of Changes in Government Spending and Taxes on Output," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(4), pages 1329-1368.
    23. Martin Abel, 2019. "Unintended Labor Supply Effects of Cash Transfer Programs: New Evidence from South Africa’s Pension," Journal of African Economies, Centre for the Study of African Economies, vol. 28(5), pages 558-581.
    24. David Neumark & William Wascher, 1992. "Employment Effects of Minimum and Subminimum Wages: Panel Data on State Minimum Wage Laws," ILR Review, Cornell University, ILR School, vol. 46(1), pages 55-81, October.
    25. Christopher Boone & Arindrajit Dube & Lucas Goodman & Ethan Kaplan, 2021. "Unemployment Insurance Generosity and Aggregate Employment," American Economic Journal: Economic Policy, American Economic Association, vol. 13(2), pages 58-99, May.
    26. Vimal Ranchhod, 2017. "Household responses to the cessation of grant income: The case of South Africa's Old Age Pension," SALDRU Working Papers 213, Southern Africa Labour and Development Research Unit, University of Cape Town.
    27. Posel, Dorrit & Fairburn, James A. & Lund, Frances, 2006. "Labour migration and households: A reconsideration of the effects of the social pension on labour supply in South Africa," Economic Modelling, Elsevier, vol. 23(5), pages 836-853, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Girish Bahal, 2020. "Estimating the Impact of Welfare Programs on Agricultural Output: Evidence from India," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(3), pages 982-998, May.
    2. Girish Bahal & Anand Shrivastava, 2022. "Fiscal transfers and inflation: evidence from India," Empirical Economics, Springer, vol. 63(4), pages 1837-1858, October.
    3. Ramey, V.A., 2016. "Macroeconomic Shocks and Their Propagation," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 71-162, Elsevier.
    4. Valerie A. Ramey, 2011. "Can Government Purchases Stimulate the Economy?," Journal of Economic Literature, American Economic Association, vol. 49(3), pages 673-685, September.
    5. Valerie A. Ramey, 2019. "Ten Years after the Financial Crisis: What Have We Learned from the Renaissance in Fiscal Research?," Journal of Economic Perspectives, American Economic Association, vol. 33(2), pages 89-114, Spring.
    6. Cloyne, James & Jordà , Òscar & Taylor, Alan M., 2023. "State-Dependent Local Projections: Understanding Impulse Response Heterogeneity," CEPR Discussion Papers 17903, C.E.P.R. Discussion Papers.
    7. Manea, Roxana Elena & Piraino, Patrizio & Viarengo, Martina, 2023. "Crime, inequality and subsidized housing: Evidence from South Africa," World Development, Elsevier, vol. 168(C).
    8. Ihsaan Bassier & Joshua Budlender, 2024. "Stimulus effects of a large public employment programme," Working Paper a09be470-a23f-4594-b51a-f, Agence française de développement.
    9. Bahal, G., 2017. "Estimating Transfer Multiplier using Spending on Rural Development Programs in India," Cambridge Working Papers in Economics 1709, Faculty of Economics, University of Cambridge.
    10. Valerie A. Ramey, 2020. "The Macroeconomic Consequences of Infrastructure Investment," NBER Chapters, in: Economic Analysis and Infrastructure Investment, pages 219-268, National Bureau of Economic Research, Inc.
    11. Kacker, Kanishka, 2019. "Social transfers and labor supply: Long run rvidence from South Africa," MPRA Paper 99044, University Library of Munich, Germany.
    12. Agüero,Jorge M. & Fasola,Eniola, 2022. "Distributional Policies and Social Cohesion in a High-Unemployment Setting," Policy Research Working Paper Series 10103, The World Bank.
    13. Miguel Ángel Borrella Mas & Mariano Bosch Mossi & Marcello Sartarelli, 2016. "Non-Contributory Pensions Number-Gender Effects on Poverty and Household Decisions," Working Papers. Serie AD 2016-02, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    14. Goemans, Pascal & Belke, Ansgar, 2019. "Uncertainty and non-linear macroeconomic effects of fiscal policy in the US: A SEIVAR-based analysis," VfS Annual Conference 2019 (Leipzig): 30 Years after the Fall of the Berlin Wall - Democracy and Market Economy 203538, Verein für Socialpolitik / German Economic Association.
    15. Tannous Kass-Hanna & Julien Reynaud & Chris Walker, 2023. "Estimating Fiscal Multipliers Under Alternative Exchange Rate Regimes: The Case of Bolivia," IMF Working Papers 2023/240, International Monetary Fund.
    16. Fuchs-Schündeln, N. & Hassan, T.A., 2016. "Natural Experiments in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 923-1012, Elsevier.
    17. Alessandro Tondini & Cally Ardington & Ingrid Woolard, 2017. "Public pensions and elderly informal employment: Evidence from a change in retirement age in South Africa," SALDRU Working Papers 206, Southern Africa Labour and Development Research Unit, University of Cape Town.
    18. Gabriel Chodorow-Reich, 2017. "Geographic Cross-Sectional Fiscal Multipliers: What Have We Learned?," 2017 Meeting Papers 1214, Society for Economic Dynamics.
    19. Karamysheva, Madina, 2022. "How do fiscal adjustments work? An empirical investigation," Journal of Economic Dynamics and Control, Elsevier, vol. 137(C).
    20. Maria Laura Alzua & Natalia Cantet & Ana C Dammert & Damilola Olajide, 2024. "The Well-being Effects of an Old-Age Pension: Experimental Evidence for Ekiti State in Nigeria," Journal of African Economies, Centre for the Study of African Economies, vol. 33(3), pages 240-270.

    More about this item

    Keywords

    Afrique du Sud;

    JEL classification:

    • Q - Agricultural and Natural Resource Economics; Environmental and Ecological Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:avg:wpaper:en16321. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AFD (email available below). General contact details of provider: https://edirc.repec.org/data/afdgvfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.