IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/5705.html
   My bibliography  Save this paper

How do ex ante simulations compare with ex post evaluations ? evidence from the impact of conditional cash transfer programs

Author

Listed:
  • Leite, Phillippe
  • Narayan, Ambar
  • Skoufias, Emmanuel

Abstract

This paper compares the ex ante simulation of the impacts of conditional cash transfer programs against the ex post estimates of impacts obtained from experimental evaluations. Using data on program-eligible households in treatment areas from the same baseline surveys that are used for experimental evaluations of conditional cash transfer programs in Mexico and Ecuador, the authors use a micro-simulation model to derive ex ante estimates of the impact of the programs on enrollment rates and poverty. The estimates reveal that ex ante predictions of certain impacts of conditional cash transfer programs match up well against the benchmark estimates of ex post experimental studies. The findings seem to support the use of this model to assess the potential impact and cost efficiency of a conditional cash transfer program ex ante, in order to inform decisions about how the program would be designed.

Suggested Citation

  • Leite, Phillippe & Narayan, Ambar & Skoufias, Emmanuel, 2011. "How do ex ante simulations compare with ex post evaluations ? evidence from the impact of conditional cash transfer programs," Policy Research Working Paper Series 5705, The World Bank.
    • Handle: RePEc:wbk:wbrwps:5705
    as

    Download full text from publisher

    File URL: http://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/2011/06/23/000158349_20110623162735/Rendered/PDF/WPS5705.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Emmanuel Skoufias & Susan Wendy Parker, 2001. "Conditional Cash Transfers and Their Impact on Child Work and Schooling: Evidence from the PROGRESA Program in Mexico," Economía Journal, The Latin American and Caribbean Economic Association - LACEA, vol. 0(Fall 2001), pages 45-96, August.
    2. Emmanuel Skoufias & Vincenzo Di Maro, 2008. "Conditional Cash Transfers, Adult Work Incentives, and Poverty," Journal of Development Studies, Taylor & Francis Journals, vol. 44(7), pages 935-960.
    3. David McKenzie & John Gibson & Steven Stillman, 2010. "How Important Is Selection? Experimental vs. Non-Experimental Measures of the Income Gains from Migration," Journal of the European Economic Association, MIT Press, vol. 8(4), pages 913-945, June.
    4. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    5. Ravallion, Martin, 2008. "Evaluating Anti-Poverty Programs," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 59, pages 3787-3846, Elsevier.
    6. Paul Schultz, T., 2004. "School subsidies for the poor: evaluating the Mexican Progresa poverty program," Journal of Development Economics, Elsevier, vol. 74(1), pages 199-250, June.
    7. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    8. David McKenzie & John Gibson & Steven Stillman, 2006. "How Important is Selection? Experimental vs Non-experimental Measures of the Income Gains of Migration," Working Papers 06_02, Motu Economic and Public Policy Research.
    9. McKenzie, David & Gibson, John & Stillman, Steven, 2006. "How important is selection ? Experimental versus non-experimental measures of the income gains from migration," Policy Research Working Paper Series 3906, The World Bank.
    10. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    11. Deepak Lal (ed.), 1992. "Development Economics," Books, Edward Elgar Publishing, volume 0, number 566.
    12. Eliana Cardoso & Andre Portela Souza, 2004. "The Impact of Cash Transfers on Child Labor and School Attendance in Brazil," Vanderbilt University Department of Economics Working Papers 0407, Vanderbilt University Department of Economics.
    13. Kenneth I. Wolpin & Petra E. Todd, 2006. "Assessing the Impact of a School Subsidy Program in Mexico: Using a Social Experiment to Validate a Dynamic Behavioral Model of Child Schooling and Fertility," American Economic Review, American Economic Association, vol. 96(5), pages 1384-1417, December.
    14. Norbert Schady & Maria Caridad Araujo, 2008. "Cash Transfers, Conditions, and School enrollment in Ecuador," Economía Journal, The Latin American and Caribbean Economic Association - LACEA, vol. 0(Spring 20), pages 43-77, January.
    15. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. André Decoster & Pieter Vanleenhove, 2012. "In-Work Tax Credits in Belgium :An Analysis of the Jobkorting Using a Discrete Labour Supply Model," Brussels Economic Review, ULB -- Universite Libre de Bruxelles, vol. 55(2), pages 121-150.
    2. Jose Cuesta & Jon Jellema & Lucia Ferrone, 2021. "Fiscal Policy, Multidimensional Poverty, and Equity in Uganda: A Child-Lens Analysis," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 33(3), pages 427-458, June.
    3. Jose Cuesta & Michael Danquah, 2022. "Urban cash transfers and poverty in Ghana," Review of Development Economics, Wiley Blackwell, vol. 26(1), pages 133-155, February.
    4. Jose Cuesta & Jon Jellema & Lucia Ferrone, 0. "Fiscal Policy, Multidimensional Poverty, and Equity in Uganda: A Child-Lens Analysis," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 0, pages 1-32.
    5. Pablo Vidueira & José M. Díaz-Puente & María Rivera, 2014. "Socioeconomic Impact Assessment in Ex Ante Evaluations," Evaluation Review, , vol. 38(4), pages 309-335, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    2. Ferraro, Paul J. & Miranda, Juan José, 2014. "The performance of non-experimental designs in the evaluation of environmental programs: A design-replication study using a large-scale randomized experiment as a benchmark," Journal of Economic Behavior & Organization, Elsevier, vol. 107(PA), pages 344-365.
    3. Deon Filmer & Norbert Schady, 2008. "Getting Girls into School: Evidence from a Scholarship Program in Cambodia," Economic Development and Cultural Change, University of Chicago Press, vol. 56(3), pages 581-617, April.
    4. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    5. Todd, Petra E., 2012. "Effectiveness of interventions aimed at improving women's employability and quality of work : a critical review," Policy Research Working Paper Series 6189, The World Bank.
    6. de Brauw, Alan & Hoddinott, John, 2011. "Must conditional cash transfer programs be conditioned to be effective? The impact of conditioning transfers on school enrollment in Mexico," Journal of Development Economics, Elsevier, vol. 96(2), pages 359-370, November.
    7. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    8. Kitaura, Koji & Miyazawa, Kazutoshi, 2021. "Inequality and conditionality in cash transfers: Demographic transition and economic development," Economic Modelling, Elsevier, vol. 94(C), pages 276-287.
    9. Mazzutti, Caio Cícero Toledo Piza da Costa, 2016. "Three essays on the causal impacts of child labour laws in Brazil," Economics PhD Theses 0616, Department of Economics, University of Sussex Business School.
    10. Rizwana Siddiqui, 2013. "Impact Evaluation of Remittances for Pakistan: Propensity Score Matching Approach," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 52(1), pages 17-44.
    11. John Gibson & David McKenzie, 2007. "Using Global Positioning Systems in Household Surveys for Better Economics and Better Policy," The World Bank Research Observer, World Bank, vol. 22(2), pages 217-241, September.
    12. Rodriguez, Divina Gracia P. & Rejesus, Roderick M. & Aragon, Corazono T., 2007. "Impacts of an Agricultural Development Program for Poor Coconut Producers in the Philippines: An Approach Using Panel Data and Propensity Score Matching Techniques," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 32(3), pages 1-24, December.
    13. Eliana V. Jimenez & Richard P.C. Brown, 2008. "Assessing the poverty impacts of remittances with alternative counterfactual income estimates," Discussion Papers Series 375, School of Economics, University of Queensland, Australia.
    14. Sudhanshu Handa & John A. Maluccio, 2010. "Matching the Gold Standard: Comparing Experimental and Nonexperimental Evaluation Techniques for a Geographically Targeted Program," Economic Development and Cultural Change, University of Chicago Press, vol. 58(3), pages 415-447, April.
    15. Fernando Borraz & Nicolás González, 2009. "Impact of the Uruguayan Conditional Cash Transfer Program," Latin American Journal of Economics-formerly Cuadernos de Economía, Instituto de Economía. Pontificia Universidad Católica de Chile., vol. 46(134), pages 243-271.
    16. Dettmann, E. & Becker, C. & Schmeißer, C., 2011. "Distance functions for matching in small samples," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1942-1960, May.
    17. Juan Díaz & Miguel Jaramillo, 2006. "An Evaluation of the Peruvian "Youth Labor Training Program"-PROJOVEN," OVE Working Papers 1006, Inter-American Development Bank, Office of Evaluation and Oversight (OVE).
    18. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006. "Moving the Goalposts: Addressing Limited Overlap in the Estimation of Average Treatment Effects by Changing the Estimand," NBER Technical Working Papers 0330, National Bureau of Economic Research, Inc.
    19. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2009. "Dealing with limited overlap in estimation of average treatment effects," Biometrika, Biometrika Trust, vol. 96(1), pages 187-199.
    20. Tommaso Nannicini, 2007. "Simulation-based sensitivity analysis for matching estimators," Stata Journal, StataCorp LP, vol. 7(3), pages 334-350, September.

    More about this item

    Keywords

    Poverty Monitoring&Analysis; Scientific Research&Science Parks; Science Education; Youth and Governance; Primary Education;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:5705. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.