IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp12839.html
   My bibliography  Save this paper

Understanding Program Complementarities: Estimating the Dynamic Effects of a Training Program with Multiple Alternatives

Author

Listed:
  • Dalla-Zuanna, Antonio

    (Bank of Italy)

  • Liu, Kai

    (University of Cambridge)

Abstract

In this paper we estimate the causal effect of a training program for disadvantaged youths on their long-run labor market outcomes. Individuals receive lottery offers to participate in the program, but are allowed to choose when to leave the program and to participate in alternative programs. We consider a multistage decision setting, where individuals sequentially select which program to participate in at every stage. The standard IV estimator using initial random assignment as instrumental variable identifies a weighted average of the effects of the treatment for subgroups of individuals differing in terms of potential duration of participation and choice of alternative programs. We estimate a sequential choice model that allows us to estimate the effect of the treatment for these different subgroups separately. We use the estimated model to investigate the dynamic complementarity between different training programs and explore program targeting to improve the cost-effectiveness relative to the existing program.

Suggested Citation

  • Dalla-Zuanna, Antonio & Liu, Kai, 2019. "Understanding Program Complementarities: Estimating the Dynamic Effects of a Training Program with Multiple Alternatives," IZA Discussion Papers 12839, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp12839
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp12839.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bocar A. Ba & John C. Ham & Robert J. LaLonde & Xianghong Li, 2017. "Estimating (Easily Interpreted) Dynamic Training Effects from Experimental Data," Journal of Labor Economics, University of Chicago Press, vol. 35(S1), pages 149-200.
    2. Hansen, Karsten T. & Heckman, James J. & Mullen, K.J.Kathleen J., 2004. "The effect of schooling and ability on achievement test scores," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 39-98.
    3. James Heckman & Flavio Cunha, 2007. "The Technology of Skill Formation," American Economic Review, American Economic Association, vol. 97(2), pages 31-47, May.
    4. Bernd Fitzenberger & Aderonke Osikominu & Robert Völter, 2008. "Get Training or Wait? Long-Run Employment Effects of Training Programs for the Unemployed in West Germany," Annals of Economics and Statistics, GENES, issue 91-92, pages 321-355.
    5. Heckman, James J. & Navarro, Salvador, 2007. "Dynamic discrete choice and dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 136(2), pages 341-396, February.
    6. Patrick Kline & Christopher R. Walters, 2016. "Evaluating Public Programs with Close Substitutes: The Case of HeadStart," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1795-1848.
    7. repec:eme:rleczz:s0147-9121(2012)0000035039 is not listed on IDEAS
    8. Heckman, James J. & Urzúa, Sergio, 2010. "Comparing IV with structural models: What simple IV can and cannot identify," Journal of Econometrics, Elsevier, vol. 156(1), pages 27-37, May.
    9. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    10. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    11. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    12. Michael Lechner & Ruth Miquel, 2010. "Identification of the effects of dynamic treatments by sequential conditional independence assumptions," Empirical Economics, Springer, vol. 39(1), pages 111-137, August.
    13. Curtis Eberwein & John C. Ham & Robert J. Lalonde, 1997. "The Impact of Being Offered and Receiving Classroom Training on the Employment Histories of Disadvantaged Women: Evidence from Experimental Data," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 655-682.
    14. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    15. Matthew Gentzkow, 2007. "Valuing New Goods in a Model with Complementarity: Online Newspapers," American Economic Review, American Economic Association, vol. 97(3), pages 713-744, June.
    16. Joseph G. Altonji & Nicolas Williams, 2005. "Do Wages Rise with Job Seniority? A Reassessment," ILR Review, Cornell University, ILR School, vol. 58(3), pages 370-397, April.
    17. Sebastian Calónico & Jeffrey Smith, 2017. "The Women of the National Supported Work Demonstration," Journal of Labor Economics, University of Chicago Press, vol. 35(S1), pages 65-97.
    18. James Heckman & Neil Hohmann & Jeffrey Smith & Michael Khoo, 2000. "Substitution and Dropout Bias in Social Experiments: A Study of an Influential Social Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(2), pages 651-694.
    19. Howard S. Bloom & Larry L. Orr & Stephen H. Bell & George Cave & Fred Doolittle & Winston Lin & Johannes M. Bos, 1997. "The Benefits and Costs of JTPA Title II-A Programs: Key Findings from the National Job Training Partnership Act Study," Journal of Human Resources, University of Wisconsin Press, vol. 32(3), pages 549-576.
    20. Peter Z. Schochet & John Burghardt & Sheena McConnell, 2008. "Does Job Corps Work? Impact Findings from the National Job Corps Study," American Economic Review, American Economic Association, vol. 98(5), pages 1864-1886, December.
    21. repec:adr:anecst:y:2008:i:91-92:p:15 is not listed on IDEAS
    22. Jaap H. Abbring & Gerard J. van den Berg, 2003. "The Nonparametric Identification of Treatment Effects in Duration Models," Econometrica, Econometric Society, vol. 71(5), pages 1491-1517, September.
    23. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    24. Paolo Frumento & Fabrizia Mealli & Barbara Pacini & Donald B. Rubin, 2012. "Evaluating the Effect of Training on Wages in the Presence of Noncompliance, Nonemployment, and Missing Outcome Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 450-466, June.
    25. Michael Lechner, 2002. "Program Heterogeneity And Propensity Score Matching: An Application To The Evaluation Of Active Labor Market Policies," The Review of Economics and Statistics, MIT Press, vol. 84(2), pages 205-220, May.
    26. Taber, Christopher R., 2000. "Semiparametric identification and heterogeneity in discrete choice dynamic programming models," Journal of Econometrics, Elsevier, vol. 96(2), pages 201-229, June.
    27. Jane Cooley Fruehwirth & Salvador Navarro & Yuya Takahashi, 2016. "How the Timing of Grade Retention Affects Outcomes: Identification and Estimation of Time-Varying Treatment Effects," Journal of Labor Economics, University of Chicago Press, vol. 34(4), pages 979-1021.
    28. David Card & Dean R. Hyslop, 2005. "Estimating the Effects of a Time-Limited Earnings Subsidy for Welfare-Leavers," Econometrica, Econometric Society, vol. 73(6), pages 1723-1770, November.
    29. Ham, John C & LaLonde, Robert J, 1996. "The Effect of Sample Selection and Initial Conditions in Duration Models: Evidence from Experimental Data on Training," Econometrica, Econometric Society, vol. 64(1), pages 175-205, January.
    30. Carlos A. Flores & Alfonso Flores-Lagunes & Arturo Gonzalez & Todd C. Neumann, 2012. "Estimating the Effects of Length of Exposure to Instruction in a Training Program: The Case of Job Corps," The Review of Economics and Statistics, MIT Press, vol. 94(1), pages 153-171, February.
    31. Ernst R. Berndt & Bronwyn H. Hall & Robert E. Hall & Jerry A. Hausman, 1974. "Estimation and Inference in Nonlinear Structural Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 3, number 4, pages 653-665, National Bureau of Economic Research, Inc.
    32. repec:mpr:mprres:6097 is not listed on IDEAS
    33. Sheena McConnell & Steven Glazerman, 2001. "National Job Corps Study: The Benefits and Costs of Job Corps," Mathematica Policy Research Reports 19ff8678a108410587c5dfad0, Mathematica Policy Research.
    34. James Heckman & Jeffrey Smith & Christopher Taber, 1998. "Accounting For Dropouts In Evaluations Of Social Programs," The Review of Economics and Statistics, MIT Press, vol. 80(1), pages 1-14, February.
    35. repec:mpr:mprres:2955 is not listed on IDEAS
    36. Heckman, James J. & Humphries, John Eric & Veramendi, Gregory, 2016. "Dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 191(2), pages 276-292.
    37. Nathaniel Hendren, 2016. "The Policy Elasticity," Tax Policy and the Economy, University of Chicago Press, vol. 30(1), pages 51-89.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chan, M. & Dalla-Zuanna, A., 2023. "Understanding Program Complementarities: Estimating the Dynamic Effects of Head Start with Multiple Alternatives," Cambridge Working Papers in Economics 2330, Faculty of Economics, University of Cambridge.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chan, M. & Dalla-Zuanna, A., 2023. "Understanding Program Complementarities: Estimating the Dynamic Effects of Head Start with Multiple Alternatives," Cambridge Working Papers in Economics 2330, Faculty of Economics, University of Cambridge.
    2. Jorge Rodríguez & Fernando Saltiel & Sergio Urzúa, 2022. "Dynamic treatment effects of job training," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 242-269, March.
    3. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    4. Jaap Abbring & James Heckman, 2008. "Dynamic policy analysis," CeMMAP working papers CWP05/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    5. German Blanco & Xuan Chen & Carlos A. Flores & Alfonso Flores-Lagunes, 2020. "Bounds on Average and Quantile Treatment Effects on Duration Outcomes Under Censoring, Selection, and Noncompliance," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(4), pages 901-920, October.
    6. Jesse Rothstein & Till von Wachter, 2016. "Social Experiments in the Labor Market," NBER Working Papers 22585, National Bureau of Economic Research, Inc.
    7. Tarek Azzam & Michael Bates & David Fairris, 2019. "Do Learning Communities Increase First Year College Retention? Testing Sample Selection and External Validity of Randomized Control Trials," Working Papers 202002, University of California at Riverside, Department of Economics.
    8. Burt S. Barnow & Jeffrey Smith, 2015. "Employment and Training Programs," NBER Chapters, in: Economics of Means-Tested Transfer Programs in the United States, Volume 2, pages 127-234, National Bureau of Economic Research, Inc.
    9. Chen, Xuan & Flores, Carlos A. & Flores-Lagunes, Alfonso, 2015. "Going Beyond LATE: Bounding Average Treatment Effects of Job Corps Training," IZA Discussion Papers 9511, Institute of Labor Economics (IZA).
    10. Fitzenberger, Bernd & Osikominu, Aderonke & Paul, Marie, 2023. "The effects of training incidence and planned training duration on labor market transitions," Journal of Econometrics, Elsevier, vol. 235(1), pages 256-279.
    11. Stephen Kastoryano & Bas van der Klaauw, 2022. "Dynamic evaluation of job search assistance," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 227-241, March.
    12. Heckman, James J. & Humphries, John Eric & Veramendi, Gregory & Urzua, Sergio, 2014. "Education, Health and Wages," IZA Discussion Papers 8027, Institute of Labor Economics (IZA).
    13. Rahul Singh & Liyuan Xu & Arthur Gretton, 2020. "Kernel Methods for Causal Functions: Dose, Heterogeneous, and Incremental Response Curves," Papers 2010.04855, arXiv.org, revised Oct 2022.
    14. Heckman, James J. & Navarro, Salvador, 2007. "Dynamic discrete choice and dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 136(2), pages 341-396, February.
    15. Lionel Cottier & Yves Flückiger & Pierre Kempeneers & Rafael Lalive, 2024. "Employment Effects of Job Search Assistance for the Long-Term Unemployed," AEA Papers and Proceedings, American Economic Association, vol. 114, pages 577-581, May.
    16. Jane Cooley Fruehwirth & Salvador Navarro & Yuya Takahashi, 2016. "How the Timing of Grade Retention Affects Outcomes: Identification and Estimation of Time-Varying Treatment Effects," Journal of Labor Economics, University of Chicago Press, vol. 34(4), pages 979-1021.
    17. Black, Dan A. & Joo, Joonhwi & LaLonde, Robert & Smith, Jeffrey A. & Taylor, Evan J., 2022. "Simple Tests for Selection: Learning More from Instrumental Variables," Labour Economics, Elsevier, vol. 79(C).
    18. David Card & Pablo Ibarrarán & Ferdinando Regalia & David Rosas-Shady & Yuri Soares, 2011. "The Labor Market Impacts of Youth Training in the Dominican Republic," Journal of Labor Economics, University of Chicago Press, vol. 29(2), pages 267-300.
    19. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    20. Flores-Lagunes, Alfonso & Gonzalez, Arturo & Neumann, Todd C., 2007. "Estimating the Effects of Length of Exposure to a Training Program: The Case of Job Corps," IZA Discussion Papers 2846, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    training; program evaluation; dynamic treatment effects; experiment;
    All these keywords.

    JEL classification:

    • J0 - Labor and Demographic Economics - - General
    • H4 - Public Economics - - Publicly Provided Goods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp12839. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.