IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp3767.html
   My bibliography  Save this paper

The Relative Effectiveness of Selected Active Labour Market Programmes and the Common Support Problem

Author

Listed:
  • Stephan, Gesine

    (Institute for Employment Research (IAB), Nuremberg)

  • Pahnke, André

    (IfM Bonn)

Abstract

For Germany, we analyse the (relative) effects of participation in several active labour market programmes on the employment prospects of participants. First, our results show that different matching algorithms result in different severe problems of common support. Second, we obtain favourable effects of participation in training programmes, which is not true for job creation schemes. Third, while lock-in effects are smaller for shorter programmes, long retraining shows mainly positive effects compared to shorter training at the end of the observation period. Fourth, participants in job creation schemes are too different from participants in training programmes to conduct a reliable comparison.

Suggested Citation

  • Stephan, Gesine & Pahnke, André, 2008. "The Relative Effectiveness of Selected Active Labour Market Programmes and the Common Support Problem," IZA Discussion Papers 3767, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp3767
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp3767.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Michael Lechner, 2002. "Program Heterogeneity And Propensity Score Matching: An Application To The Evaluation Of Active Labor Market Policies," The Review of Economics and Statistics, MIT Press, vol. 84(2), pages 205-220, May.
    2. Jaap H. Abbring & Gerard J. van den Berg, 2004. "Analyzing the effect of dynamically assigned treatments using duration models, binary treatment models, and panel data models," Empirical Economics, Springer, vol. 29(1), pages 5-20, January.
    3. Marco Caliendo & Reinhard Hujer & Stephan Thomsen, 2008. "Identifying effect heterogeneity to improve the efficiency of job creation schemes in Germany," Applied Economics, Taylor & Francis Journals, vol. 40(9), pages 1101-1122.
    4. Marco Caliendo & Reinhard Hujer, 2006. "The microeconometric estimation of treatment effects—An overview," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 90(1), pages 199-215, March.
    5. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    6. Michael Lechner & Ruth Miquel & Conny Wunsch, 2011. "Long‐Run Effects Of Public Sector Sponsored Training In West Germany," Journal of the European Economic Association, European Economic Association, vol. 9(4), pages 742-784, August.
    7. Kluve, Jochen & Schneider, Hilmar & Uhlendorff, Arne & Zhao, Zhong, 2007. "Evaluating Continuous Training Programs Using the Generalized Propensity Score," IZA Discussion Papers 3255, Institute of Labor Economics (IZA).
    8. Bernd Fitzenberger & Aderonke Osikominu & Robert Völter, 2008. "Get Training or Wait? Long-Run Employment Effects of Training Programs for the Unemployed in West Germany," Annals of Economics and Statistics, GENES, issue 91-92, pages 321-355.
    9. Black, Dan A. & Smith, J.A.Jeffrey A., 2004. "How robust is the evidence on the effects of college quality? Evidence from matching," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 99-124.
    10. Lechner, Michael, 1999. "Identification and Estimation of Causal Effects of Multiple Treatments Under the Conditional Independence Assumption," IZA Discussion Papers 91, Institute of Labor Economics (IZA).
    11. Hujer, Reinhard & Thomsen, Stephan L. & Zeiss, Christopher, 2006. "The effects of short-term training measures on the individual unemployment duration in West Germany," ZEW Discussion Papers 06-065, ZEW - Leibniz Centre for European Economic Research.
    12. Michael Gerfin & Michael Lechner, 2002. "A Microeconometric Evaluation of the Active Labour Market Policy in Switzerland," Economic Journal, Royal Economic Society, vol. 112(482), pages 854-893, October.
    13. Ulf Rinne & Marc Schneider & Arne Uhlendorff, 2011. "Do the skilled and prime-aged unemployed benefit more from training? Effect heterogeneity of public training programmes in Germany," Applied Economics, Taylor & Francis Journals, vol. 43(25), pages 3465-3494.
    14. Bernhard, Sarah & Hohmeyer, Katrin & Jozwiak, Eva & Koch, Susanne & Kruppe, Thomas & Stephan, Gesine & Wolff, Joachim, 2008. "Aktive Arbeitsmarktpolitik in Deutschland und ihre Wirkungen," IAB-Forschungsbericht 200802, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    15. Reinhard Hujer & Stephan Thomsen & Christopher Zeiss, 2006. "The effects of vocational training programmes on the duration of unemployment in Eastern Germany," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 90(2), pages 299-321, June.
    16. Lechner Michael & Miquel Ruth & Wunsch Conny, 2007. "The Curse and Blessing of Training the Unemployed in a Changing Economy: The Case of East Germany After Unification," German Economic Review, De Gruyter, vol. 8(4), pages 468-509, December.
    17. repec:diw:diwwpp:dp485 is not listed on IDEAS
    18. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
    19. Stephan Gesine, 2008. "The Effects of Active Labor Market Programs in Germany: An Investigation Using Different Definitions of Non-Treatment," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 228(5-6), pages 586-611, October.
    20. Hujer, Reinhard & Zeiss, Christopher, 2006. "The effects of job creation schemes on the unemployment duration in East Germany," IAB-Discussion Paper 200616, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    21. Barbara Sianesi, 2004. "An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 133-155, February.
    22. Biewen, Martin & Fitzenberger, Bernd & Osikominu, Aderonke & Waller, Marie, 2007. "Which Program for Whom? Evidence on the Comparative Effectiveness of Public Sponsored Training Programs in Germany," IZA Discussion Papers 2885, Institute of Labor Economics (IZA).
    23. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    24. Hohmeyer, Katrin & Wolff, Joachim, 2007. "A fistful of Euros: Does One-Euro-Job participation lead means-tested benefit recipients into regular jobs and out of unemployment benefit II receipt?," IAB-Discussion Paper 200732, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    25. Jeffrey Smith, 2000. "A Critical Survey of Empirical Methods for Evaluating Active Labor Market Policies," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 136(III), pages 247-268, September.
    26. Edwin Leuven & Barbara Sianesi, 2003. "PSMATCH2: Stata module to perform full Mahalanobis and propensity score matching, common support graphing, and covariate imbalance testing," Statistical Software Components S432001, Boston College Department of Economics, revised 01 Feb 2018.
    27. Caliendo Marco & Hujer Reinhard & Thomsen Stephan L., 2006. "Sectoral Heterogeneity in the Employment Effects of Job Creation Schemes in Germany," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 226(2), pages 139-179, April.
    28. Fredriksson, Peter & Johansson, Per, 2004. "Dynamic Treatment Assignment – The Consequences for Evaluations Using Observational Data," IZA Discussion Papers 1062, Institute of Labor Economics (IZA).
    29. Fitzenberger, Bernd & Volter, Robert, 2007. "Long-run effects of training programs for the unemployed in East Germany," Labour Economics, Elsevier, vol. 14(4), pages 730-755, August.
    30. Wolff, Joachim & Jozwiak, Eva, 2007. "Does short-term training activate means-tested unemployment benefit recipients in Germany?," IAB-Discussion Paper 200729, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    31. Guido W. Imbens, 1999. "The Role of the Propensity Score in Estimating Dose-Response Functions," NBER Technical Working Papers 0237, National Bureau of Economic Research, Inc.
    32. Barbara Sianesi, 2001. "Propensity score matching," United Kingdom Stata Users' Group Meetings 2001 12, Stata Users Group, revised 23 Aug 2001.
    33. Hujer, Reinhard & Thomsen, Stephan L., 2010. "How do the employment effects of job creation schemes differ with respect to the foregoing unemployment duration?," Labour Economics, Elsevier, vol. 17(1), pages 38-51, January.
    34. Sianesi, Barbara, 2008. "Differential effects of active labour market programs for the unemployed," Labour Economics, Elsevier, vol. 15(3), pages 370-399, June.
    35. repec:bla:germec:v:8:y:2007:i::p:468-509 is not listed on IDEAS
    36. Jochen Kluve & Hilmar Schneider & Arne Uhlendorff & Zhong Zhao, 2012. "Evaluating continuous training programmes by using the generalized propensity score," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(2), pages 587-617, April.
    37. Jaap H. Abbring & Gerard J. van den Berg, 2003. "The Nonparametric Identification of Treatment Effects in Duration Models," Econometrica, Econometric Society, vol. 71(5), pages 1491-1517, September.
    38. Jochen Kluve & Hilmar Schneider & Arne Uhlendorff & Zhong Zhao, 2012. "Evaluating continuous training programmes by using the generalized propensity score," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(2), pages 587-617, April.
    39. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    40. Kruppe, Thomas, 2008. "Selektivität bei der Einlösung von Bildungsgutscheinen," IAB-Discussion Paper 200817, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    41. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Thomas Kruppe & Julia Lang, 2018. "Labour market effects of retraining for the unemployed: the role of occupations," Applied Economics, Taylor & Francis Journals, vol. 50(14), pages 1578-1600, March.
    2. Pavel Stafek & Petra Sanova & Zuzana Novotna & Adriana Laputkova, 2016. "Effectiveness of Retraining as an Instrument for Solving the Problem of Structural Unemployment in the Czech Republic," International Journal of Economics and Financial Issues, Econjournals, vol. 6(3), pages 926-932.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stephan Gesine, 2008. "The Effects of Active Labor Market Programs in Germany: An Investigation Using Different Definitions of Non-Treatment," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 228(5-6), pages 586-611, October.
    2. Gerd Heyer & Susanne Koch & Gesine Stephan & Joachim Wolff, 2012. "Evaluation der aktiven Arbeitsmarktpolitik: Ein Sachstandsbericht für die Instrumentenreform 2011 [Evaluation of active labor market programs: a summary of recent results for the German program ref," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 45(1), pages 41-62, March.
    3. Heyer, Gerd & Koch, Susanne & Stephan, Gesine & Wolff, Joachim, 2012. "Evaluation der aktiven Arbeitsmarktpolitik: Ein Sachstandsbericht für die Instrumentenreform 2011 (Evaluation of active labor market programs : a summary of recent results for the German program refor," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 45(1), pages 41-62.
    4. Stephan, Gesine & Zickert, Kathi, 2008. "Participation of unemployment benefit recipients in active labor market programs : before and after the German labor market reforms," IAB-Discussion Paper 200815, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    5. Ulf Rinne & Arne Uhlendorff & Zhong Zhao, 2013. "Vouchers and caseworkers in training programs for the unemployed," Empirical Economics, Springer, vol. 45(3), pages 1089-1127, December.
    6. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    7. Biewen, Martin & Fitzenberger, Bernd & Osikominu, Aderonke & Waller, Marie, 2007. "Which Program for Whom? Evidence on the Comparative Effectiveness of Public Sponsored Training Programs in Germany," IZA Discussion Papers 2885, Institute of Labor Economics (IZA).
    8. Sarah Bernhard & Thomas Kruppe, 2012. "Effectiveness of Further Vocational Training in Germany – Empirical Findings for Persons Receiving Means-tested Unemployment Benefits," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 132(4), pages 501-526.
    9. Brück-Klingberg, Andrea & Burkert, Carola & Garloff, Alfred & Seibert, Holger & Wapler, Rüdiger, 2011. "Does higher education help immigrants find a job? : A survival analysis," IAB-Discussion Paper 201106, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    10. Lechner, Michael & Wunsch, Conny & Huber, Martin & Walter, Thomas, 2009. "Do German Welfare-to-Work Programmes Reduce Welfare and Increase Work?," CEPR Discussion Papers 7238, C.E.P.R. Discussion Papers.
    11. Conny Wunsch & Michael Lechner, 2008. "What Did All the Money Do? On the General Ineffectiveness of Recent West German Labour Market Programmes," Kyklos, Wiley Blackwell, vol. 61(1), pages 134-174, February.
    12. Martin Biewen & Bernd Fitzenberger & Aderonke Osikominu & Marie Paul, 2014. "The Effectiveness of Public-Sponsored Training Revisited: The Importance of Data and Methodological Choices," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 837-897.
    13. Carlos A. Flores & Oscar A. Mitnik, 2009. "Evaluating Nonexperimental Estimators for Multiple Treatments: Evidence from Experimental Data," Working Papers 2010-10, University of Miami, Department of Economics.
    14. Doerr, Annabelle & Strittmatter, Anthony, 2014. "Assignment Mechanisms, Selection Criteria, and the Effectiveness of Training Programs," Economics Working Paper Series 1421, University of St. Gallen, School of Economics and Political Science, revised May 2017.
    15. Stephan, Gesine & Rässler, Susanne & Schewe, Torben, 2006. "Das TrEffeR-Projekt der Bundesagentur für Arbeit : die Wirkung von Maßnahmen aktiver Arbeitsmarktpolitik (The TrEffeR project of the Federal Employment Agency : the effect of active labour market poli," Zeitschrift für ArbeitsmarktForschung - Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 39(3/4), pages 447-465.
    16. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2017. "Unobservable, but unimportant? The relevance of usually unobserved variables for the evaluation of labor market policies," Labour Economics, Elsevier, vol. 46(C), pages 14-25.
    17. Kluve, Jochen & Lehmann, Hartmut & Schmidt, Christoph M., 2008. "Disentangling Treatment Effects of Active Labor Market Policies: The Role of Labor Force Status Sequences," Labour Economics, Elsevier, vol. 15(6), pages 1270-1295, December.
    18. Fitzenberger, Bernd & Volter, Robert, 2007. "Long-run effects of training programs for the unemployed in East Germany," Labour Economics, Elsevier, vol. 14(4), pages 730-755, August.
    19. Wolff, Joachim & Hohmeyer, Katrin, 2011. "Direct job creation revisited: Is it effective for welfare recipients and does it matter whether participants receive a wage?," VfS Annual Conference 2011 (Frankfurt, Main): The Order of the World Economy - Lessons from the Crisis 48722, Verein für Socialpolitik / German Economic Association.
    20. Bernhard, Sarah & Gartner, Hermann & Stephan, Gesine, 2008. "Wage Subsidies for Needy Job-Seekers and Their Effect on Individual Labour Market Outcomes after the German Reforms," IZA Discussion Papers 3772, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    evaluation of active labour market programmes; propensity score matching; common support problem;
    All these keywords.

    JEL classification:

    • J68 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Public Policy
    • J64 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Unemployment: Models, Duration, Incidence, and Job Search
    • J65 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Unemployment Insurance; Severance Pay; Plant Closings

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp3767. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.