IDEAS home Printed from https://ideas.repec.org/a/spr/jlabre/v42y2021i3d10.1007_s12122-021-09322-x.html
   My bibliography  Save this article

Give it Another Try: What are the Effects of a Job Creation Scheme Especially Designed for Hard-to-Place Workers?

Author

Listed:
  • Tobias Brändle

    (Institute for Applied Economic Research (IAW))

  • Lukas Fervers

    (University of Cologne, German Institute for Adult Education (DIE) and Institute for Applied Economic Research (IAW))

Abstract

Previous evaluations of job creation schemes (JCS) reveal mostly negative employment effects, mainly due to inherent lock-in effects. In this paper, we assess the impact of an innovative JCS that employs a pre-selection mechanism to target programme participation on unemployed job seekers with very low integration chances, hereby reducing possible lock-in effects. Relying on high-quality administrative as well as survey data, we conduct regression-adjusted matching analyses to estimate the programme effect on integration into regular employment. Our results show that the programme did not succeed to foster labour market integration, but still entails remarkably negative employment effects in the first years after participation. We argue that this results from a principal-agent problem at the last step of the selection mechanism that may have led to cream-skimming rather than targeting on very hard to place workers. However, supplementary analyses reveal that negative effects can be avoided for subgroups with very poor employment chances in case of non-participation. These results are robust to the use of different matching estimators and definitions of non-participation. The inclusion of usually unobservable survey variables as well as placebo tests based on past employment outcomes refute concerns about endogenous selection. From a policy-perspective, these findings imply that targeting JCS on workers with very low integration chances is a key factor to avoid negative employment effects found in previous evaluations. At the methodological level, our analyses add to recent literature that assesses the credibility of non-experimental evaluations based on high-quality administrative data.

Suggested Citation

  • Tobias Brändle & Lukas Fervers, 2021. "Give it Another Try: What are the Effects of a Job Creation Scheme Especially Designed for Hard-to-Place Workers?," Journal of Labor Research, Springer, vol. 42(3), pages 382-417, December.
  • Handle: RePEc:spr:jlabre:v:42:y:2021:i:3:d:10.1007_s12122-021-09322-x
    DOI: 10.1007/s12122-021-09322-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s12122-021-09322-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s12122-021-09322-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jacob Nielsen Arendt & Christophe Kolodziejczyk, 2019. "The Effects of an Employment Bonus for Long-Term Social Assistance Recipients," Journal of Labor Research, Springer, vol. 40(4), pages 412-427, December.
    2. Daniel L. Millimet & Rusty Tchernis, 2013. "Estimation Of Treatment Effects Without An Exclusion Restriction: With An Application To The Analysis Of The School Breakfast Program," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(6), pages 982-1017, September.
    3. Martin Biewen & Bernd Fitzenberger & Aderonke Osikominu & Marie Paul, 2014. "The Effectiveness of Public-Sponsored Training Revisited: The Importance of Data and Methodological Choices," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 837-897.
    4. Hainmueller, Jens, 2012. "Entropy Balancing for Causal Effects: A Multivariate Reweighting Method to Produce Balanced Samples in Observational Studies," Political Analysis, Cambridge University Press, vol. 20(1), pages 25-46, January.
    5. K. Dengler, 2015. "Effectiveness of sequences of One-Euro-Jobs for welfare recipients in Germany," Applied Economics, Taylor & Francis Journals, vol. 47(57), pages 6170-6190, December.
    6. repec:hal:pseose:halshs-00840901 is not listed on IDEAS
    7. Patrick Arni & Rafael Lalive & Jan C. Van Ours, 2013. "How Effective Are Unemployment Benefit Sanctions? Looking Beyond Unemployment Exit," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(7), pages 1153-1178, November.
    8. Markus Frlich, 2004. "Finite-Sample Properties of Propensity-Score Matching and Weighting Estimators," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 77-90, February.
    9. Bruno Crépon & Esther Duflo & Marc Gurgand & Roland Rathelot & Philippe Zamora, 2013. "Do Labor Market Policies have Displacement Effects? Evidence from a Clustered Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(2), pages 531-580.
    10. Michael Gerfin & Michael Lechner, 2002. "A Microeconometric Evaluation of the Active Labour Market Policy in Switzerland," Economic Journal, Royal Economic Society, vol. 112(482), pages 854-893, October.
    11. Kluve, Jochen, 2010. "The effectiveness of European active labor market programs," Labour Economics, Elsevier, vol. 17(6), pages 904-918, December.
    12. David Card & Jochen Kluve & Andrea Weber, 2010. "Active Labour Market Policy Evaluations: A Meta-Analysis," Economic Journal, Royal Economic Society, vol. 120(548), pages 452-477, November.
    13. Lutz Bellmann & Marco Caliendo & Stefan Tübbicke, 2018. "The Post‐Reform Effectiveness of the New German Start‐Up Subsidy for the Unemployed," LABOUR, CEIS, vol. 32(3), pages 293-319, September.
    14. K. Hohmeyer, 2012. "Effectiveness of One-Euro-Jobs: do programme characteristics matter?," Applied Economics, Taylor & Francis Journals, vol. 44(34), pages 4469-4484, December.
    15. Ian McCarthy & Daniel Millimet & Rusty Tchernis, 2014. "The bmte command: Methods for the estimation of treatment effects when exclusion restrictions are unavailable," Stata Journal, StataCorp LP, vol. 14(3), pages 670-683, September.
    16. David Card & Jochen Kluve & Andrea Weber, 2018. "What Works? A Meta Analysis of Recent Active Labor Market Program Evaluations," Journal of the European Economic Association, European Economic Association, vol. 16(3), pages 894-931.
    17. Abadie, Alberto & Imbens, Guido W., 2011. "Bias-Corrected Matching Estimators for Average Treatment Effects," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 1-11.
    18. Michael Lechner & Conny Wunsch, 2009. "Active labour market policy in East Germany," The Economics of Transition, The European Bank for Reconstruction and Development, vol. 17(4), pages 661-702, October.
    19. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    20. Carling, Kenneth & Richardson, Katarina, 2004. "The relative efficiency of labor market programs: Swedish experience from the 1990s," Labour Economics, Elsevier, vol. 11(3), pages 335-354, June.
    21. repec:iab:iabfme:201009(en is not listed on IDEAS
    22. Heckman, J.J. & Hotz, V.J., 1988. "Choosing Among Alternative Nonexperimental Methods For Estimating The Impact Of Social Programs: The Case Of Manpower Training," University of Chicago - Economics Research Center 88-12, Chicago - Economics Research Center.
    23. Caliendo Marco & Hujer Reinhard & Thomsen Stephan L., 2006. "Sectoral Heterogeneity in the Employment Effects of Job Creation Schemes in Germany," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 226(2), pages 139-179, April.
    24. repec:iab:iabfda:201001(en is not listed on IDEAS
    25. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2017. "Unobservable, but unimportant? The relevance of usually unobserved variables for the evaluation of labor market policies," Labour Economics, Elsevier, vol. 46(C), pages 14-25.
    26. Alessio Brown & Johannes Koettl, 2015. "Active labor market programs - employment gain or fiscal drain?," IZA Journal of Labor Economics, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 4(1), pages 1-36, December.
    27. Mosthaf, Alexander & Schank, Thorsten & Schwarz, Stefan, 2021. "Do Supplementary Jobs for Welfare Recipients Increase the Chance of Welfare Exit? Evidence from Germany," IZA Discussion Papers 14268, Institute of Labor Economics (IZA).
    28. Alexander Spermann, 2015. "How to fight long-term unemployment: lessons from Germany," IZA Journal of Labor Policy, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 4(1), pages 1-15, December.
    29. Michael Lechner, 1999. "Nonparametric bounds on employment and income effects of continuous vocational training in East Germany," Econometrics Journal, Royal Economic Society, vol. 2(1), pages 1-28.
    30. Marco Caliendo & Reinhard Hujer & Stephan Thomsen, 2008. "Identifying effect heterogeneity to improve the efficiency of job creation schemes in Germany," Applied Economics, Taylor & Francis Journals, vol. 40(9), pages 1101-1122.
    31. Lechner, Michael, 1999. "Earnings and Employment Effects of Continuous Off-the-Job Training in East Germany after Unification," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(1), pages 74-90, January.
    32. Joachim Wolff & Gesine Stephan, 2013. "Subsidized work before and after the German Hartz reforms: design of major schemes, evaluation results and lessons learnt," IZA Journal of Labor Policy, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 2(1), pages 1-24, December.
    33. John Martin, 2015. "Activation and active labour market policies in OECD countries: stylised facts and evidence on their effectiveness," IZA Journal of Labor Policy, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 4(1), pages 1-29, December.
    34. Marco Caliendo & Jens Hogenacker, 2012. "The German labor market after the Great Recession: successful reforms and future challenges," IZA Journal of European Labor Studies, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 1(1), pages 1-24, December.
    35. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The performance of estimators based on the propensity score," Journal of Econometrics, Elsevier, vol. 175(1), pages 1-21.
    36. Stephan L. Thomsen & Thomas Walter, 2010. "Temporary Extra Jobs for Immigrants: Merging Lane to Employment or Dead‐End Road in Welfare?," LABOUR, CEIS, vol. 24(s1), pages 114-140, December.
    37. Ulf Rinne & Klaus Zimmermann, 2012. "Another economic miracle? The German labor market and the Great Recession," IZA Journal of Labor Policy, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 1(1), pages 1-21, December.
    38. Martin Huber & Michael Lechner & Andreas Steinmayr, 2015. "Radius matching on the propensity score with bias adjustment: tuning parameters and finite sample behaviour," Empirical Economics, Springer, vol. 49(1), pages 1-31, August.
    39. Markus Frölich & Almas Heshmati & Michael Lechner, 2004. "A microeconometric evaluation of rehabilitation of long-term sickness in Sweden," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 19(3), pages 375-396.
    40. Stephen DeLoach & Mark Kurt, 2013. "Discouraging Workers: Estimating the Impacts of Macroeconomic Shocks on the Search Intensity of the Unemployed," Journal of Labor Research, Springer, vol. 34(4), pages 433-454, December.
    41. Lukas Fervers, 2016. "Fast track to the labour market or highway to hell? The effect of activation policies on quantity and quality of labour market integration," IAW Discussion Papers 125, Institut für Angewandte Wirtschaftsforschung (IAW).
    42. Caliendo, Marco & Hujer, Reinhard & Thomsen, Stephan L., 2004. "Evaluation der Eingliederungseffekte von Arbeitsbeschaffungsmaßnahmen in reguläre Beschäftigung für Teilnehmer in Deutschland," ZEW Discussion Papers 04-46, ZEW - Leibniz Centre for European Economic Research.
    43. Busso, Matias & DiNardo, John & McCrary, Justin, 2009. "New Evidence on the Finite Sample Properties of Propensity Score Matching and Reweighting Estimators," IZA Discussion Papers 3998, Institute of Labor Economics (IZA).
    44. Huber Martin & Lechner Michael & Wunsch Conny & Walter Thomas, 2011. "Do German Welfare-to-Work Programmes Reduce Welfare Dependency and Increase Employment?," German Economic Review, De Gruyter, vol. 12(2), pages 182-204, May.
    45. Matthias Dorner & Jörg Heining & Peter Jacobebbinghaus & Stefan Seth, 2010. "The Sample of Integrated Labour Market Biographies," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 130(4), pages 599-608.
    46. Gerd Heyer & Susanne Koch & Gesine Stephan & Joachim Wolff, 2012. "Evaluation der aktiven Arbeitsmarktpolitik: Ein Sachstandsbericht für die Instrumentenreform 2011," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 45(1), pages 41-62, March.
    47. repec:taf:applec:44:y:2012:i:34:p:4469-4484 is not listed on IDEAS
    48. Dorner, Matthias & Heining, Jörg & Jacobebbinghaus, Peter & Seth, Stefan, 2010. "Sample of Integrated Labour Market Biographies (SIAB) 1975-2008," FDZ Methodenreport 201009_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    49. Hujer, Reinhard & Thomsen, Stephan L., 2010. "How do the employment effects of job creation schemes differ with respect to the foregoing unemployment duration?," Labour Economics, Elsevier, vol. 17(1), pages 38-51, January.
    50. Sianesi, Barbara, 2008. "Differential effects of active labour market programs for the unemployed," Labour Economics, Elsevier, vol. 15(3), pages 370-399, June.
    51. Nisar Ahmad & Michael Svarer & Amjad Naveed, 2019. "The Effect of Active Labour Market Programmes and Benefit Sanctions on Reducing Unemployment Duration," Journal of Labor Research, Springer, vol. 40(2), pages 202-229, June.
    52. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, October.
    53. Dorner, Matthias & Heining, Jörg & Jacobebbinghaus, Peter & Seth, Stefan, 2010. "Sample of Integrated Labour Market Biographies (SIAB) 1975-2008," FDZ Datenreport. Documentation on Labour Market Data 201001_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    54. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    55. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2014. "Unobservable, but Unimportant? The Influence of Personality Traits (and Other Usually Unobserved Variables) for the Evaluation of Labor Market Policies," IZA Discussion Papers 8337, Institute of Labor Economics (IZA).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rainer Eppel & Ulrike Huemer & Helmut Mahringer & Lukas Schmoigl, 2024. "Active Labour Market Policies: What Works for the Long-term Unemployed?," WIFO Working Papers 671, WIFO.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tobias Brändle & Lukas Fervers, 2017. "Give it Another Try: What are the Effects of a Public Employment Scheme Especially Designed for Hard-to-Place Workers?," IAW Discussion Papers 129, Institut für Angewandte Wirtschaftsforschung (IAW).
    2. Joachim Wolff & Gesine Stephan, 2013. "Subsidized work before and after the German Hartz reforms: design of major schemes, evaluation results and lessons learnt," IZA Journal of Labor Policy, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 2(1), pages 1-24, December.
    3. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The performance of estimators based on the propensity score," Journal of Econometrics, Elsevier, vol. 175(1), pages 1-21.
    4. Katharina Dengler, 2019. "Effectiveness of sequences of classroom training for welfare recipients: what works best in West Germany?," Applied Economics, Taylor & Francis Journals, vol. 51(1), pages 1-46, January.
    5. Cerqua, Augusto & Urwin, Peter & Thomson, Dave & Bibby, David, 2020. "Evaluation of education and training impacts for the unemployed: Challenges of new data," Labour Economics, Elsevier, vol. 67(C).
    6. Lukas Fervers, 2016. "Fast track to the labour market or highway to hell? The effect of activation policies on quantity and quality of labour market integration," IAW Discussion Papers 125, Institut für Angewandte Wirtschaftsforschung (IAW).
    7. Mörk, Eva & Ottosson, Lillit & Vikman, Ulrika, 2021. "To work or not to work? Effects of temporary public employment on future employment and benefits," Working Paper Series 2021:12, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    8. Michael C. Knaus & Michael Lechner & Anthony Strittmatter, 2022. "Heterogeneous Employment Effects of Job Search Programs: A Machine Learning Approach," Journal of Human Resources, University of Wisconsin Press, vol. 57(2), pages 597-636.
    9. Martin Biewen & Bernd Fitzenberger & Aderonke Osikominu & Marie Paul, 2014. "The Effectiveness of Public-Sponsored Training Revisited: The Importance of Data and Methodological Choices," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 837-897.
    10. N. N., 2017. "WIFO-Monatsberichte, Heft 6/2017," WIFO Monatsberichte (monthly reports), WIFO, vol. 90(6), June.
    11. Hagen, Tobias, 2016. "Econometric Evaluation of a Placement Coaching Program for Recipients of Disability Insurance Benefits in Switzerland," VfS Annual Conference 2016 (Augsburg): Demographic Change 145736, Verein für Socialpolitik / German Economic Association.
    12. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2010. "How to Control for Many Covariates? Reliable Estimators Based on the Propensity Score," IZA Discussion Papers 5268, Institute of Labor Economics (IZA).
    13. Hagen, Tobias, 2016. "Econometric evaluation of a placement coaching program for recipients of disability insurance benefits in Switzerland," Working Paper Series 10, Frankfurt University of Applied Sciences, Faculty of Business and Law.
    14. Thomas Kruppe & Julia Lang, 2018. "Labour market effects of retraining for the unemployed: the role of occupations," Applied Economics, Taylor & Francis Journals, vol. 50(14), pages 1578-1600, March.
    15. Christine Dauth & Julia Lang, 2019. "Can the unemployed be trained to care for the elderly? The effects of subsidized training in elderly care," Health Economics, John Wiley & Sons, Ltd., vol. 28(4), pages 543-555, April.
    16. Dauth, Christine & Lang, Julia, 2017. "Should the unemployed care for the elderly? : The effect of subsidized occupational and further training in elderly care," IAB-Discussion Paper 201713, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    17. Lang, Julia & Dauth, Christine, 2017. "Should the unemployed care for the elderly? The effect of subsidized occupational and further training in geriatric care," VfS Annual Conference 2017 (Vienna): Alternative Structures for Money and Banking 168130, Verein für Socialpolitik / German Economic Association.
    18. Rainer Eppel & Helmut Mahringer & Petra Sauer, 2017. "Österreich 2025 – Arbeitslosigkeit und die Rolle der aktiven Arbeitsmarktpolitik," WIFO Monatsberichte (monthly reports), WIFO, vol. 90(6), pages 493-505, June.
    19. Cockx, Bart & Lechner, Michael & Bollens, Joost, 2023. "Priority to unemployed immigrants? A causal machine learning evaluation of training in Belgium," Labour Economics, Elsevier, vol. 80(C).
    20. Goller, Daniel & Lechner, Michael & Moczall, Andreas & Wolff, Joachim, 2020. "Does the estimation of the propensity score by machine learning improve matching estimation? The case of Germany's programmes for long term unemployed," Labour Economics, Elsevier, vol. 65(C).

    More about this item

    JEL classification:

    • J18 - Labor and Demographic Economics - - Demographic Economics - - - Public Policy
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • J68 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Public Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jlabre:v:42:y:2021:i:3:d:10.1007_s12122-021-09322-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.