IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v44y2020i2-3p145-184.html
   My bibliography  Save this article

Assessing the Impact of Off-the-Job and On-the-Job Training on Employment Outcomes: A Counterfactual Evaluation of the PIPOL Program

Author

Listed:
  • Francesco Pastore
  • Marco Pompili

Abstract

Background: This article studies the effect of PIPOL, an integrated program of active labor policies launched by the Friuli Venezia Giulia, an Italian region, in 2014. Objectives: To understand the impact of training in a classroom setting (off-the-job) and work-related training (on-the-job) on employment integration of benefit recipients. Research design: We adopt a counterfactual approach by comparing a target group (treated) against a control group (19,899) extracted by means of propensity score matching and Mahalanobis distance matching among subjects who, while registered in the program over the years 2014–2016, had never benefited from it. The selection of about 7,175 recipients in the program and in each type of intervention was random. Subjects: About 30,000 job seekers made up of 3,911 interns, 2,945 trainees, and 319 recipients of training and internship within PIPOL. Target: Young people, Not in Education Employment or Trainings, and over 30s. Measures: We look at different outcomes: employment tout court and employment in open-ended contracts. Results: The overall net impact of PIPOL was equal to +5 pp on average. Specifically, impact results were classroom training none, internship sizable (+14.1 pp), and training combined with an internship, quite sizable (+9.6 pp). Furthermore, training to gain a qualification was the most effective (+6.4 pp) among those receiving combined training and internship. Internship also increased the chance to find permanent employment (+3 pp). Among recipients, women, immigrants, and low-skilled recipients registered the most sizable impact on finding employment and training in manufacturing and construction was more effective than elsewhere. Conclusions: Italian young people have ever-increasing academic attainment but, due to the sequential nature of the education system, little work-related competences. This could explain the greater success of internships on classroom training.

Suggested Citation

  • Francesco Pastore & Marco Pompili, 2020. "Assessing the Impact of Off-the-Job and On-the-Job Training on Employment Outcomes: A Counterfactual Evaluation of the PIPOL Program," Evaluation Review, , vol. 44(2-3), pages 145-184, April.
    • Handle: RePEc:sae:evarev:v:44:y:2020:i:2-3:p:145-184
    DOI: 10.1177/0193841X20966112
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X20966112
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X20966112?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David Card & Jochen Kluve & Andrea Weber, 2010. "Active Labour Market Policy Evaluations: A Meta-Analysis," Economic Journal, Royal Economic Society, vol. 120(548), pages 452-477, November.
    2. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2017. "Unobservable, but unimportant? The relevance of usually unobserved variables for the evaluation of labor market policies," Labour Economics, Elsevier, vol. 46(C), pages 14-25.
    3. David Card & Jochen Kluve & Andrea Weber, 2018. "What Works? A Meta Analysis of Recent Active Labor Market Program Evaluations," Journal of the European Economic Association, European Economic Association, vol. 16(3), pages 894-931.
    4. Pastore, Francesco, 2020. "The quasi-market of employment services in Italy," Journal of Policy Modeling, Elsevier, vol. 42(6), pages 1248-1269.
    5. Luisa Donato & Maria Cristina Migliore & Samuele Poy, 2018. "Employment Effects of Vocational Training: An Evaluation Using Propensity Score Matching," Politica economica, Società editrice il Mulino, issue 3, pages 273-296.
    6. Francesco Pastore, 2015. "The Youth Experience Gap," SpringerBriefs in Economics, Springer, edition 127, number 978-3-319-10196-5, June.
    7. Francesco Pastore, 2009. "School-to-Work Transitions in Mongolia," European Journal of Comparative Economics, Cattaneo University (LIUC), vol. 6(2), pages 245-264, December.
    8. Giovanni Cerulli, 2022. "Econometric Evaluation of Socio-Economic Programs," Advanced Studies in Theoretical and Applied Econometrics, Springer, edition 2, number 978-3-662-65945-8.
    9. Pastore, Francesco, 2017. "Why so slow? The School-to-Work Transition in Italy," GLO Discussion Paper Series 65, Global Labor Organization (GLO).
    10. Cerulli-Harms, Annette, 2017. "Generation Internship: The Impact of Internships on Early Labour Market Performance," IZA Discussion Papers 11163, Institute of Labor Economics (IZA).
    11. Elena Cappellini & Marialuisa Maitino & Valentina Patacchini & Nicola Sciclone, 2019. "Are traineeships stepping-stones for youth working careers in Italy?," International Journal of Manpower, Emerald Group Publishing Limited, vol. 40(8), pages 1389-1410, September.
    12. Corinna Ghirelli & Enkelejda Havari & Giulia Santangelo & Marta Scettri, 2019. "Does on-the-job training help graduates find a job? Evidence from an Italian region," International Journal of Manpower, Emerald Group Publishing Limited, vol. 40(3), pages 500-524, February.
    13. Bryson, Alex & Dorsett, Richard & Purdon, Susan, 2002. "The use of propensity score matching in the evaluation of active labour market policies," LSE Research Online Documents on Economics 4993, London School of Economics and Political Science, LSE Library.
    14. Francesco Pastore & Claudio Quintano & Antonella Rocca, 2020. "Stuck at a crossroads? The duration of the Italian school-to-work transition," International Journal of Manpower, Emerald Group Publishing Limited, vol. 42(3), pages 442-469, September.
    15. Sianesi, Barbara, 2008. "Differential effects of active labour market programs for the unemployed," Labour Economics, Elsevier, vol. 15(3), pages 370-399, June.
    16. Martina Bazzoli & Silvia De Poli & Enrico Rettore & Antonio Schizzerotto, 2018. "Are Vocational Training Programmes Worth Their Cost? Evidence from a Cost-Benefit Analysis," Politica economica, Società editrice il Mulino, issue 3, pages 215-240.
    17. Joshua D. Angrist, 1998. "Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants," Econometrica, Econometric Society, vol. 66(2), pages 249-288, March.
    18. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    19. Bratti, Massimiliano & Ghirelli, Corinna & Havari, Enkelejda & Santangelo, Giulia, 2018. "Vocational Training for Unemployed Youth in Latvia: Evidence from a Regression Discontinuity Design," IZA Discussion Papers 11870, Institute of Labor Economics (IZA).
    20. Francesco Pastore, 2018. "Why is youth unemployment so high and different across countries?," IZA World of Labor, Institute of Labor Economics (IZA), pages 420-420, January.
    21. Silvia Duranti & Maria Luisa Maitino & Valentina Patacchini & Carla Rampichini & Nicola Sciclone, 2018. "What Training for the Unemployed? An Impact Evaluation for Targeting Training Courses," Politica economica, Società editrice il Mulino, issue 3, pages 241-272.
    22. Melvin Vooren & Carla Haelermans & Wim Groot & Henriëtte Maassen van den Brink, 2019. "The Effectiveness Of Active Labor Market Policies: A Meta‐Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 33(1), pages 125-149, February.
    23. Barbara Sianesi, 2004. "An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 133-155, February.
    24. Kluve, Jochen & Puerto, Susana & Robalino, David & Romero, Jose M. & Rother, Friederike & Stöterau, Jonathan & Weidenkaff, Felix & Witte, Marc, 2019. "Do youth employment programs improve labor market outcomes? A quantitative review," World Development, Elsevier, vol. 114(C), pages 237-253.
    25. Luca Mo Costabella, 2017. "Do high school graduates benefit from intensive vocational training?," International Journal of Manpower, Emerald Group Publishing Limited, vol. 38(5), pages 746-764, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pastore, Francesco & Pompili, Marco, 2022. "An impact assessment of ESF training courses for unemployed in the Province of Bolzano," GLO Discussion Paper Series 1042, Global Labor Organization (GLO).
    2. Giorgia Casalone & Eliana Baici, 2023. "Education, Off-the-Job Vocational Training, and Early Employment Outcomes: Evidence from Italy," Merits, MDPI, vol. 3(2), pages 1-15, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pastore, Francesco & Pompili, Marco, 2019. "Assessing the impact of off- and on-the-job training on employment outcomes. A counterfactual evaluation of the PIPOL program," GLO Discussion Paper Series 333, Global Labor Organization (GLO).
    2. Pastore, Francesco & Pompili, Marco, 2022. "An Impact Assessment of ESF Training Courses for Unemployed in the Province of Bolzano," IZA Discussion Papers 15066, Institute of Labor Economics (IZA).
    3. Doruk, Ömer Tuğsal & Pastore, Francesco, 2020. "School to Work Transition and Macroeconomic Conditions in the Turkish Economy," GLO Discussion Paper Series 730, Global Labor Organization (GLO).
    4. Francesco Pastore & Claudio Quintano & Antonella Rocca, 2020. "Stuck at a crossroads? The duration of the Italian school-to-work transition," International Journal of Manpower, Emerald Group Publishing Limited, vol. 42(3), pages 442-469, September.
    5. Karol Madoń & Iga Magda & Marta Palczyńska & Mateusz Smoter, 2024. "What Works for Whom? Youth Labour Market Policy in Poland," Gospodarka Narodowa. The Polish Journal of Economics, Warsaw School of Economics, issue 2, pages 1-34.
    6. Fitzenberger, Bernd & Furdas, Marina & Sajons, Christoph, 2016. "End-of-year spending and the long-run employment effects of training programs for the unemployed," Freiburg Discussion Papers on Constitutional Economics 16/08, Walter Eucken Institut e.V..
    7. Corinna Ghirelli & Enkelejda Havari & Giulia Santangelo & Marta Scettri, 2019. "Does on-the-job training help graduates find a job? Evidence from an Italian region," International Journal of Manpower, Emerald Group Publishing Limited, vol. 40(3), pages 500-524, February.
    8. Cerqua, Augusto & Urwin, Peter & Thomson, Dave & Bibby, David, 2020. "Evaluation of education and training impacts for the unemployed: Challenges of new data," Labour Economics, Elsevier, vol. 67(C).
    9. Mörk, Eva & Ottosson, Lillit & Vikman, Ulrika, 2021. "To work or not to work? Effects of temporary public employment on future employment and benefits," Working Paper Series 2021:12, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    10. Christine Dauth & Julia Lang, 2019. "Can the unemployed be trained to care for the elderly? The effects of subsidized training in elderly care," Health Economics, John Wiley & Sons, Ltd., vol. 28(4), pages 543-555, April.
    11. Dauth, Christine & Lang, Julia, 2017. "Should the unemployed care for the elderly? : The effect of subsidized occupational and further training in elderly care," IAB-Discussion Paper 201713, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    12. Lang, Julia & Dauth, Christine, 2017. "Should the unemployed care for the elderly? The effect of subsidized occupational and further training in geriatric care," VfS Annual Conference 2017 (Vienna): Alternative Structures for Money and Banking 168130, Verein für Socialpolitik / German Economic Association.
    13. Aina, Carmen & Brunetti, Irene & Mussida, Chiara & Scicchitano, Sergio, 2021. "Even more discouraged? The NEET generation at the age of COVID-19," GLO Discussion Paper Series 863, Global Labor Organization (GLO).
    14. Canzian, Giulia & Meroni, Elena Claudia & Santangelo, Giulia, 2023. "Evaluation of a Flemish Active Labour Market Policy in the framework of the European Social Fund. Results and challenges," Socio-Economic Planning Sciences, Elsevier, vol. 88(C).
    15. Miroslav Štefánik & Lukáš Lafférs, 2024. "Supporting the right workplace experience: a dynamic evaluation of three activation programmes for young job seekers in Slovakia," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 58(1), pages 1-22, December.
    16. José María Arranz & Carlos García-Serrano, 2024. "You’ll never seek alone: The impact of active labour market policies on finding a job," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 58(1), pages 1-19, December.
    17. Daniel Goller & Tamara Harrer & Michael Lechner & Joachim Wolff, 2021. "Active labour market policies for the long-term unemployed: New evidence from causal machine learning," Papers 2106.10141, arXiv.org, revised May 2023.
    18. Maria Laura Alzúa & Soyolmaa Batbekh & Altantsetseg Batchuluun & Bayarmaa Dalkhjavd & José Galdo, 2019. "Living with the Neighbors: Demand-Driven Youth Training Programs: Experimental Evidence from Mongolia," CEDLAS, Working Papers 0249, CEDLAS, Universidad Nacional de La Plata.
    19. Dauth, Christine, 2017. "Regional discontinuities and the effectiveness of further training subsidies for low-skilled employees," IAB-Discussion Paper 201707, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    20. Maria Laura Alzúa & Soyolmaa Batbekh & Altantsetseg Batchuluun & Bayarmaa Dalkhjav & José Galdo, 2021. "Demand-Driven Youth Training Programs: Experimental Evidence from Mongolia," The World Bank Economic Review, World Bank, vol. 35(3), pages 720-744.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:44:y:2020:i:2-3:p:145-184. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.