IDEAS home Printed from https://ideas.repec.org/a/jae/japmet/v23y2008i3p305-327.html
   My bibliography  Save this article

From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity?

Author

Listed:
  • Andrea Ichino

    (Department of Economics, University of Bologna, Bologna, Italy)

  • Fabrizia Mealli

    (Department of Statistics, University of Florence, Florence, Italy)

  • Tommaso Nannicini

    (Department of Economics, Universidad Carlos III de Madrid, Madrid, Spain)

Abstract

The diffusion of temporary work agency (TWA) jobs has led to a harsh policy debate and ambiguous empirical evidence. Results for the USA, based on quasi-experimental evidence, suggest that a TWA assignment decreases the probability of finding a stable job, while results for Europe, based on the conditional independence assumption (CIA), typically reach opposite conclusions. Using data for two Italian regions, we rely on a matching estimator to show that TWA assignments can be an effective springboard to permanent employment. We also propose a simulation-based sensitivity analysis, which highlights that only for one of these two regions are our results robust to specific failures of the CIA. We conclude that European studies based on the CIA should not be automatically discarded, but should be put under the scrutiny of a sensitivity analysis like the one we propose. Copyright © 2008 John Wiley & Sons, Ltd.

Suggested Citation

  • Andrea Ichino & Fabrizia Mealli & Tommaso Nannicini, 2008. "From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 305-327.
    • Handle: RePEc:jae:japmet:v:23:y:2008:i:3:p:305-327
    DOI: 10.1002/jae.998
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1002/jae.998
    File Function: Link to full text; subscription required
    Download Restriction: no
    File URL: http://qed.econ.queensu.ca:80/jae/2008-v23.3/
    File Function: Supporting data files and programs
    Download Restriction: no
    File URL: https://libkey.io/10.1002/jae.998?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Gerfin, Michael & Lechner, Michael & Steiger, Heidi, 2005. "Does subsidised temporary employment get the unemployed back to work? Aneconometric analysis of two different schemes," Labour Economics, Elsevier, vol. 12(6), pages 807-835, December.
    2. Manski, Charles F, 1990. "Nonparametric Bounds on Treatment Effects," American Economic Review, American Economic Association, vol. 80(2), pages 319-323, May.
    3. Michael Lechner, 2002. "Program Heterogeneity And Propensity Score Matching: An Application To The Evaluation Of Active Labor Market Policies," The Review of Economics and Statistics, MIT Press, vol. 84(2), pages 205-220, May.
    4. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    5. Joseph G. Altonji & Todd E. Elder & Christopher R. Taber, 2005. "Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 151-184, February.
    6. Andrea Ichino & Fabrizia Mealli & Tommaso Nannicini, 2008. "From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 305-327.
    7. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    8. David H. Autor & Susan N. Houseman, 2010. "Do Temporary-Help Jobs Improve Labor Market Outcomes for Low-Skilled Workers? Evidence from "Work First"," American Economic Journal: Applied Economics, American Economic Association, vol. 2(3), pages 96-128, July.
    9. Guildo W. Imbens, 2003. "Sensitivity to Exogeneity Assumptions in Program Evaluation," American Economic Review, American Economic Association, vol. 93(2), pages 126-132, May.
    10. Alison L. Booth & Marco Francesconi & Jeff Frank, 2002. "Temporary Jobs: Stepping Stones Or Dead Ends?," Economic Journal, Royal Economic Society, vol. 112(480), pages 189-213, June.
    11. Black, Dan A. & Smith, J.A.Jeffrey A., 2004. "How robust is the evidence on the effects of college quality? Evidence from matching," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 99-124.
    12. Tommaso Nannicini, 2007. "Simulation-based sensitivity analysis for matching estimators," Stata Journal, StataCorp LP, vol. 7(3), pages 334-350, September.
    13. Julia Lane & Kelly S. Mikelson & Pat Sharkey & Doug Wissoker, 2003. "Pathways to work for low-income workers: The effect of work in the temporary help industry," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 22(4), pages 581-598.
    14. Rajeev H. Dehejia & Sadek Wahba, 1998. "Causal Effects in Non-Experimental Studies: Re-Evaluating the Evaluation of Training Programs," NBER Working Papers 6586, National Bureau of Economic Research, Inc.
    15. Miguel A. Malo & Fernando Munoz-Bullón, "undated". "Temporary help agencies and the labour market biography: A sequences-oriented approach," Studies on the Spanish Economy 132, FEDEA.
    16. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    17. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
    18. Michael Kvasnicka, 2005. "Does Temporary Agency Work Provide a Stepping Stone to Regular Employment?," Labor and Demography 0510005, University Library of Munich, Germany.
    19. Tommaso NANNICINI, 2004. "The Take-off of Temporary Employment in the Italian Labor Market," Economics Working Papers ECO2004/09, European University Institute.
    20. Charles Michalopoulos & Howard S. Bloom & Carolyn J. Hill, 2004. "Can Propensity-Score Methods Match the Findings from a Random Assignment Evaluation of Mandatory Welfare-to-Work Programs?," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 156-179, February.
    21. James J. Heckman & Jeffrey A. Smith, 1998. "Evaluating the Welfare State," NBER Working Papers 6542, National Bureau of Economic Research, Inc.
    22. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    23. Amuedo-Dorantes, Catalina & Malo, Miguel & Muñoz-Bullón, Fernando, 2006. "The Role of Temporary Help Agencies in Facilitating Temp-to-Perm Transitions," IZA Discussion Papers 2177, Institute of Labor Economics (IZA).
    24. Lechner, Michael & Pfeiffer, Friedhelm & Spengler, Hannes & Almus, Matthias, 2000. "The impact of non-profit temping agencies on individual labour market success in the West German state of Rhineland-Palatinate," ZEW Discussion Papers 00-02, ZEW - Leibniz Centre for European Economic Research.
    25. Andersson Joona, Pernilla & Wadensjö, Eskil, 2004. "Temporary Employment Agencies: A Route for Immigrants to Enter the Labour Market?," IZA Discussion Papers 1090, Institute of Labor Economics (IZA).
    26. Andrea Ichino & Fabrizia Mealli & Tommaso Nannicini, 2005. "Temporary Work Agencies in Italy: A Springboard Toward Permanent Employment?," Giornale degli Economisti, GDE (Giornale degli Economisti e Annali di Economia), Bocconi University, vol. 64(1), pages 1-27, September.
    27. Tommaso Nannicini, 2007. "A simulation-based sensitivity for matching estimators," United Kingdom Stata Users' Group Meetings 2007 15, Stata Users Group.
    28. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tommaso Nannicini, 2007. "Simulation-based sensitivity analysis for matching estimators," Stata Journal, StataCorp LP, vol. 7(3), pages 334-350, September.
    2. Candon, David, 2018. "The effect of cancer on the labor supply of employed men over the age of 65," Economics & Human Biology, Elsevier, vol. 31(C), pages 184-199.
    3. Carlos A. Flores & Oscar A. Mitnik, 2009. "Evaluating Nonexperimental Estimators for Multiple Treatments: Evidence from Experimental Data," Working Papers 2010-10, University of Miami, Department of Economics.
    4. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    5. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    6. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2017. "Unobservable, but unimportant? The relevance of usually unobserved variables for the evaluation of labor market policies," Labour Economics, Elsevier, vol. 46(C), pages 14-25.
    7. Bruno Arpino & Arnstein Aassve, 2013. "Estimating the causal effect of fertility on economic wellbeing: data requirements, identifying assumptions and estimation methods," Empirical Economics, Springer, vol. 44(1), pages 355-385, February.
    8. Okudaira, Hiroko & Ohtake, Fumio & Kume, Koichi & Tsuru, Kotaro, 2013. "What does a temporary help service job offer? Empirical suggestions from a Japanese survey," Journal of the Japanese and International Economies, Elsevier, vol. 28(C), pages 37-68.
    9. Arpino, Bruno & Mealli, Fabrizia, 2011. "The specification of the propensity score in multilevel observational studies," Computational Statistics & Data Analysis, Elsevier, vol. 55(4), pages 1770-1780, April.
    10. Baris Ucar & Gianni Betti, 2016. "The effect of a newborn on household poverty: a multi-indicator analysis," Department of Economics University of Siena 742, Department of Economics, University of Siena.
    11. Paolo Naticchioni & Silvia Loriga, 2011. "Short and Long Term Evaluations of Public Employment Services in Italy," Applied Economics Quarterly (formerly: Konjunkturpolitik), Duncker & Humblot, Berlin, vol. 57(3), pages 201-229.
    12. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006. "Moving the Goalposts: Addressing Limited Overlap in the Estimation of Average Treatment Effects by Changing the Estimand," NBER Technical Working Papers 0330, National Bureau of Economic Research, Inc.
    13. Michele Campolieti & Morley Gunderson & Jeffrey Smith, 2014. "The effect of vocational rehabilitation on the employment outcomes of disability insurance beneficiaries: new evidence from Canada," IZA Journal of Labor Policy, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 3(1), pages 1-29, December.
    14. Gonzalo Nunez-Chaim & Henry G. Overman & Capucine Riom, 2024. "Does subsidising business advice improve firm performance? Evidence from a large RCT," CEP Discussion Papers dp1977, Centre for Economic Performance, LSE.
    15. Eliasson, Kent, 2006. "How Robust is the Evidence on the Returns to College Choice? Results Using Swedish Administrative Data," Umeå Economic Studies 692, Umeå University, Department of Economics.
    16. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    17. Helena Holmlund & Olmo Silva, 2014. "Targeting Noncognitive Skills to Improve Cognitive Outcomes: Evidence from a Remedial Education Intervention," Journal of Human Capital, University of Chicago Press, vol. 8(2), pages 126-160.
    18. Caliendo, Marco & Künn, Steffen, 2011. "Start-up subsidies for the unemployed: Long-term evidence and effect heterogeneity," Journal of Public Economics, Elsevier, vol. 95(3), pages 311-331.
    19. Ángela Rocío López Sánchez & Andrés Felipe Virgüez Clavijo & Jaime Andrés Sarmiento Espinel & Adriana Carolina Silva Arias, 2015. "El efecto de la gerencia privada de escuelas públicas en el desempeno estudiantil en la educación media en Colombia," Revista Ecos de Economía, Universidad EAFIT, vol. 19(41), pages 108-136, December.
    20. Eliasson, Kent, 2006. "College Choice And Earnings Among University Graduates In Sweden," Umeå Economic Studies 693, Umeå University, Department of Economics.

    More about this item

    JEL classification:

    • C2 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables
    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs
    • J6 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity? (Journal of Applied Econometrics 2008) in ReplicationWiki

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jae:japmet:v:23:y:2008:i:3:p:305-327. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.