IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp1100.html
   My bibliography  Save this paper

The Success of Job Applications: A New Approach to Program Evaluation

Author

Listed:
  • Falk, Armin

    (University of Bonn)

  • Lalive, Rafael

    (University of Lausanne)

  • Zweimüller, Josef

    (University of Zurich)

Abstract

In this paper, we suggest a novel approach to program evaluation that allows identification of the causal effect of a training program on the likelihood of being invited to a job interview under weak assumptions. The idea is to measure the program-effects by pre- and posttreatment data that are very close in time for the same individual. Our approach provides useful information on both, average effects of the program as well as information on potential differences in the effects of the program by type of vacancy or by individual.

Suggested Citation

  • Falk, Armin & Lalive, Rafael & Zweimüller, Josef, 2004. "The Success of Job Applications: A New Approach to Program Evaluation," IZA Discussion Papers 1100, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp1100
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp1100.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jonas Agell & Per Lundborg, 2003. "Survey Evidence on Wage Rigidity and Unemployment: Sweden in the 1990s," Scandinavian Journal of Economics, Wiley Blackwell, vol. 105(1), pages 15-30, March.
    2. James W. Albrecht & Jan C. Van Ours, 2006. "Using Employer Hiring Behavior to Test the Educational Signaling Hypothesis," Scandinavian Journal of Economics, Wiley Blackwell, vol. 108(3), pages 361-372, October.
    3. David Neumark & Roy J. Bank & Kyle D. Van Nort, 1996. "Sex Discrimination in Restaurant Hiring: An Audit Study," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 111(3), pages 915-941.
    4. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    5. Barron, John M & Bishop, John, 1985. "Extensive Search, Intensive Search, and Hiring Costs: New Evidence on Employer Hiring Activity," Economic Inquiry, Western Economic Association International, vol. 23(3), pages 363-382, July.
    6. Peter A. Riach & Judith Rich, 1995. "An Investigation of Gender Discrimination in Labor Hiring," Eastern Economic Journal, Eastern Economic Association, vol. 21(3), pages 343-356, Summer.
    7. Riach, Peter A & Rich, Judith, 1991. "Testing for Racial Discrimination in the Labour Market," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 15(3), pages 239-256, September.
    8. Pedro Carneiro & Karsten T. Hansen & James J. Heckman, 2002. "Removing the Veil of Ignorance in Assessing the Distributional Impacts of Social Policies," NBER Working Papers 8840, National Bureau of Economic Research, Inc.
    9. Charles F. Manski, 2000. "Using Studies of Treatment Response to Inform Treatment Choice in Heterogeneous Populations," NBER Technical Working Papers 0263, National Bureau of Economic Research, Inc.
    10. Michael Gerfin & Michael Lechner, 2002. "A Microeconometric Evaluation of the Active Labour Market Policy in Switzerland," Economic Journal, Royal Economic Society, vol. 112(482), pages 854-893, October.
    11. Falk, Armin & Lalive, Rafael & Zweimüller, Josef, 2005. "The success of job applications: a new approach to program evaluation," Labour Economics, Elsevier, vol. 12(6), pages 739-748, December.
    12. Doris Weichselbaumer, 2004. "Is It Sex or Personality? The Impact of Sex Stereotypes on Discrimination in Applicant Selection," Eastern Economic Journal, Eastern Economic Association, vol. 30(2), pages 159-186, Spring.
    13. Lars Calmfors & Anders Forslund & Maria Hemström, 2002. "Does Active Labour Market Policy Work? Lessons from the Swedish Experiences," CESifo Working Paper Series 675, CESifo.
    14. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    15. van Ours, Jan & Ridder, Geert, 1992. "Vacancies and the Recruitment of New Employees," Journal of Labor Economics, University of Chicago Press, vol. 10(2), pages 138-155, April.
    16. James J. Heckman, 1998. "Detecting Discrimination," Journal of Economic Perspectives, American Economic Association, vol. 12(2), pages 101-116, Spring.
    17. Gorter, Cees & Nijkamp, Peter & Rietveld, Piet, 1993. "The Impact of Employers' Recruitment Behaviour on the Allocation of Vacant Jobs to Unemployed Job Seekers," Empirical Economics, Springer, vol. 18(2), pages 251-269.
    18. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    19. Lars Behrenz, 2001. "Who Gets The Job And Why? An Explorative Study Of Employersâ’ Recruitment Behavior," Journal of Applied Economics, Universidad del CEMA, vol. 4, pages 255-278, November.
    20. Lindeboom, Maarten & van Ours, Jan C & Renes, Gusta, 1994. "Matching Employers and Workers: An Empirical Analysis on the Effectiveness of Search," Oxford Economic Papers, Oxford University Press, vol. 46(1), pages 45-67, January.
    21. Arild Aakvik & James J. Heckman & Edward J. Vytlacil, 2000. "Treatment Effects for Discrete Outcomes when Responses to Treatment Vary Among Observationally Identical Persons: An Application to Norwegian ..," NBER Technical Working Papers 0262, National Bureau of Economic Research, Inc.
    22. A. D. Roy, 1951. "Some Thoughts On The Distribution Of Earnings," Oxford Economic Papers, Oxford University Press, vol. 3(2), pages 135-146.
    23. repec:bla:scandj:v:97:y:1995:i:2:p:295-307 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bruno S. Frey & Alois Stutzer, "undated". "Direct Democracy: Designing a Living Constitution," IEW - Working Papers 167, Institute for Empirical Research in Economics - University of Zurich.
    2. Piopiunik, Marc & Schwerdt, Guido & Simon, Lisa & Woessmann, Ludger, 2020. "Skills, signals, and employability: An experimental investigation," European Economic Review, Elsevier, vol. 123(C).
    3. Enrico De Giorgi & Stefan Reimann, "undated". "The ?-Beauty Contest: Choosing Numbers, Thinking Intervals," IEW - Working Papers 183, Institute for Empirical Research in Economics - University of Zurich.
    4. Li, Chuhui & Poskitt, D.S. & Zhao, Xueyan, 2019. "The bivariate probit model, maximum likelihood estimation, pseudo true parameters and partial identification," Journal of Econometrics, Elsevier, vol. 209(1), pages 94-113.
    5. Eva Van Belle & Ralf Caers & Marijke De Couck & Valentina Di Stasio & Stijn Baert, 2019. "The Signal of Applying for a Job Under a Vacancy Referral Scheme," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 58(2), pages 251-274, April.
    6. Falk, Armin & Lalive, Rafael & Zweimüller, Josef, 2005. "The success of job applications: a new approach to program evaluation," Labour Economics, Elsevier, vol. 12(6), pages 739-748, December.
    7. Bruno Frey, 2005. "‘‘Just forget it.’’ Memory distortions as bounded rationality," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 4(1), pages 13-25, June.
    8. Deuchert, Eva & Kauer, Lukas, 2013. "Hiring subsidies for people with a disability: Helping or hindering? - Evidence from a small scale social field experiment," Economics Working Paper Series 1335, University of St. Gallen, School of Economics and Political Science.
    9. Lisa Simon, 2019. "Microeconometric Analyses on Determinants of Individual Labour Market Outcomes," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 83.
    10. Beatty, Timothy K.M. & Tuttle, Charlotte, 2014. "The Effect of Energy Price Shocks on Household Food Security: Do Federal Assistance Programs Mitigate the Effects of Price Shocks," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 170546, Agricultural and Applied Economics Association.
    11. Arni, Patrick, 2012. "Kausale Evaluation von Pilotprojekten: Die Nutzung von Randomisierung in der Praxis," IZA Standpunkte 52, Institute of Labor Economics (IZA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Barbara Sianesi, 2002. "Swedish active labour market programmes in the 1990s: overall effectiveness and differential performance," IFS Working Papers W02/03, Institute for Fiscal Studies.
    2. Barbara Sianesi, 2002. "An evaluation of the Swedish system of active labour market programmes in the 1990s," IFS Working Papers W02/01, Institute for Fiscal Studies.
    3. Jordi Brandts & Arthur Schram & Klarita Gërxhani, 2007. "Information Networks and Worker Recruitment," UFAE and IAE Working Papers 707.07, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    4. Rodríguez-Planas, Núria, 2007. "What Works Best for Getting the Unemployed Back to Work: Employment Services or Small-Business Assistance Programmes? Evidence from Romania," IZA Discussion Papers 3051, Institute of Labor Economics (IZA).
    5. Volpe Martincus, Christian & Carballo, Jerónimo, 2010. "Beyond the average effects: The distributional impacts of export promotion programs in developing countries," Journal of Development Economics, Elsevier, vol. 92(2), pages 201-214, July.
    6. James Heckman & Salvador Navarro-Lozano, 2004. "Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
    7. Michael Lechner, 2002. "Some practical issues in the evaluation of heterogeneous labour market programmes by matching methods," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 165(1), pages 59-82, February.
    8. Lars Behrenz, 2001. "Who Gets The Job And Why? An Explorative Study Of Employersâ’ Recruitment Behavior," Journal of Applied Economics, Universidad del CEMA, vol. 4, pages 255-278, November.
    9. Wolff, Joachim & Hohmeyer, Katrin, 2011. "Direct job creation revisited: Is it effective for welfare recipients and does it matter whether participants receive a wage?," VfS Annual Conference 2011 (Frankfurt, Main): The Order of the World Economy - Lessons from the Crisis 48722, Verein für Socialpolitik / German Economic Association.
    10. Caliendo, Marco & Steiner, Viktor, 2005. "Aktive Arbeitsmarktpolitik in Deutschland : Bestandsaufnahme und Bewertung der mikroökonomischen Evaluationsergebnisse (Active labour market policy in Germany * review ans assessment of the microecono," Zeitschrift für ArbeitsmarktForschung - Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 38(2/3), pages 396-418.
    11. Deborah A. Cobb‐Clark & Thomas Crossley, 2003. "Econometrics for Evaluations: An Introduction to Recent Developments," The Economic Record, The Economic Society of Australia, vol. 79(247), pages 491-511, December.
    12. Petit, Pascale, 2007. "The effects of age and family constraints on gender hiring discrimination: A field experiment in the French financial sector," Labour Economics, Elsevier, vol. 14(3), pages 371-391, June.
    13. Doris Weichselbaumer, 2004. "Is It Sex or Personality? The Impact of Sex Stereotypes on Discrimination in Applicant Selection," Eastern Economic Journal, Eastern Economic Association, vol. 30(2), pages 159-186, Spring.
    14. Michele Pellizzari, 2011. "Employers' Search and the Efficiency of Matching," British Journal of Industrial Relations, London School of Economics, vol. 49(1), pages 25-53, March.
    15. Doris Weichselbaumer, 2013. "Discrimination in gay and lesbian lives," Chapters, in: Deborah M. Figart & Tonia L. Warnecke (ed.), Handbook of Research on Gender and Economic Life, chapter 15, pages 236-254, Edward Elgar Publishing.
    16. Caliendo, Marco & Steiner, Viktor, 2005. "Aktive Arbeitsmarktpolitik in Deutschland : Bestandsaufnahme und Bewertung der mikroökonomischen Evaluationsergebnisse (Active labour market policy in Germany * review ans assessment of the microecono," Zeitschrift für ArbeitsmarktForschung - Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 38(2/3), pages 396-418.
    17. Abdellatif Chatri & Khadija Hadef & Naima Samoudi, 2021. "Micro-econometric evaluation of subsidized employment in morocco: the case of the "Idmaj" program," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 55(1), pages 1-13, December.
    18. Hohmeyer, Katrin & Wolff, Joachim, 2010. "Direct job creation in Germany revisited: Is it effective for welfare recipients and does it matter whether participants receive a wage?," IAB-Discussion Paper 201021, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    19. Barbara Sianesi, 2001. "Differential effects of Swedish active labour market programmes for unemployed adults during the 1990s," IFS Working Papers W01/25, Institute for Fiscal Studies.
    20. Souleymane Mbaye, 2019. "Trois évaluations d’actions de lutte contre les discriminations," Erudite Ph.D Dissertations, Erudite, number ph19-01 edited by Pascale Petit.

    More about this item

    Keywords

    field experiments; active labour market program; evaluation; correspondence testing;
    All these keywords.

    JEL classification:

    • I38 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Government Programs; Provision and Effects of Welfare Programs
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp1100. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.