IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp14377.html
   My bibliography  Save this paper

Using Machine Learning to Create an Early Warning System for Welfare Recipients

Author

Listed:
  • Sansone, Dario

    (University of Exeter)

  • Zhu, Anna

    (RMIT University)

Abstract

Using high-quality nation-wide social security data combined with machine learning tools, we develop predictive models of income support receipt intensities for any payment enrolee in the Australian social security system between 2014 and 2018. We show that off-the-shelf machine learning algorithms can significantly improve predictive accuracy compared to simpler heuristic models or early warning systems currently in use. Specifically, the former predicts the proportion of time individuals are on income support in the subsequent four years with greater accuracy, by a magnitude of at least 22% (14 percentage points increase in the R2), compared to the latter. This gain can be achieved at no extra cost to practitioners since the algorithms use administrative data currently available to caseworkers. Consequently, our machine learning algorithms can improve the detection of long-term income support recipients, which can potentially provide governments with large savings in accrued welfare costs.

Suggested Citation

  • Sansone, Dario & Zhu, Anna, 2021. "Using Machine Learning to Create an Early Warning System for Welfare Recipients," IZA Discussion Papers 14377, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp14377
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp14377.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Mitchell Hoffman & Lisa B Kahn & Danielle Li, 2018. "Discretion in Hiring," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 765-800.
    2. Moffitt, Robert, 1992. "Incentive Effects of the U.S. Welfare System: A Review," Journal of Economic Literature, American Economic Association, vol. 30(1), pages 1-61, March.
    3. Cobb-Clark, Deborah A. & Dahmann, Sarah C. & Salamanca, Nicolás & Zhu, Anna, 2022. "Intergenerational disadvantage: Learning about equal opportunity from social assistance receipt," Labour Economics, Elsevier, vol. 79(C).
    4. Edward L. Glaeser & Scott Duke Kominers & Michael Luca & Nikhil Naik, 2018. "Big Data And Big Cities: The Promises And Limitations Of Improved Measures Of Urban Life," Economic Inquiry, Western Economic Association International, vol. 56(1), pages 114-137, January.
    5. Aaron Chalfin & Oren Danieli & Andrew Hillis & Zubin Jelveh & Michael Luca & Jens Ludwig & Sendhil Mullainathan, 2016. "Productivity and Selection of Human Capital with Machine Learning," American Economic Review, American Economic Association, vol. 106(5), pages 124-127, May.
    6. Gordon B. Dahl & Andreas Ravndal Kostøl & Magne Mogstad, 2014. "Family Welfare Cultures," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(4), pages 1711-1752.
    7. Hoynes, Hilary Williamson & Schanzenbach, Diane Whitmore, 2012. "Work incentives and the Food Stamp Program," Journal of Public Economics, Elsevier, vol. 96(1), pages 151-162.
    8. David Card & Andrew Johnston & Pauline Leung & Alexandre Mas & Zhuan Pei, 2015. "The Effect of Unemployment Benefits on the Duration of Unemployment Insurance Receipt: New Evidence from a Regression Kink Design in Missouri, 2003-2013," American Economic Review, American Economic Association, vol. 105(5), pages 126-130, May.
    9. Johannes F. Schmieder & Till von Wachter, 2016. "The Effects of Unemployment Insurance Benefits: New Evidence and Interpretation," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 547-581, October.
    10. David Card & Jochen Kluve & Andrea Weber, 2018. "What Works? A Meta Analysis of Recent Active Labor Market Program Evaluations," Journal of the European Economic Association, European Economic Association, vol. 16(3), pages 894-931.
    11. Bruce Bradbury & Anna Zhu, 2018. "Welfare Entry and Exit after Marital Separation among Australian Mothers," The Economic Record, The Economic Society of Australia, vol. 94(307), pages 405-423, December.
    12. Manudeep Bhuller & Christian N. Brinch & Sebastian Königs, 2017. "Time Aggregation and State Dependence in Welfare Receipt," Economic Journal, Royal Economic Society, vol. 127(604), pages 1833-1873, September.
    13. Michael C. Knaus & Michael Lechner & Anthony Strittmatter, 2022. "Heterogeneous Employment Effects of Job Search Programs: A Machine Learning Approach," Journal of Human Resources, University of Wisconsin Press, vol. 57(2), pages 597-636.
    14. Gordon B. Dahl & Anne C. Gielen, 2021. "Intergenerational Spillovers in Disability Insurance," American Economic Journal: Applied Economics, American Economic Association, vol. 13(2), pages 116-150, April.
    15. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "High-Dimensional Methods and Inference on Structural and Treatment Effects," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 29-50, Spring.
    16. McKenzie, David & Sansone, Dario, 2019. "Predicting entrepreneurial success is hard: Evidence from a business plan competition in Nigeria," Journal of Development Economics, Elsevier, vol. 141(C).
    17. Bert van Landeghem & Sam Desiere & Ludo Struyven, 2021. "Statistical profiling of unemployed jobseekers," IZA World of Labor, Institute of Labor Economics (IZA), pages 483-483, February.
    18. Nick Guenther & Matthias Schonlau, 2016. "Support vector machines," Stata Journal, StataCorp LP, vol. 16(4), pages 917-937, December.
    19. David Card & Raj Chetty & Andrea Weber, 2007. "The Spike at Benefit Exhaustion: Leaving the Unemployment System or Starting a New Job?," American Economic Review, American Economic Association, vol. 97(2), pages 113-118, May.
    20. Moffitt, Robert, 1985. "Unemployment insurance and the distribution of unemployment spells," Journal of Econometrics, Elsevier, vol. 28(1), pages 85-101, April.
    21. Athey, Susan & Imbens, Guido W., 2019. "Machine Learning Methods Economists Should Know About," Research Papers 3776, Stanford University, Graduate School of Business.
    22. Raj Chetty & John N. Friedman & Nathaniel Hendren & Maggie R. Jones & Sonya R. Porter, 2018. "The Opportunity Atlas: Mapping the Childhood Roots of Social Mobility," Working Papers 18-42, Center for Economic Studies, U.S. Census Bureau.
    23. Yi‐Ping Tseng & Roger Wilkins, 2003. "Reliance on Income Support in Australia: Prevalence and Persistence," The Economic Record, The Economic Society of Australia, vol. 79(245), pages 196-217, June.
    24. Alkire, Sabina & Foster, James, 2011. "Counting and multidimensional poverty measurement," Journal of Public Economics, Elsevier, vol. 95(7), pages 476-487.
    25. Manudeep Bhuller & Christian N. Brinch & Sebastian Königs, 2017. "Time Aggregation and State Dependence in Welfare Receipt," Economic Journal, Royal Economic Society, vol. 127(604), pages 1833-1873, September.
    26. Vanya Van Belle & Ben Van Calster & Sabine Van Huffel & Johan A K Suykens & Paulo Lisboa, 2016. "Explaining Support Vector Machines: A Color Based Nomogram," PLOS ONE, Public Library of Science, vol. 11(10), pages 1-33, October.
    27. Dario Sansone, 2019. "Beyond Early Warning Indicators: High School Dropout and Machine Learning," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 81(2), pages 456-485, April.
    28. Mitrut, Andreea & Tudor, Simona, 2018. "Bridging the gap for Roma: The effects of an ethnically targeted program on prenatal care and child health," Journal of Public Economics, Elsevier, vol. 165(C), pages 114-132.
    29. Susan Athey & Guido W. Imbens, 2019. "Machine Learning Methods That Economists Should Know About," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 685-725, August.
    30. Barrett, Garry F., 2000. "The effect of educational attainment on welfare dependence: Evidence from Canada," Journal of Public Economics, Elsevier, vol. 77(2), pages 209-232, August.
    31. Stevenson, Megan T. & Doleac, Jennifer, 2019. "Algorithmic Risk Assessment in the Hands of Humans," IZA Discussion Papers 12853, Institute of Labor Economics (IZA).
    32. Aizer, Anna & Currie, Janet, 2004. "Networks or neighborhoods? Correlations in the use of publicly-funded maternity care in California," Journal of Public Economics, Elsevier, vol. 88(12), pages 2573-2585, December.
    33. Jon Kleinberg & Himabindu Lakkaraju & Jure Leskovec & Jens Ludwig & Sendhil Mullainathan, 2018. "Human Decisions and Machine Predictions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 237-293.
    34. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    35. Joakim Palme & Walter Korpi, 1998. "The Paradox of Redistribution and Strategies of Equality: Welfare State Institutions, Inequality and Poverty in the Western Countries," LIS Working papers 174, LIS Cross-National Data Center in Luxembourg.
    36. Christopher Yeh & Anthony Perez & Anne Driscoll & George Azzari & Zhongyi Tang & David Lobell & Stefano Ermon & Marshall Burke, 2020. "Using publicly available satellite imagery and deep learning to understand economic well-being in Africa," Nature Communications, Nature, vol. 11(1), pages 1-11, December.
    37. Matthias Schonlau, 2005. "Boosted regression (boosting): An introductory tutorial and a Stata plugin," Stata Journal, StataCorp LP, vol. 5(3), pages 330-354, September.
    38. Jake M. Hofman & Duncan J. Watts & Susan Athey & Filiz Garip & Thomas L. Griffiths & Jon Kleinberg & Helen Margetts & Sendhil Mullainathan & Matthew J. Salganik & Simine Vazire & Alessandro Vespignani, 2021. "Integrating explanation and prediction in computational social science," Nature, Nature, vol. 595(7866), pages 181-188, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guerra, Pedro & Castelli, Mauro & Côrte-Real, Nadine, 2022. "Machine learning for liquidity risk modelling: A supervisory perspective," Economic Analysis and Policy, Elsevier, vol. 74(C), pages 175-187.
    2. Shu-Ling Lin & Xiao Jin, 2023. "Does ESG Predict Systemic Banking Crises? A Computational Economics Model of Early Warning Systems with Interpretable Multi-Variable LSTM based on Mixture Attention," Mathematics, MDPI, vol. 11(2), pages 1-15, January.
    3. Carbó, José Manuel & Gorjón, Sergio, 2024. "Determinants of the price of bitcoin: An analysis with machine learning and interpretability techniques," International Review of Economics & Finance, Elsevier, vol. 92(C), pages 123-140.
    4. Jeremy K. Nguyen & Adam Karg & Abbas Valadkhani & Heath McDonald, 2022. "Predicting individual event attendance with machine learning: a ‘step-forward’ approach," Applied Economics, Taylor & Francis Journals, vol. 54(27), pages 3138-3153, June.
    5. Moreno Badia, Marialuz & Medas, Paulo & Gupta, Pranav & Xiang, Yuan, 2022. "Debt is not free," Journal of International Money and Finance, Elsevier, vol. 127(C).
    6. Zhao, Zichao & Li, Dexuan & Dai, Wensheng, 2023. "Machine-learning-enabled intelligence computing for crisis management in small and medium-sized enterprises (SMEs)," Technological Forecasting and Social Change, Elsevier, vol. 191(C).
    7. Citterio, Alberto, 2024. "Bank failure prediction models: Review and outlook," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).
    8. Alonso-Alvarez, Irma & Molina, Luis, 2023. "How to foresee crises? A new synthetic index of vulnerabilities for emerging economies," Economic Modelling, Elsevier, vol. 125(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. McKenzie, David & Sansone, Dario, 2017. "Man vs. Machine in Predicting Successful Entrepreneurs: Evidence from a Business Plan Competition in Nigeria," CEPR Discussion Papers 12523, C.E.P.R. Discussion Papers.
    2. McKenzie, David & Sansone, Dario, 2019. "Predicting entrepreneurial success is hard: Evidence from a business plan competition in Nigeria," Journal of Development Economics, Elsevier, vol. 141(C).
    3. Filmer,Deon P. & Nahata,Vatsal & Sabarwal,Shwetlena, 2021. "Preparation, Practice, and Beliefs : A Machine Learning Approach to Understanding Teacher Effectiveness," Policy Research Working Paper Series 9847, The World Bank.
    4. Yu, Baojun & Li, Changming & Mirza, Nawazish & Umar, Muhammad, 2022. "Forecasting credit ratings of decarbonized firms: Comparative assessment of machine learning models," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    5. Lily Davies & Mark Kattenberg & Benedikt Vogt, 2023. "Predicting Firm Exits with Machine Learning: Implications for Selection into COVID-19 Support and Productivity Growth," CPB Discussion Paper 444, CPB Netherlands Bureau for Economic Policy Analysis.
    6. Bubonya, Melisa & Cobb-Clark, Deborah A., 2021. "Pathways of Disadvantage: Unpacking the Intergenerational Correlation in Welfare," Economics of Education Review, Elsevier, vol. 80(C).
    7. de Blasio, Guido & D'Ignazio, Alessio & Letta, Marco, 2022. "Gotham city. Predicting ‘corrupted’ municipalities with machine learning," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    8. Liyang Tang, 2020. "Application of Nonlinear Autoregressive with Exogenous Input (NARX) neural network in macroeconomic forecasting, national goal setting and global competitiveness assessment," Papers 2005.08735, arXiv.org.
    9. Andres, Antonio Rodriguez & Otero, Abraham & Amavilah, Voxi Heinrich, 2021. "Using Deep Learning Neural Networks to Predict the Knowledge Economy Index for Developing and Emerging Economies," MPRA Paper 109137, University Library of Munich, Germany.
    10. Guido de Blasio & Alessio D'Ignazio & Marco Letta, 2020. "Predicting Corruption Crimes with Machine Learning. A Study for the Italian Municipalities," Working Papers 16/20, Sapienza University of Rome, DISS.
    11. Michael C Knaus, 2022. "Double machine learning-based programme evaluation under unconfoundedness [Econometric methods for program evaluation]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 602-627.
    12. Delogu, Marco & Lagravinese, Raffaele & Paolini, Dimitri & Resce, Giuliano, 2024. "Predicting dropout from higher education: Evidence from Italy," Economic Modelling, Elsevier, vol. 130(C).
    13. Cockx, Bart & Lechner, Michael & Bollens, Joost, 2023. "Priority to unemployed immigrants? A causal machine learning evaluation of training in Belgium," Labour Economics, Elsevier, vol. 80(C).
    14. Mehmet Güney Celbiş & Pui-Hang Wong & Karima Kourtit & Peter Nijkamp, 2021. "Innovativeness, Work Flexibility, and Place Characteristics: A Spatial Econometric and Machine Learning Approach," Sustainability, MDPI, vol. 13(23), pages 1-29, December.
    15. Yongtong Shao & Tao Xiong & Minghao Li & Dermot Hayes & Wendong Zhang & Wei Xie, 2021. "China's Missing Pigs: Correcting China's Hog Inventory Data Using a Machine Learning Approach," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(3), pages 1082-1098, May.
    16. Falco J. Bargagli Stoffi & Kenneth De Beckker & Joana E. Maldonado & Kristof De Witte, 2021. "Assessing Sensitivity of Machine Learning Predictions.A Novel Toolbox with an Application to Financial Literacy," Papers 2102.04382, arXiv.org.
    17. Ajit Desai, 2023. "Machine Learning for Economics Research: When What and How?," Papers 2304.00086, arXiv.org, revised Apr 2023.
    18. Ghysels, Eric & Babii, Andrii & Chen, Xi & Kumar, Rohit, 2020. "Binary Choice with Asymmetric Loss in a Data-Rich Environment: Theory and an Application to Racial Justice," CEPR Discussion Papers 15418, C.E.P.R. Discussion Papers.
    19. Daniel Goller & Tamara Harrer & Michael Lechner & Joachim Wolff, 2021. "Active labour market policies for the long-term unemployed: New evidence from causal machine learning," Papers 2106.10141, arXiv.org, revised May 2023.
    20. Byron Botha & Rulof Burger & Kevin Kotzé & Neil Rankin & Daan Steenkamp, 2023. "Big data forecasting of South African inflation," Empirical Economics, Springer, vol. 65(1), pages 149-188, July.

    More about this item

    Keywords

    income support; machine learning; Australia;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • H53 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Welfare Programs
    • I38 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Government Programs; Provision and Effects of Welfare Programs
    • J68 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Public Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp14377. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.