IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp1728.html
   My bibliography  Save this paper

What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments

Author

Listed:
  • Bitler, Marianne P.

    (University of California, Davis)

  • Gelbach, Jonah B.

    (Yale University)

  • Hoynes, Hilary W.

    (University of California, Berkeley)

Abstract

Labor supply theory predicts systematic heterogeneity in the impact of recent welfare reforms on earnings, transfers, and income. Yet most welfare reform research focuses on mean impacts. We investigate the importance of heterogeneity using random-assignment data from Connecticut's Jobs First waiver, which features key elements of post-1996 welfare programs. Estimated quantile treatment effects exhibit the substantial heterogeneity predicted by labor supply theory. Thus mean impacts miss a great deal. Looking separately at samples of dropouts and other women does not improve the performance of mean impacts. We conclude that welfare reform's effects are likely both more varied and more extensive than has been recognized.

Suggested Citation

  • Bitler, Marianne P. & Gelbach, Jonah B. & Hoynes, Hilary W., 2005. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," IZA Discussion Papers 1728, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp1728
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp1728.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Moffitt, Robert, 1992. "Incentive Effects of the U.S. Welfare System: A Review," Journal of Economic Literature, American Economic Association, vol. 30(1), pages 1-61, March.
    2. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2006. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," American Economic Review, American Economic Association, vol. 96(4), pages 988-1012, September.
    3. Sergio Firpo, 2007. "Efficient Semiparametric Estimation of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 75(1), pages 259-276, January.
    4. Alberto Abadie & Joshua Angrist & Guido Imbens, 2002. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Econometrica, Econometric Society, vol. 70(1), pages 91-117, January.
    5. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2006. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," American Economic Review, American Economic Association, vol. 96(4), pages 988-1012, September.
    6. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 487-535.
    7. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
    8. Melvin Stephens Jr., 2003. ""3rd of tha Month": Do Social Security Recipients Smooth Consumption Between Checks?," American Economic Review, American Economic Association, vol. 93(1), pages 406-422, March.
    9. Nada Eissa & Jeffrey B. Liebman, 1996. "Labor Supply Response to the Earned Income Tax Credit," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 111(2), pages 605-637.
    10. Jeffrey Grogger & Charles Michalopoulos, 2003. "Welfare Dynamics under Time Limits," Journal of Political Economy, University of Chicago Press, vol. 111(3), pages 530-554, June.
    11. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    12. Gruber, Jonathan, 2000. "Cash welfare as a consumption smoothing mechanism for divorced mothers," Journal of Public Economics, Elsevier, vol. 75(2), pages 157-182, February.
    13. Hilary W. Hoynes & Kenneth Y. Chay & Dean Hyslop, 2004. "True State Dependence In Monthly Welfare Participation:A Nonexperimental Analysis," Working Papers 2, University of California, Davis, Department of Economics.
    14. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    15. Schoeni, R.F. & Blank, R.M., 2000. "What Has Welfare Reform Accomplished? Impacts on Welfare Participation, Employment, Income, Poverty, and Family Structure," Papers 00-02, RAND - Labor and Population Program.
    16. Neil G. Bennett & Hsien-Hen Lu & Younghwan Song, 2002. "Welfare Reform and Changes in the Economic Well-Being of Children," NBER Working Papers 9399, National Bureau of Economic Research, Inc.
    17. Daniel Friedlander & Philip K. Robins, 1997. "The Distributional Impacts of Social Programs," Evaluation Review, , vol. 21(5), pages 531-553, October.
    18. Rebecca M. Blank & David Card & Philip K. Robins, 1999. "Financial Incentives for Increasing Work and Income Among Low- Income Families," HEW 9902002, University Library of Munich, Germany.
    19. Terra McKinnish & Seth Sanders & Jeffrey Smith, 1999. "Estimates of Effective Guarantees and Tax Rates in the AFDC Program for the Post-OBRA Period," Journal of Human Resources, University of Wisconsin Press, vol. 34(2), pages 312-345.
    20. Atkinson, Anthony B., 1970. "On the measurement of inequality," Journal of Economic Theory, Elsevier, vol. 2(3), pages 244-263, September.
    21. Jeffrey Grogger, 2003. "The Effects of Time Limits, the EITC, and Other Policy Changes on Welfare Use, Work, and Income among Female-Headed Families," The Review of Economics and Statistics, MIT Press, vol. 85(2), pages 394-408, May.
    22. Besley, Timothy & Coate, Stephen, 1992. "Workfare versus Welfare Incentive Arguments for Work Requirements in Poverty-Alleviation Programs," American Economic Review, American Economic Association, vol. 82(1), pages 249-261, March.
    23. Leora Friedberg, 2000. "The Labor Supply Effects of the Social Security Earnings Test," The Review of Economics and Statistics, MIT Press, vol. 82(1), pages 48-63, February.
    24. Hilary W. Hoynes & Kenneth Y. Chay & Dean Hyslop, 2004. "True State Dependence In Monthly Welfare Participation:A Nonexperimental Analysis," Working Papers 533, University of California, Davis, Department of Economics.
    25. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2003. "Some Evidence on Race, Welfare Reform, and Household Income," American Economic Review, American Economic Association, vol. 93(2), pages 293-298, May.
    26. Dehejia, Rajeev H., 2005. "Program evaluation as a decision problem," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 141-173.
    27. Jonathan Gruber, 1996. "Cash Welfare as a Consumption Smoothing Mechanism for Single Mothers," NBER Working Papers 5738, National Bureau of Economic Research, Inc.
    28. Moffitt, Robert A., 2002. "Welfare programs and labor supply," Handbook of Public Economics, in: A. J. Auerbach & M. Feldstein (ed.), Handbook of Public Economics, edition 1, volume 4, chapter 34, pages 2393-2430, Elsevier.
    29. Rebecca M. Blank, 2002. "Evaluating Welfare Reform in the United States," Journal of Economic Literature, American Economic Association, vol. 40(4), pages 1105-1166, December.
    30. Schoeni, R.F. & Blank, R.M., 2000. "What Has Welfare Reform Accomplished? Impacts on Welfare Participation, Employment, Income, Poverty, and Family Structure," Papers 00-02, RAND - Labor and Population Program.
    31. Abadie A., 2002. "Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 284-292, March.
    32. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    33. Thomas Fraker & Robert Moffitt & Douglas Wolf, 1985. "Effective Tax Rates and Guarantees in the AFDC Program, 1967-1982," Journal of Human Resources, University of Wisconsin Press, vol. 20(2), pages 251-263.
    34. Robert A. Moffitt, 1999. "The Effect of Pre-PRWORA Waivers on AFDC Caseloads and Female Earnings, Income, and Labor Force Behavior," JCPR Working Papers 89, Northwestern University/University of Chicago Joint Center for Poverty Research.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2006. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," American Economic Review, American Economic Association, vol. 96(4), pages 988-1012, September.
    2. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    3. Mazzolari, Francesca & Ragusa, Giuseppe, 2012. "Time Limits: The Effects on Welfare Use and Other Consumption-Smoothing Mechanisms," IZA Discussion Papers 6993, Institute of Labor Economics (IZA).
    4. Bitler, Marianne P. & Gelbach, Jonah B. & Hoynes, Hilary W., 2008. "Distributional impacts of the Self-Sufficiency Project," Journal of Public Economics, Elsevier, vol. 92(3-4), pages 748-765, April.
    5. Bitler, Marianne P. & Gelbach, Jonah B. & Hoynes, Hilary W., 2008. "Distributional impacts of the Self-Sufficiency Project," Journal of Public Economics, Elsevier, vol. 92(3-4), pages 748-765, April.
    6. Rebecca M. Blank, 2002. "Evaluating Welfare Reform in the United States," Journal of Economic Literature, American Economic Association, vol. 40(4), pages 1105-1166, December.
    7. Sokbae Lee & Yoon-Jae Whang, 2009. "Nonparametric Tests of Conditional Treatment Effects," Cowles Foundation Discussion Papers 1740, Cowles Foundation for Research in Economics, Yale University.
    8. Melanie Guldi & Lucie Schmidt, 2017. "Taxes, Transfers, and Women’s Labor Supply in the United States," Working Papers 2017-01, University of Central Florida, Department of Economics.
    9. Ozkan Eren & Serkan Ozbeklik, 2014. "Who Benefits From Job Corps? A Distributional Analysis Of An Active Labor Market Program," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(4), pages 586-611, June.
    10. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.
    11. Maier, Michael, 2011. "Tests for distributional treatment effects under unconfoundedness," Economics Letters, Elsevier, vol. 110(1), pages 49-51, January.
    12. Gregory Acs & Eric Toder, 2007. "Should we subsidize work? Welfare reform, the earned income tax credit and optimal transfers," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 14(3), pages 327-343, June.
    13. Steven F. Lehrer & R. Vincent Pohl & Kyungchul Song, 2022. "Multiple Testing and the Distributional Effects of Accountability Incentives in Education," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(4), pages 1552-1568, October.
    14. Hartley, Robert Paul & Lamarche, Carlos, 2018. "Behavioral responses and welfare reform: Evidence from a randomized experiment," Labour Economics, Elsevier, vol. 54(C), pages 135-151.
    15. Susan Athey & Guido W. Imbens, 2006. "Identification and Inference in Nonlinear Difference-in-Differences Models," Econometrica, Econometric Society, vol. 74(2), pages 431-497, March.
    16. Pedro H. C. Sant'Anna, 2016. "Program Evaluation with Right-Censored Data," Papers 1604.02642, arXiv.org.
    17. Marianne Bitler & Jonah Gelbach & Hilary Hoynes & Madeline Zavodny, 2004. "The impact of welfare reform on marriage and divorce," Demography, Springer;Population Association of America (PAA), vol. 41(2), pages 213-236, May.
    18. Halbert White & Karim Chalak, 2008. "Identifying Structural Effects in Nonseparable Systems Using Covariates," Boston College Working Papers in Economics 734, Boston College Department of Economics.
    19. Steven F. Lehrer & R. Vincent Pohl & Kyungchul Song, 2016. "Targeting Policies: Multiple Testing and Distributional Treatment Effects," NBER Working Papers 22950, National Bureau of Economic Research, Inc.
    20. Sakos, Grayson & Cerulli, Giovanni & Garbero, Alessandra, 2021. "Beyond the ATE: Idiosyncratic Effect Estimation to Uncover Distributional Impacts Results from 17 Impact Evaluations," 2021 Annual Meeting, August 1-3, Austin, Texas 314017, Agricultural and Applied Economics Association.

    More about this item

    Keywords

    distributional effects; treatment effect heterogeneity; welfare reform;
    All these keywords.

    JEL classification:

    • J2 - Labor and Demographic Economics - - Demand and Supply of Labor
    • I38 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Government Programs; Provision and Effects of Welfare Programs
    • H53 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Welfare Programs

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp1728. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.