IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/9708.html
   My bibliography  Save this paper

Treatment Effect Heterogeneity in Theory and Practice

Author

Listed:
  • Joshua D. Angrist

Abstract

Instrumental Variables (IV) methods identify internally valid causal effects for individuals whose treatment status is manipulable by the instrument at hand. Inference for other populations requires some sort of homogeneity assumption. This paper outlines a theoretical framework that nests all possible homogeneity assumptions for a causal treatment-effects model with a binary instrument. The framework suggests strategies for using IV estimates for extrapolation, while making it clear that efforts to go from local average treatment effects (LATE) to population average treatment effects are inherently speculative. These ideas are illustrated in an application using sibling-sex composition to estimate the effect of child-bearing on economic and marital outcomes for mothers with two or more children. The application is motivated by welfare reform, which penalizes further childbearing by welfare mothers on the grounds that more children make continued poverty and welfare receipt more likely. The empirical results generally support the notion of reduced labor supply and increased poverty rates as a consequence of additional childbearing, but evidence on the impact of childbearing on marital stability and welfare use is more tenuous. Another interesting finding is that for the sample of teen mothers, LATE is essentially equal to the population average treatment effect.

Suggested Citation

  • Joshua D. Angrist, 2003. "Treatment Effect Heterogeneity in Theory and Practice," NBER Working Papers 9708, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:9708
    Note: LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w9708.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Alberto Abadie & Joshua Angrist & Guido Imbens, 2002. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Econometrica, Econometric Society, vol. 70(1), pages 91-117, January.
    2. Howard S. Bloom, 1984. "Accounting for No-Shows in Experimental Evaluation Designs," Evaluation Review, , vol. 8(2), pages 225-246, April.
    3. James Heckman & Justin L. Tobias & Edward Vytlacil, 2001. "Four Parameters of Interest in the Evaluation of Social Programs," Southern Economic Journal, John Wiley & Sons, vol. 68(2), pages 210-223, October.
    4. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    5. Angrist, Joshua D, 2001. "Estimations of Limited Dependent Variable Models with Dummy Endogenous Regressors: Simple Strategies for Empirical Practice," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(1), pages 2-16, January.
    6. Jeff Grogger & Stephen G. Bronars, 2001. "The Effect of Welfare Payments on the Marriage and Fertility Behavior of Unwed Mothers: Results from a Twins Experiment," Journal of Political Economy, University of Chicago Press, vol. 109(3), pages 529-545, June.
    7. Angrist, J.D. & Imbens, G.W., 1991. "Sources of Identifying Information in Evaluation Models," Harvard Institute of Economic Research Working Papers 1568, Harvard - Institute of Economic Research.
    8. Abadie, Alberto, 2003. "Semiparametric instrumental variable estimation of treatment response models," Journal of Econometrics, Elsevier, vol. 113(2), pages 231-263, April.
    9. Moffitt, Robert A., 1999. "New developments in econometric methods for labor market analysis," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 24, pages 1367-1397, Elsevier.
    10. James Heckman & Justin L. Tobias & Edward Vytlacil, 2001. "Four Parameters of Interest in the Evaluation of Social Programs," Southern Economic Journal, John Wiley & Sons, vol. 68(2), pages 210-223, October.
    11. Chamberlain, Gary, 1986. "Asymptotic efficiency in semi-parametric models with censoring," Journal of Econometrics, Elsevier, vol. 32(2), pages 189-218, July.
    12. Wooldridge, Jeffrey M., 1997. "On two stage least squares estimation of the average treatment effect in a random coefficient model," Economics Letters, Elsevier, vol. 56(2), pages 129-133, October.
    13. A. D. Roy, 1951. "Some Thoughts On The Distribution Of Earnings," Oxford Economic Papers, Oxford University Press, vol. 3(2), pages 135-146.
    14. Becker, Gary S & Landes, Elisabeth M & Michael, Robert T, 1977. "An Economic Analysis of Marital Instability," Journal of Political Economy, University of Chicago Press, vol. 85(6), pages 1141-1187, December.
    15. James J. Heckman & Edward J. Vytlacil, 2000. "Local Instrumental Variables," NBER Technical Working Papers 0252, National Bureau of Economic Research, Inc.
    16. Andrew Cherlin, 1977. "The effect of children on marital dissolution," Demography, Springer;Population Association of America (PAA), vol. 14(3), pages 265-272, August.
    17. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    18. Melissa Schettini Kearney, 2004. "Is There an Effect of Incremental Welfare Benefits on Fertility Behavior?: A Look at the Family Cap," Journal of Human Resources, University of Wisconsin Press, vol. 39(2).
    19. Rebecca M. Blank, 2002. "Evaluating Welfare Reform in the United States," Journal of Economic Literature, American Economic Association, vol. 40(4), pages 1105-1166, December.
    20. Tim Heaton, 1990. "Marital stability throughout the child-rearing years," Demography, Springer;Population Association of America (PAA), vol. 27(1), pages 55-63, February.
    21. Abadie A., 2002. "Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 284-292, March.
    22. Frolich, Markus, 2007. "Nonparametric IV estimation of local average treatment effects with covariates," Journal of Econometrics, Elsevier, vol. 139(1), pages 35-75, July.
    23. Angrist, Joshua D & Evans, William N, 1998. "Children and Their Parents' Labor Supply: Evidence from Exogenous Variation in Family Size," American Economic Review, American Economic Association, vol. 88(3), pages 450-477, June.
    24. Arellano, Manuel, 2002. "Sargan's Instrumental Variables Estimation and the Generalized Method of Moments," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(4), pages 450-459, October.
    25. Phillips, Peter C.B., 2003. "Vision And Influence In Econometrics: John Denis Sargan," Econometric Theory, Cambridge University Press, vol. 19(3), pages 495-511, June.
    26. V. Joseph Hotz & Guido W. Imbens & Jacob A. Klerman, 2000. "The Long-Term Gains from GAIN: A Re-Analysis of the Impacts of the California GAIN Program," NBER Working Papers 8007, National Bureau of Economic Research, Inc.
    27. Joshua D. Angrist & Guido W. Imbens & D.B. Rubin, 1993. "Identification of Causal Effects Using Instrumental Variables," NBER Technical Working Papers 0136, National Bureau of Economic Research, Inc.
    28. Manski, Charles F, 1990. "Nonparametric Bounds on Treatment Effects," American Economic Review, American Economic Association, vol. 80(2), pages 319-323, May.
    29. Wooldridge, Jeffrey M., 2003. "Further results on instrumental variables estimation of average treatment effects in the correlated random coefficient model," Economics Letters, Elsevier, vol. 79(2), pages 185-191, May.
    30. Heckman, James J, 1990. "Varieties of Selection Bias," American Economic Review, American Economic Association, vol. 80(2), pages 313-318, May.
    31. Bronars, Stephen G & Grogger, Jeff, 1994. "The Economic Consequences of Unwed Motherhood: Using Twin Births as a Natural Experiment," American Economic Review, American Economic Association, vol. 84(5), pages 1141-1156, December.
    32. Chamberlain, Gary, 1987. "Asymptotic efficiency in estimation with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 34(3), pages 305-334, March.
    33. Joshua D. Angrist, 1991. "Instrumental Variables Estimation of Average Treatment Effects in Econometrics and Epidemiology," NBER Technical Working Papers 0115, National Bureau of Economic Research, Inc.
    34. Angrist, Joshua D, 2001. "Estimations of Limited Dependent Variable Models with Dummy Endogenous Regressors: Simple Strategies for Empirical Practice: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(1), pages 27-28, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Huber, Martin & Wüthrich, Kaspar, 2017. "Evaluating local average and quantile treatment effects under endogeneity based on instruments: a review," FSES Working Papers 479, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    3. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    4. Committee, Nobel Prize, 2021. "Answering causal questions using observational data," Nobel Prize in Economics documents 2021-2, Nobel Prize Committee.
    5. Guillermo Cruces & Sebastian Galiani, 2003. "Generalizing the Causal Effect of Fertility on Female Labor Supply," Labor and Demography 0310002, University Library of Munich, Germany.
    6. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    7. Imbens, Guido W., 2014. "Instrumental Variables: An Econometrician's Perspective," IZA Discussion Papers 8048, Institute of Labor Economics (IZA).
    8. Guido W. Imbens & Whitney K. Newey, 2009. "Identification and Estimation of Triangular Simultaneous Equations Models Without Additivity," Econometrica, Econometric Society, vol. 77(5), pages 1481-1512, September.
    9. Black, Dan A. & Joo, Joonhwi & LaLonde, Robert & Smith, Jeffrey A. & Taylor, Evan J., 2022. "Simple Tests for Selection: Learning More from Instrumental Variables," Labour Economics, Elsevier, vol. 79(C).
    10. Kaspar Wüthrich, 2020. "A Comparison of Two Quantile Models With Endogeneity," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(2), pages 443-456, April.
    11. Joshua Angrist & Ivan Fernandez-Val, 2010. "ExtrapoLATE-ing: External Validity and Overidentification in the LATE Framework," NBER Working Papers 16566, National Bureau of Economic Research, Inc.
    12. Sloczynski, Tymon, 2018. "A General Weighted Average Representation of the Ordinary and Two-Stage Least Squares Estimands," IZA Discussion Papers 11866, Institute of Labor Economics (IZA).
    13. Aassve, Arnstein & Arpino, Bruno, 2008. "Estimation of causal effects of fertility on economic wellbeing: evidence from rural Vietnam," ISER Working Paper Series 2007-27, Institute for Social and Economic Research.
    14. Markus Frölich & Martin Huber, 2017. "Direct and indirect treatment effects–causal chains and mediation analysis with instrumental variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1645-1666, November.
    15. Pereda-Fernández, Santiago, 2023. "Identification and estimation of triangular models with a binary treatment," Journal of Econometrics, Elsevier, vol. 234(2), pages 585-623.
    16. John DiNardo & David S. Lee, 2010. "Program Evaluation and Research Designs," Working Papers 1228, Princeton University, Department of Economics, Industrial Relations Section..
    17. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    18. Mustafa Özer & Jan Fidrmuc & Mehmet Ali Eryurt, 2018. "Maternal education and childhood immunization in Turkey," Health Economics, John Wiley & Sons, Ltd., vol. 27(8), pages 1218-1229, August.
    19. DiNardo, John & Lee, David S., 2011. "Program Evaluation and Research Designs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 5, pages 463-536, Elsevier.
    20. Priebe, Jan, 2011. "Child Costs and the Causal Effect of Fertility on Female Labor Supply: An investigation for Indonesia 1993-2008," Proceedings of the German Development Economics Conference, Berlin 2011 67, Verein für Socialpolitik, Research Committee Development Economics.

    More about this item

    JEL classification:

    • C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models
    • J12 - Labor and Demographic Economics - - Demographic Economics - - - Marriage; Marital Dissolution; Family Structure

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:9708. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.