IDEAS home Printed from https://ideas.repec.org/p/nbr/nberte/0261.html
   My bibliography  Save this paper

Bootstrap Tests for the Effect of a Treatment on the Distribution of an Outcome Variable

Author

Listed:
  • Alberto Abadie

Abstract

This paper considers the problem of assessing the distributional consequences of a treatment on some outcome variable of interest when treatment intake is (possibly) non-randomized but there is a binary instrument available for the researcher. Such scenario is common in observational studies and in randomized experiments with imperfect compliance. One possible approach to this problem is to compare the counterfactual cumulative distribution functions of the outcome with and without the treatment. Here, it is shown how to estimate these distributions using instrumental variable methods and a simple bootstrap procedure is proposed to test distributional hypotheses, such as equality of distributions, first-order stochastic dominance and second order stochastic dominance. These tests and estimators are applied to the study of the effects of veteran status on the distribution of civilian earnings. The results show a negative effect of military service in Vietnam that appears to be concentrated on the lower tail of the distribution of earnings. First order stochastic dominance cannot be rejected by the data.

Suggested Citation

  • Alberto Abadie, 2000. "Bootstrap Tests for the Effect of a Treatment on the Distribution of an Outcome Variable," NBER Technical Working Papers 0261, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberte:0261
    Note: TWP LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/t0261.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," American Economic Review, American Economic Association, vol. 80(3), pages 313-336, June.
    2. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    3. Joshua D. Angrist & Alan B. Krueger, 1993. "Split Sample Instrumental Variables," Working Papers 699, Princeton University, Department of Economics, Industrial Relations Section..
    4. Foster, James E & Shorrocks, Anthony F, 1988. "Poverty Orderings," Econometrica, Econometric Society, vol. 56(1), pages 173-177, January.
    5. Atkinson, Anthony B., 1970. "On the measurement of inequality," Journal of Economic Theory, Elsevier, vol. 2(3), pages 244-263, September.
    6. Joshua D. Angrist & Guido W. Imbens & D.B. Rubin, 1993. "Identification of Causal Effects Using Instrumental Variables," NBER Technical Working Papers 0136, National Bureau of Economic Research, Inc.
    7. Donald W. K. Andrews, 1997. "A Conditional Kolmogorov Test," Econometrica, Econometric Society, vol. 65(5), pages 1097-1128, September.
    8. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
    9. Angrist, Joshua D & Krueger, Alan B, 1995. "Split-Sample Instrumental Variables Estimates of the Return to Schooling," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(2), pages 225-235, April.
    10. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records: Errata," American Economic Review, American Economic Association, vol. 80(5), pages 1284-1286, December.
    11. Anderson, Gordon, 1996. "Nonparametric Tests of Stochastic Dominance in Income Distributions," Econometrica, Econometric Society, vol. 64(5), pages 1183-1193, September.
    12. Guido W. Imbens & Donald B. Rubin, 1997. "Estimating Outcome Distributions for Compliers in Instrumental Variables Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 555-574.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alberto Abadie, 2000. "Semiparametric Estimation of Instrumental Variable Models for Causal Effects," NBER Technical Working Papers 0260, National Bureau of Economic Research, Inc.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joshua D. Angrist & Stacey H. Chen, 2007. "Long-term consequences of vietnam-era conscription: schooling, experience, and earnings," NBER Working Papers 13411, National Bureau of Economic Research, Inc.
    2. Sun, Zhenting, 2023. "Instrument validity for heterogeneous causal effects," Journal of Econometrics, Elsevier, vol. 237(2).
    3. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    4. Lee, Jinhyun, 2013. "Sharp Bounds on Heterogeneous Individual Treatment Responses," SIRE Discussion Papers 2013-89, Scottish Institute for Research in Economics (SIRE).
    5. Joshua D. Angrist & Alan B. Krueger, 2001. "Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 69-85, Fall.
    6. Maasoumi, Esfandiar & Millimet, Daniel & Sarkar, Dipanwita, 2005. "The Distribution of Returns to Marriage," Departmental Working Papers 0503, Southern Methodist University, Department of Economics.
    7. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    8. Paul A. Bekker & Jan van der Ploeg, 2000. "Instrumental Variable Estimation Based on Grouped Data," Econometric Society World Congress 2000 Contributed Papers 1862, Econometric Society.
    9. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    10. Imbens, Guido W., 2014. "Instrumental Variables: An Econometrician's Perspective," IZA Discussion Papers 8048, Institute of Labor Economics (IZA).
    11. Eric Maurin & Theodora Xenogiani, 2007. "Demand for Education and Labor Market Outcomes: Lessons from the Abolition of Compulsory Conscription in France," Journal of Human Resources, University of Wisconsin Press, vol. 42(4).
    12. Ploeg, Jan van der & Bekker, Paul A., 1995. "Efficiency bounds for instrumental variable estimators under group-asymptotics," Research Report 95B24, University of Groningen, Research Institute SOM (Systems, Organisations and Management).
    13. Angrist, Joshua & Kolesár, Michal, 2024. "One instrument to rule them all: The bias and coverage of just-ID IV," Journal of Econometrics, Elsevier, vol. 240(2).
    14. Xintong Wang & Carlos A. Flores & Alfonso Flores-Lagunes, 2020. "The Effects of Vietnam-Era Military Service on the Long-Term Health of Veterans: A Bounds Analysis," Center for Policy Research Working Papers 234, Center for Policy Research, Maxwell School, Syracuse University.
    15. Joshua D. Angrist, 2022. "Empirical Strategies in Economics: Illuminating the Path From Cause to Effect," Econometrica, Econometric Society, vol. 90(6), pages 2509-2539, November.
    16. Jeffrey R. Kling, 2006. "Incarceration Length, Employment, and Earnings," American Economic Review, American Economic Association, vol. 96(3), pages 863-876, June.
    17. Kaspar Wüthrich, 2020. "A Comparison of Two Quantile Models With Endogeneity," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(2), pages 443-456, April.
    18. Bekker, Paul A. & Ploeg, Jan van der, 2000. "Instrumental variable estimation based on grouped data," CCSO Working Papers 200009, University of Groningen, CCSO Centre for Economic Research.
    19. Xintong Wang & Alfonso Flores-Lagunes, 2022. "Conscription and Military Service: Do They Result in Future Violent and Nonviolent Incarcerations and Recidivism?," Journal of Human Resources, University of Wisconsin Press, vol. 57(5), pages 1715-1757.
    20. John Engberg & Dennis Epple & Jason Imbrogno & Holger Sieg & Ron Zimmer, 2009. "Estimation of Causal Effects in Experiments with Multiple Sources of Noncompliance," NBER Working Papers 14842, National Bureau of Economic Research, Inc.

    More about this item

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberte:0261. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.