IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/25307.html
   My bibliography  Save this paper

Treatment Effects with Multiple Outcomes

Author

Listed:
  • John Mullahy

Abstract

This paper proposes strategies for defining, identifying, and estimating features of treatment-effect distributions in contexts where multiple outcomes are of interest. After describing existing empirical approaches used in such settings, the paper develops a notion of treatment preference that is shown to be a feature of standard treatment-effect analysis in the single-outcome case. Focusing largely on binary outcomes, treatment-preference probability treatment effects (PTEs) are defined and are seen to correspond to familiar average treatment effects in the single-outcome case. The paper suggests seven possible characterizations of treatment preference appropriate to multiple-outcome contexts. Under standard assumptions about unconfoundedness of treatment assignment, the PTEs are shown to be point identified for three of the seven characterizations and set identified for the other four. Probability bounds are derived and empirical approaches to estimating the bounds—or the PTEs themselves in the point-identified cases—are suggested. These empirical approaches are straightforward, involving in most instances little more than estimation of binary-outcome probability models of what are commonly known as composite outcomes. The results are illustrated with simulated data and in analyses of two microdata samples. Finally, the main results are extended to situations where the component outcomes are ordered or categorical.

Suggested Citation

  • John Mullahy, 2018. "Treatment Effects with Multiple Outcomes," NBER Working Papers 25307, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:25307
    Note: EH
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w25307.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Victor Chernozhukov & Sokbae Lee & Adam M. Rosen, 2013. "Intersection Bounds: Estimation and Inference," Econometrica, Econometric Society, vol. 81(2), pages 667-737, March.
    2. Brigham R. Frandsen & Lars J. Lefgren, 2018. "Partial Identification of the Distribution of Treatment Effects with an Application to the Knowledge Is Power Program (KIPP)," NBER Working Papers 24616, National Bureau of Economic Research, Inc.
    3. Susan Athey & Raj Chetty & Guido Imbens & Hyunseung Kang, 2016. "Estimating Treatment Effects using Multiple Surrogates: The Role of the Surrogate Score and the Surrogate Index," Papers 1603.09326, arXiv.org, revised Aug 2024.
    4. Sisira Sarma & Rose Anne Devlin & Jason Gilliland & M. Karen Campbell & Gregory S. Zaric, 2015. "The Effect of Leisure‐Time Physical Activity on Obesity, Diabetes, High BP and Heart Disease Among Canadians: Evidence from 2000/2001 to 2005/2006," Health Economics, John Wiley & Sons, Ltd., vol. 24(12), pages 1531-1547, December.
    5. Geronimus, A.T. & Hicken, M. & Keene, D. & Bound, J., 2006. ""Weathering" and age patterns of allostatic load scores among blacks and whites in the United States," American Journal of Public Health, American Public Health Association, vol. 96(5), pages 826-833.
    6. Charles F. Manski, 2018. "Reasonable patient care under uncertainty," Health Economics, John Wiley & Sons, Ltd., vol. 27(10), pages 1397-1421, October.
    7. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    8. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    9. Charles F. Manski, 2018. "Response to commentaries on “Reasonable patient care under uncertainty”," Health Economics, John Wiley & Sons, Ltd., vol. 27(10), pages 1431-1434, October.
    10. Mullahy, John, 2018. "Individual results may vary: Inequality-probability bounds for some health-outcome treatment effects," Journal of Health Economics, Elsevier, vol. 61(C), pages 151-162.
    11. Hilary Hoynes & Doug Miller & David Simon, 2015. "Income, the Earned Income Tax Credit, and Infant Health," American Economic Journal: Economic Policy, American Economic Association, vol. 7(1), pages 172-211, February.
    12. C. Kirabo Jackson, 2018. "What Do Test Scores Miss? The Importance of Teacher Effects on Non–Test Score Outcomes," Journal of Political Economy, University of Chicago Press, vol. 126(5), pages 2072-2107.
    13. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, July.
    14. Charles F. Manski & John V. Pepper, 2000. "Monotone Instrumental Variables, with an Application to the Returns to Schooling," Econometrica, Econometric Society, vol. 68(4), pages 997-1012, July.
    15. Charles F. Manski & Aleksey Tetenov, 2019. "Trial Size for Near-Optimal Choice Between Surveillance and Aggressive Treatment: Reconsidering MSLT-II," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 305-311, March.
    16. Brian Nolan & Christopher T. Whelan, 2010. "Using non-monetary deprivation indicators to analyze poverty and social exclusion: Lessons from Europe?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 29(2), pages 305-325.
    17. Nancy J. Devlin & Koonal K. Shah & Yan Feng & Brendan Mulhern & Ben van Hout, 2018. "Valuing health‐related quality of life: An EQ‐5D‐5L value set for England," Health Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 7-22, January.
    18. Duncan, Greg J. & Katz, Lawrence F. & Kessler, Ronald & Kling, Jeffrey R. & Gennetian, Lisa & Adam, Emma & Ludwig, Jens & Sanbonmatsu, Lisa & Tessler, Stacy & McDade, Thomas W. & Whitaker, Robert C., 2011. "Neighborhoods, Obesity and Diabetes –-- A Randomized Social Experiment," Scholarly Articles 8642951, Harvard University Department of Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. John Mullahy, 2019. "Health and evidence in health economics," Health Economics, John Wiley & Sons, Ltd., vol. 28(10), pages 1163-1165, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francesca Molinari, 2020. "Microeconometrics with Partial Identification," Papers 2004.11751, arXiv.org.
    2. Sung Jae Jun & Sokbae Lee, 2023. "Identifying the Effect of Persuasion," Journal of Political Economy, University of Chicago Press, vol. 131(8), pages 2032-2058.
    3. Neil Christy & A. E. Kowalski, 2024. "Starting Small: Prioritizing Safety over Efficacy in Randomized Experiments Using the Exact Finite Sample Likelihood," Papers 2407.18206, arXiv.org.
    4. John Mullahy, 2021. "Discovering treatment effectiveness via median treatment effects—Applications to COVID‐19 clinical trials," Health Economics, John Wiley & Sons, Ltd., vol. 30(5), pages 1050-1069, May.
    5. Ting Ye & Luke Keele & Raiden Hasegawa & Dylan S. Small, 2020. "A Negative Correlation Strategy for Bracketing in Difference-in-Differences," Papers 2006.02423, arXiv.org, revised Jun 2022.
    6. Francesca Molinari, 2019. "Econometrics with Partial Identification," CeMMAP working papers CWP25/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    7. German Blanco & Carlos A. Flores & Alfonso Flores-Lagunes, 2013. "Bounds on Average and Quantile Treatment Effects of Job Corps Training on Wages," Journal of Human Resources, University of Wisconsin Press, vol. 48(3), pages 659-701.
    8. Manski, Charles F., 2023. "Probabilistic prediction for binary treatment choice: With focus on personalized medicine," Journal of Econometrics, Elsevier, vol. 234(2), pages 647-663.
    9. Arun G. Chandrasekhar & Victor Chernozhukov & Francesca Molinari & Paul Schrimpf, 2019. "Best Linear Approximations to Set Identified Functions: With an Application to the Gender Wage Gap," NBER Working Papers 25593, National Bureau of Economic Research, Inc.
    10. Sungwon Lee, 2024. "Partial identification and inference for conditional distributions of treatment effects," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(1), pages 107-127, January.
    11. Ho, Kate & Rosen, Adam M., 2015. "Partial Identification in Applied Research: Benefits and Challenges," CEPR Discussion Papers 10883, C.E.P.R. Discussion Papers.
    12. Qian, Hang, 2011. "Bayesian inference with monotone instrumental variables," MPRA Paper 32672, University Library of Munich, Germany.
    13. Lukáš Lafférs, 2019. "Identification in Models with Discrete Variables," Computational Economics, Springer;Society for Computational Economics, vol. 53(2), pages 657-696, February.
    14. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    15. Tsunao Okumura & Emiko Usui, 2014. "Concave‐monotone treatment response and monotone treatment selection: With an application to the returns to schooling," Quantitative Economics, Econometric Society, vol. 5, pages 175-194, March.
    16. Imbens, Guido W., 2014. "Instrumental Variables: An Econometrician's Perspective," IZA Discussion Papers 8048, Institute of Labor Economics (IZA).
    17. Lee, Sokbae & Song, Kyungchul & Whang, Yoon-Jae, 2018. "Testing For A General Class Of Functional Inequalities," Econometric Theory, Cambridge University Press, vol. 34(5), pages 1018-1064, October.
    18. Victor Chernozhukov & Sokbae Lee & Adam M. Rosen, 2013. "Intersection Bounds: Estimation and Inference," Econometrica, Econometric Society, vol. 81(2), pages 667-737, March.
    19. Lina Zhang & David T. Frazier & D. S. Poskitt & Xueyan Zhao, 2020. "Decomposing Identification Gains and Evaluating Instrument Identification Power for Partially Identified Average Treatment Effects," Papers 2009.02642, arXiv.org, revised Sep 2022.
    20. Nicolas R. Ziebarth, 2018. "Social Insurance and Health," Contributions to Economic Analysis, in: Health Econometrics, volume 127, pages 57-84, Emerald Group Publishing Limited.

    More about this item

    JEL classification:

    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • D04 - Microeconomics - - General - - - Microeconomic Policy: Formulation; Implementation; Evaluation
    • I1 - Health, Education, and Welfare - - Health

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:25307. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.