IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/23603.html
   My bibliography  Save this paper

Individual Results May Vary: Elementary Analytics of Inequality-Probability Bounds, with Applications to Health-Outcome Treatment Effects

Author

Listed:
  • John Mullahy

Abstract

While many results from the treatment-effect and related literatures are familiar and have been applied productively in health economics evaluations, other potentially useful results from those literatures have had little influence on health economics practice. With the intent of demonstrating the value and use of some such results in health economics applications, this paper focuses on one particular class of parameters that describe probabilities that one outcome is larger or smaller than other outcomes, namely inequality probabilities. While the properties of such parameters have been explored in the technical literature, they have scarcely been considered in informing practical questions in health evaluations. This paper discusses how such probabilities can be used informatively, and describes how they might be identified or bounded given standard sampling assumptions and information only on marginal distributions of outcomes. Graphical and algebraic exposition reveals the logic supporting these results, as well as their empirical implementation, to be quite straightforward. Applications to health outcome evaluations are presented and discussed throughout.

Suggested Citation

  • John Mullahy, 2017. "Individual Results May Vary: Elementary Analytics of Inequality-Probability Bounds, with Applications to Health-Outcome Treatment Effects," NBER Working Papers 23603, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:23603
    Note: EH
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w23603.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 487-535.
    2. Joshua D. Angrist, 2004. "Treatment effect heterogeneity in theory and practice," Economic Journal, Royal Economic Society, vol. 114(494), pages 52-83, March.
    3. Myoung‐jae Lee, 2000. "Median treatment effect in randomized trials," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(3), pages 595-604.
    4. Aaron A. Stinnett & John Mullahy, 1998. "Net Health Benefits," Medical Decision Making, , vol. 18(2_suppl), pages 68-80, April.
    5. Coate, Stephen, 2000. "An Efficiency Approach to the Evaluation of Policy Changes," Economic Journal, Royal Economic Society, vol. 110(463), pages 437-455, April.
    6. Charles F. Manski, 1996. "Learning about Treatment Effects from Experiments with Random Assignment of Treatments," Journal of Human Resources, University of Wisconsin Press, vol. 31(4), pages 709-733.
    7. Susan Athey & Guido W. Imbens, 2006. "Identification and Inference in Nonlinear Difference-in-Differences Models," Econometrica, Econometric Society, vol. 74(2), pages 431-497, March.
    8. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2006. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," American Economic Review, American Economic Association, vol. 96(4), pages 988-1012, September.
    9. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    10. Bijan J. Borah & Marguerite E. Burns & Nilay D. Shah, 2011. "Assessing the impact of high deductible health plans on health‐care utilization and cost: a changes‐in‐changes approach," Health Economics, John Wiley & Sons, Ltd., vol. 20(9), pages 1025-1042, September.
    11. Aaron A. Stinnett & John Mullahy, 1998. "Net Health Benefits: A New Framework for the Analysis of Uncertainty in Cost-Effectiveness Analysis," NBER Technical Working Papers 0227, National Bureau of Economic Research, Inc.
    12. Donald W. K. Andrews, 1997. "A Conditional Kolmogorov Test," Econometrica, Econometric Society, vol. 65(5), pages 1097-1128, September.
    13. A. Colin Cameron & Tong Li & Pravin K. Trivedi & David M. Zimmer, 2004. "Modelling the differences in counted outcomes using bivariate copula models with application to mismeasured counts," Econometrics Journal, Royal Economic Society, vol. 7(2), pages 566-584, December.
    14. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    15. Yanqin Fan & Robert Sherman & Matthew Shum, 2014. "Identifying Treatment Effects Under Data Combination," Econometrica, Econometric Society, vol. 82(2), pages 811-822, March.
    16. Fan, Yanqin & Park, Sang Soo, 2012. "Confidence intervals for the quantile of treatment effects in randomized experiments," Journal of Econometrics, Elsevier, vol. 167(2), pages 330-344.
    17. Abadie A., 2002. "Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 284-292, March.
    18. Heckman, James, 2001. "Accounting for Heterogeneity, Diversity and General Equilibrium in Evaluating Social Programmes," Economic Journal, Royal Economic Society, vol. 111(475), pages 654-699, November.
    19. Tamer, Elie, 2010. "Partial Identification in Econometrics," Scholarly Articles 34728615, Harvard University Department of Economics.
    20. Jacob, Johanna & Lundin, Douglas, 2005. "A median voter model of health insurance with ex post moral hazard," Journal of Health Economics, Elsevier, vol. 24(2), pages 407-426, March.
    21. Yannis Bilias & Roger Koenker, 2001. "Quantile regression for duration data: A reappraisal of the Pennsylvania Reemployment Bonus Experiments," Empirical Economics, Springer, vol. 26(1), pages 199-220.
    22. Tat Y. Chan & Barton H. Hamilton, 2006. "Learning, Private Information, and the Economic Evaluation of Randomized Experiments," Journal of Political Economy, University of Chicago Press, vol. 114(6), pages 997-1040, December.
    23. Elisabeth Fenwick & Bernie J. O'Brien & Andrew Briggs, 2004. "Cost‐effectiveness acceptability curves – facts, fallacies and frequently asked questions," Health Economics, John Wiley & Sons, Ltd., vol. 13(5), pages 405-415, May.
    24. Abbring, Jaap H. & Heckman, James J., 2007. "Econometric Evaluation of Social Programs, Part III: Distributional Treatment Effects, Dynamic Treatment Effects, Dynamic Discrete Choice, and General Equilibrium Policy Evaluation," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 72, Elsevier.
    25. A. Colin Cameron & Tong Li & Pravin K. Trivedi & David M. Zimmer, 2004. "Modelling the differences in counted outcomes using bivariate copula models with application to mismeasured counts," Econometrics Journal, Royal Economic Society, vol. 7(2), pages 566-584, December.
    26. Fan, Yanqin & Guerre, Emmanuel & Zhu, Dongming, 2017. "Partial identification of functionals of the joint distribution of “potential outcomes”," Journal of Econometrics, Elsevier, vol. 197(1), pages 42-59.
    27. Denuit, Michel & Lefevre, Claude & Utev, Sergey, 2002. "Measuring the impact of dependence between claims occurrences," Insurance: Mathematics and Economics, Elsevier, vol. 30(1), pages 1-19, February.
    28. Fan, Yanqin & Park, Sang Soo, 2010. "Sharp Bounds On The Distribution Of Treatment Effects And Their Statistical Inference," Econometric Theory, Cambridge University Press, vol. 26(3), pages 931-951, June.
    29. Elisabeth R. Gerber & Jeffrey B. Lewis, 2004. "Beyond the Median: Voter Preferences, District Heterogeneity, and Political Representation," Journal of Political Economy, University of Chicago Press, vol. 112(6), pages 1364-1383, December.
    30. Anirban Basu & James J. Heckman & Salvador Navarro-Lozano & Sergio Urzua, 2007. "Use of instrumental variables in the presence of heterogeneity and self-selection: an application to treatments of breast cancer patients," Health Economics, John Wiley & Sons, Ltd., vol. 16(11), pages 1133-1157.
    31. Jason Abrevaya, 2000. "Testing for a treatment effect in a heterogeneous population: A modified sign-test statistic and a leapfrog statistic," Journal of Applied Statistics, Taylor & Francis Journals, vol. 27(6), pages 679-687.
    32. Aakvik, Arild & Heckman, James J. & Vytlacil, Edward J., 2005. "Estimating treatment effects for discrete outcomes when responses to treatment vary: an application to Norwegian vocational rehabilitation programs," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 15-51.
    33. Myoung‐Jae Lee & Satoru Kobayashi, 2001. "Proportional treatment effects for count response panel data: effects of binary exercise on health care demand," Health Economics, John Wiley & Sons, Ltd., vol. 10(5), pages 411-428, July.
    34. Elie Tamer, 2010. "Partial Identification in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 167-195, September.
    35. Ben A. Van Hout & Maiwenn J. Al & Gilad S. Gordon & Frans F. H. Rutten, 1994. "Costs, effects and C/E‐ratios alongside a clinical trial," Health Economics, John Wiley & Sons, Ltd., vol. 3(5), pages 309-319, September.
    36. Allison, R. Andrew & Foster, James E., 2004. "Measuring health inequality using qualitative data," Journal of Health Economics, Elsevier, vol. 23(3), pages 505-524, May.
    37. A. Atkinson, 2003. "Multidimensional Deprivation: Contrasting Social Welfare and Counting Approaches," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 1(1), pages 51-65, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mullahy, John, 2018. "Individual results may vary: Inequality-probability bounds for some health-outcome treatment effects," Journal of Health Economics, Elsevier, vol. 61(C), pages 151-162.
    2. Firpo, Sergio & Galvao, Antonio F. & Parker, Thomas, 2023. "Uniform inference for value functions," Journal of Econometrics, Elsevier, vol. 235(2), pages 1680-1699.
    3. Callaway, Brantly, 2021. "Bounds on distributional treatment effect parameters using panel data with an application on job displacement," Journal of Econometrics, Elsevier, vol. 222(2), pages 861-881.
    4. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    5. David J. Vanness & John Mullahy, 2012. "Moving Beyond Mean-based Evaluation of Health Care," Chapters, in: Andrew M. Jones (ed.), The Elgar Companion to Health Economics, Second Edition, chapter 52, Edward Elgar Publishing.
    6. Wenlong Ji & Lihua Lei & Asher Spector, 2023. "Model-Agnostic Covariate-Assisted Inference on Partially Identified Causal Effects," Papers 2310.08115, arXiv.org, revised Nov 2024.
    7. Sungwon Lee, 2024. "Partial identification and inference for conditional distributions of treatment effects," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(1), pages 107-127, January.
    8. Fan, Yanqin & Guerre, Emmanuel & Zhu, Dongming, 2017. "Partial identification of functionals of the joint distribution of “potential outcomes”," Journal of Econometrics, Elsevier, vol. 197(1), pages 42-59.
    9. Battistin, Erich & Lamarche, Carlos & Rettore, Enrico, 2020. "Quantiles of the Gain Distribution of an Early Childhood Intervention," IZA Discussion Papers 13101, Institute of Labor Economics (IZA).
    10. Sungwon Lee, 2021. "Partial Identification and Inference for Conditional Distributions of Treatment Effects," Papers 2108.00723, arXiv.org, revised Nov 2023.
    11. Yanqin Fan & Sang Soo Park, 2009. "Partial identification of the distribution of treatment effects and its confidence sets," Advances in Econometrics, in: Nonparametric Econometric Methods, pages 3-70, Emerald Group Publishing Limited.
    12. Bedoya Arguelles,Guadalupe & Bittarello,Luca & Davis,Jonathan Martin Villars & Mittag,Nikolas Karl & Bedoya Arguelles,Guadalupe & Bittarello,Luca & Davis,Jonathan Martin Villars & Mittag,Nikolas Karl, 2017. "Distributional impact analysis: toolkit and illustrations of impacts beyond the average treatment effect," Policy Research Working Paper Series 8139, The World Bank.
    13. Paul. B. Kenfac Dongmezo & P. N. Mwita & I. R. Kamga Tchwaket, 2018. "Distributive and Quantile Treatment Effects: Imputation Based Estimators Approach," Journal of Statistical and Econometric Methods, SCIENPRESS Ltd, vol. 7(2), pages 1-3.
    14. John Mullahy, 2020. "Discovering Treatment Effectiveness via Median Treatment Effects—Applications to COVID-19 Clinical Trials," NBER Working Papers 27895, National Bureau of Economic Research, Inc.
    15. Pablo Lavado & Gonzalo Rivera, 2016. "Identifying Treatment Effects with Data Combination and Unobserved Heterogeneity," Working Papers 79, Peruvian Economic Association.
    16. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    17. Sung Jae Jun & Sokbae Lee, 2023. "Identifying the Effect of Persuasion," Journal of Political Economy, University of Chicago Press, vol. 131(8), pages 2032-2058.
    18. Lina Zhang & David T. Frazier & D. S. Poskitt & Xueyan Zhao, 2020. "Decomposing Identification Gains and Evaluating Instrument Identification Power for Partially Identified Average Treatment Effects," Papers 2009.02642, arXiv.org, revised Sep 2022.
    19. Jones A.M & Rice N, 2009. "Econometric Evaluation of Health Policies," Health, Econometrics and Data Group (HEDG) Working Papers 09/09, HEDG, c/o Department of Economics, University of York.
    20. James J. Heckman, 2008. "The Principles Underlying Evaluation Estimators with an Application to Matching," Annals of Economics and Statistics, GENES, issue 91-92, pages 9-73.

    More about this item

    JEL classification:

    • I1 - Health, Education, and Welfare - - Health

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:23603. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.