IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1901.02991.html
   My bibliography  Save this paper

Estimating population average treatment effects from experiments with noncompliance

Author

Listed:
  • Kellie Ottoboni
  • Jason Poulos

Abstract

Randomized control trials (RCTs) are the gold standard for estimating causal effects, but often use samples that are non-representative of the actual population of interest. We propose a reweighting method for estimating population average treatment effects in settings with noncompliance. Simulations show the proposed compliance-adjusted population estimator outperforms its unadjusted counterpart when compliance is relatively low and can be predicted by observed covariates. We apply the method to evaluate the effect of Medicaid coverage on health care use for a target population of adults who may benefit from expansions to the Medicaid program. We draw RCT data from the Oregon Health Insurance Experiment, where less than one-third of those randomly selected to receive Medicaid benefits actually enrolled.

Suggested Citation

  • Kellie Ottoboni & Jason Poulos, 2019. "Estimating population average treatment effects from experiments with noncompliance," Papers 1901.02991, arXiv.org, revised Aug 2020.
  • Handle: RePEc:arx:papers:1901.02991
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1901.02991
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Amanda Kowalski, 2016. "Doing more when you're running LATE: Applying marginal treatment effect methods to examine treatment effect heterogeneity in experiments," Artefactual Field Experiments 00560, The Field Experiments Website.
    2. Kolstad, Jonathan T. & Kowalski, Amanda E., 2012. "The impact of health care reform on hospital and preventive care: Evidence from Massachusetts," Journal of Public Economics, Elsevier, vol. 96(11), pages 909-929.
    3. Amy Finkelstein & Sarah Taubman & Bill Wright & Mira Bernstein & Jonathan Gruber & Joseph P. Newhouse & Heidi Allen & Katherine Baicker, 2012. "The Oregon Health Insurance Experiment: Evidence from the First Year," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(3), pages 1057-1106.
    4. Robert Tibshirani & Jacob Bien & Jerome Friedman & Trevor Hastie & Noah Simon & Jonathan Taylor & Ryan J. Tibshirani, 2012. "Strong rules for discarding predictors in lasso‐type problems," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(2), pages 245-266, March.
    5. Kosuke Imai & Gary King & Elizabeth A. Stuart, 2008. "Misunderstandings between experimentalists and observationalists about causal inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(2), pages 481-502, April.
    6. Miller, Sarah, 2012. "The effect of insurance on emergency room visits: An analysis of the 2006 Massachusetts health reform," Journal of Public Economics, Elsevier, vol. 96(11), pages 893-908.
    7. Kosuke Imai & Dustin Tingley & Teppei Yamamoto, 2013. "Experimental designs for identifying causal mechanisms," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(1), pages 5-51, January.
    8. Katherine Baicker & Amy Finkelstein & Jae Song & Sarah Taubman, 2014. "The Impact of Medicaid on Labor Market Activity and Program Participation: Evidence from the Oregon Health Insurance Experiment," American Economic Review, American Economic Association, vol. 104(5), pages 322-328, May.
    9. Elizabeth A. Stuart & Stephen R. Cole & Catherine P. Bradshaw & Philip J. Leaf, 2011. "The use of propensity scores to assess the generalizability of results from randomized trials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(2), pages 369-386, April.
    10. Erin Hartman & Richard Grieve & Roland Ramsahai & Jasjeet S. Sekhon, 2015. "From sample average treatment effect to population average treatment effect on the treated: combining experimental with observational studies to estimate population treatment effects," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(3), pages 757-778, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ottoboni Kellie N. & Poulos Jason V., 2020. "Estimating population average treatment effects from experiments with noncompliance," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 108-130, January.
    2. Charles Courtemanche & James Marton & Benjamin Ukert & Aaron Yelowitz & Daniela Zapata, 2018. "Early Effects of the Affordable Care Act on Health Care Access, Risky Health Behaviors, and Self‐Assessed Health," Southern Economic Journal, John Wiley & Sons, vol. 84(3), pages 660-691, January.
    3. Thomas Buchmueller & John C. Ham & Lara D. Shore-Sheppard, 2015. "The Medicaid Program," NBER Chapters, in: Economics of Means-Tested Transfer Programs in the United States, Volume 1, pages 21-136, National Bureau of Economic Research, Inc.
    4. Dunn, Abe & Shapiro, Adam Hale, 2015. "Physician payments under health care reform," Journal of Health Economics, Elsevier, vol. 39(C), pages 89-105.
    5. Péter Elek & Tamás Molnár & Balázs Váradi, 2019. "The closer the better: does better access to outpatient care prevent hospitalization?," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(6), pages 801-817, August.
    6. Lindsay M. Sabik & Cathy J. Bradley, 2016. "The Impact of Near‐Universal Insurance Coverage on Breast and Cervical Cancer Screening: Evidence from Massachusetts," Health Economics, John Wiley & Sons, Ltd., vol. 25(4), pages 391-407, April.
    7. Barbaresco, Silvia & Courtemanche, Charles J. & Qi, Yanling, 2015. "Impacts of the Affordable Care Act dependent coverage provision on health-related outcomes of young adults," Journal of Health Economics, Elsevier, vol. 40(C), pages 54-68.
    8. Akosa Antwi, Yaa & Moriya, Asako S. & Simon, Kosali I., 2015. "Access to health insurance and the use of inpatient medical care: Evidence from the Affordable Care Act young adult mandate," Journal of Health Economics, Elsevier, vol. 39(C), pages 171-187.
    9. Mark Duggan & Gopi Shah Goda & Emilie Jackson, 2019. "The Effects of the Affordable Care Act on Health Insurance Coverage and Labor Market Outcomes," National Tax Journal, National Tax Association;National Tax Journal, vol. 72(2), pages 261-322, June.
    10. Maclean, Johanna Catherine & Tello-Trillo, Sebastian & Webber, Douglas, 2023. "Losing insurance and psychiatric hospitalizations," Journal of Economic Behavior & Organization, Elsevier, vol. 205(C), pages 508-527.
    11. Charles Courtemanche & James Marton & Benjamin Ukert & Aaron Yelowitz & Daniela Zapata, 2019. "Effects of the Affordable Care Act on Health Behaviors After 3 Years," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 45(1), pages 7-33, January.
    12. Courtemanche, Charles & Marton, James & Ukert, Benjamin & Yelowitz, Aaron & Zapata, Daniela, 2018. "Effects of the Affordable Care Act on Health Behaviors after Three Years," IZA Discussion Papers 11468, Institute of Labor Economics (IZA).
    13. Chad Cotti & Erik Nesson & Nathan Tefft, 2019. "Impacts of the ACA Medicaid expansion on health behaviors: Evidence from household panel data," Health Economics, John Wiley & Sons, Ltd., vol. 28(2), pages 219-244, February.
    14. Maclean, J. Catherine & Tello-Trillo, Sebastian & Webber, Douglas A., 2019. "Losing Insurance and Behavioral Health Hospitalizations: Evidence from a Large-Scale Medicaid Disenrollment," IZA Discussion Papers 12463, Institute of Labor Economics (IZA).
    15. Marguerite Burns & Laura Dague, 2023. "In-Kind Welfare Benefits and Reincarceration Risk: Evidence from Medicaid," NBER Working Papers 31394, National Bureau of Economic Research, Inc.
    16. Sebastian Tello Trillo & Ausmita Ghosh & Kosali Simon & Johanna Catherine Maclean, 2015. "Losing Medicaid: What happens to hospitalizations?," NBER Working Papers 21580, National Bureau of Economic Research, Inc.
    17. Marcus Dillender, 2017. "English Skills and the Health Insurance Coverage of Immigrants," American Journal of Health Economics, University of Chicago Press, vol. 3(3), pages 312-345, Summer.
    18. Thomas Buchmueller & Sarah Miller & Marko Vujicic, 2016. "How Do Providers Respond to Changes in Public Health Insurance Coverage? Evidence from Adult Medicaid Dental Benefits," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 70-102, November.
    19. Isaiah Andrews & Emily Oster, 2017. "A Simple Approximation for Evaluating External Validity Bias," NBER Working Papers 23826, National Bureau of Economic Research, Inc.
    20. Kaestner, Robert & Sasso, Anthony T. Lo, 2015. "Does seeing the doctor more often keep you out of the hospital?," Journal of Health Economics, Elsevier, vol. 39(C), pages 259-272.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1901.02991. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.