IDEAS home Printed from https://ideas.repec.org/a/spr/alstar/v106y2022i3d10.1007_s10182-021-00427-3.html
   My bibliography  Save this article

Improving the causal treatment effect estimation with propensity scores by the bootstrap

Author

Listed:
  • Maeregu W. Arisido

    (University of Milano-Bicocca
    Eurac Research, Institute for Biomedicine)

  • Fulvia Mecatti

    (University of Milano-Bicocca)

  • Paola Rebora

    (University of Milano-Bicocca)

Abstract

When observational studies are used to establish the causal effects of treatments, the estimated effect is affected by treatment selection bias. The inverse propensity score weight (IPSW) is often used to deal with such bias. However, IPSW requires strong assumptions whose misspecifications and strategies to correct the misspecifications were rarely studied. We present a bootstrap bias correction of IPSW (BC-IPSW) to improve the performance of propensity score in dealing with treatment selection bias in the presence of failure to the ignorability and overlap assumptions. The approach was motivated by a real observational study to explore the potential of anticoagulant treatment for reducing mortality in patients with end-stage renal disease. The benefit of the treatment to enhance survival was demonstrated; the suggested BC-IPSW method indicated a statistically significant reduction in mortality for patients receiving the treatment. Using extensive simulations, we show that BC-IPSW substantially reduced the bias due to the misspecification of the ignorability and overlap assumptions. Further, we showed that IPSW is still useful to account for the lack of treatment randomization, but its advantages are stringently linked to the satisfaction of ignorability, indicating that the existence of relevant though unmeasured or unused covariates can worsen the selection bias.

Suggested Citation

  • Maeregu W. Arisido & Fulvia Mecatti & Paola Rebora, 2022. "Improving the causal treatment effect estimation with propensity scores by the bootstrap," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 106(3), pages 455-471, September.
  • Handle: RePEc:spr:alstar:v:106:y:2022:i:3:d:10.1007_s10182-021-00427-3
    DOI: 10.1007/s10182-021-00427-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10182-021-00427-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10182-021-00427-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Maeregu Woldeyes Arisido, 2016. "Functional measure of ozone exposure to model short‐term health effects," Environmetrics, John Wiley & Sons, Ltd., vol. 27(5), pages 306-317, August.
    2. Kim, Min Seong & Sun, Yixiao, 2016. "BOOTSTRAP AND k-STEP BOOTSTRAP BIAS CORRECTIONS FOR THE FIXED EFFECTS ESTIMATOR IN NONLINEAR PANEL DATA MODELS," Econometric Theory, Cambridge University Press, vol. 32(6), pages 1523-1568, December.
    3. Julien Worms & Rym Worms, 2018. "Extreme value statistics for censored data with heavy tails under competing risks," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 81(7), pages 849-889, October.
    4. O. Saarela & L. R. Belzile & D. A. Stephens, 2016. "A Bayesian view of doubly robust causal inference," Biometrika, Biometrika Trust, vol. 103(3), pages 667-681.
    5. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, October.
    6. Joffe, Marshall M. & Ten Have, Thomas R. & Feldman, Harold I. & Kimmel, Stephen E., 2004. "Model Selection, Confounder Control, and Marginal Structural Models: Review and New Applications," The American Statistician, American Statistical Association, vol. 58, pages 272-279, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christoph Breunig & Ruixuan Liu & Zhengfei Yu, 2022. "Double Robust Bayesian Inference on Average Treatment Effects," Papers 2211.16298, arXiv.org, revised Oct 2024.
    2. Ray Chambers & Setareh Ranjbar & Nicola Salvati & Barbara Pacini, 2022. "Weighting, informativeness and causal inference, with an application to rainfall enhancement," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(4), pages 1584-1612, October.
    3. Dimitris Bertsimas & Agni Orfanoudaki & Rory B. Weiner, 2020. "Personalized treatment for coronary artery disease patients: a machine learning approach," Health Care Management Science, Springer, vol. 23(4), pages 482-506, December.
    4. Clément de Chaisemartin & Jaime Ramirez-Cuellar, 2024. "At What Level Should One Cluster Standard Errors in Paired and Small-Strata Experiments?," American Economic Journal: Applied Economics, American Economic Association, vol. 16(1), pages 193-212, January.
    5. Clément de Chaisemartin & Luc Behaghel, 2020. "Estimating the Effect of Treatments Allocated by Randomized Waiting Lists," Econometrica, Econometric Society, vol. 88(4), pages 1453-1477, July.
    6. Bruno Ferman & Cristine Pinto & Vitor Possebom, 2020. "Cherry Picking with Synthetic Controls," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 510-532, March.
    7. Peydró, José-Luis & Jiménez, Gabriel & Kenan, Huremovic & Moral-Benito, Enrique & Vega-Redondo, Fernando, 2020. "Production and financial networks in interplay: Crisis evidence from supplier-customer and credit registers," CEPR Discussion Papers 15277, C.E.P.R. Discussion Papers.
    8. Marie Bjørneby & Annette Alstadsæter & Kjetil Telle, 2018. "Collusive tax evasion by employers and employees. Evidence from a randomized fi eld experiment in Norway," Discussion Papers 891, Statistics Norway, Research Department.
    9. Davide Viviano & Jelena Bradic, 2019. "Synthetic learner: model-free inference on treatments over time," Papers 1904.01490, arXiv.org, revised Aug 2022.
    10. Chenchuan (Mark) Li & Ulrich K. Müller, 2021. "Linear regression with many controls of limited explanatory power," Quantitative Economics, Econometric Society, vol. 12(2), pages 405-442, May.
    11. Jeon, Sung-Hee & Pohl, R. Vincent, 2019. "Medical innovation, education, and labor market outcomes of cancer patients," Journal of Health Economics, Elsevier, vol. 68(C).
    12. Johnsen, Åshild A. & Kvaløy, Ola, 2021. "Conspiracy against the public - An experiment on collusion11“People of the same trade seldom meet together, even for merriment and diversion, but the conversation ends in a conspiracy against the publ," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    13. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.
    14. Sung Jae Jun & Sokbae Lee, 2024. "Causal Inference Under Outcome-Based Sampling with Monotonicity Assumptions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(3), pages 998-1009, July.
    15. Caloffi, Annalisa & Freo, Marzia & Ghinoi, Stefano & Mariani, Marco & Rossi, Federica, 2022. "Assessing the effects of a deliberate policy mix: The case of technology and innovation advisory services and innovation vouchers," Research Policy, Elsevier, vol. 51(6).
    16. Reizer, Balázs, 2022. "Employment and Wage Consequences of Flexible Wage Components," Labour Economics, Elsevier, vol. 78(C).
    17. Jiannan Lu & Peng Ding & Tirthankar Dasgupta, 2018. "Treatment Effects on Ordinal Outcomes: Causal Estimands and Sharp Bounds," Journal of Educational and Behavioral Statistics, , vol. 43(5), pages 540-567, October.
    18. Matilde Cappelletti & Leonardo M. Giuffrida, 2024. "Targeted Bidders in Government Tenders," CESifo Working Paper Series 11142, CESifo.
    19. Art B. Owen & Hal Varian, 2018. "Optimizing the tie-breaker regression discontinuity design," Papers 1808.07563, arXiv.org, revised Jul 2020.
    20. Michela Carlana, 2019. "Implicit Stereotypes: Evidence from Teachers’ Gender Bias," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1163-1224.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:alstar:v:106:y:2022:i:3:d:10.1007_s10182-021-00427-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.