IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/k56v8_v1.html
   My bibliography  Save this paper

Estimating the variance of covariate-adjusted estimators of average treatment effects in clinical trials with binary endpoints

Author

Listed:
  • Magirr, Dominic
  • Wang, Craig

    (Novartis)

  • Przybylski, Alexander
  • Baillie, Mark

Abstract

Covariate-adjusted estimators of average treatment effects in clinical trials are typically more efficient than unadjusted estimators. Recent guidance from the FDA is highly detailed regarding the appropriate use of covariate adjustment for point estimation. Less direction is provided, however, on how to estimate the variance of such estimators. In this paper, we demonstrate that a precise description of the estimand is necessary to avoid ambiguity when comparing variance estimators for average treatment effects involving binary endpoints. When considering the suitability of a proposed estimand, together with a corresponding variance estimator, it is important to consider that the patients enrolled in clinical trials are typically a convenience sample. Since there is no unique way to map this process into formal statistical assumptions, it follows that a range of estimands, and therefore a range of variance estimators, may be acceptable. We aim to highlight through simulation results how the properties of proposed variance estimators differ, as well as the underlying reasons.

Suggested Citation

  • Magirr, Dominic & Wang, Craig & Przybylski, Alexander & Baillie, Mark, 2024. "Estimating the variance of covariate-adjusted estimators of average treatment effects in clinical trials with binary endpoints," OSF Preprints k56v8_v1, Center for Open Science.
    • Handle: RePEc:osf:osfxxx:k56v8_v1
    DOI: 10.31219/osf.io/k56v8_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/6764359e34758ebc81c55664/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/k56v8_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Alberto Abadie & Susan Athey & Guido W. Imbens & Jeffrey M. Wooldridge, 2020. "Sampling‐Based versus Design‐Based Uncertainty in Regression Analysis," Econometrica, Econometric Society, vol. 88(1), pages 265-296, January.
    2. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    3. David Benkeser & Iván Díaz & Alex Luedtke & Jodi Segal & Daniel Scharfstein & Michael Rosenblum, 2021. "Rejoinder: Improving precision and power in randomized trials for COVID‐19 treatments using covariate adjustment, for binary, ordinal, and time‐to‐event outcomes," Biometrics, The International Biometric Society, vol. 77(4), pages 1492-1494, December.
    4. Bingkai Wang & Ryoko Susukida & Ramin Mojtabai & Masoumeh Amin-Esmaeili & Michael Rosenblum, 2023. "Model-Robust Inference for Clinical Trials that Improve Precision by Stratified Randomization and Covariate Adjustment," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(542), pages 1152-1163, April.
    5. David Benkeser & Iván Díaz & Alex Luedtke & Jodi Segal & Daniel Scharfstein & Michael Rosenblum, 2021. "Improving precision and power in randomized trials for COVID‐19 treatments using covariate adjustment, for binary, ordinal, and time‐to‐event outcomes," Biometrics, The International Biometric Society, vol. 77(4), pages 1467-1481, December.
    6. Kevin Guo & Guillaume Basse, 2023. "The Generalized Oaxaca-Blinder Estimator," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(541), pages 524-536, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Magirr, Dominic & Wang, Craig & Przybylski, Alexander & Baillie, Mark, 2024. "Estimating the variance of covariate-adjusted estimators of average treatment effects in clinical trials with binary endpoints," OSF Preprints k56v8, Center for Open Science.
    2. Ashesh Rambachan & Jonathan Roth, 2020. "Design-Based Uncertainty for Quasi-Experiments," Papers 2008.00602, arXiv.org, revised Oct 2024.
    3. Özler, Berk & Çelik, Çiğdem & Cunningham, Scott & Cuevas, P. Facundo & Parisotto, Luca, 2021. "Children on the move: Progressive redistribution of humanitarian cash transfers among refugees," Journal of Development Economics, Elsevier, vol. 153(C).
    4. George Gui & Harikesh Nair & Fengshi Niu, 2021. "Auction Throttling and Causal Inference of Online Advertising Effects," Papers 2112.15155, arXiv.org, revised Feb 2022.
    5. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Jun 2024.
    6. Melvin Vooren & Carla Haelermans & Wim Groot & Henriette Maassen van den Brink, 2022. "Make IT Work: The Labor Market Effects of Information Technology Retraining in the Netherlands," De Economist, Springer, vol. 170(3), pages 323-342, August.
    7. Lina M. Montoya & Michael R. Kosorok & Elvin H. Geng & Joshua Schwab & Thomas A. Odeny & Maya L. Petersen, 2023. "Efficient and robust approaches for analysis of sequential multiple assignment randomized trials: Illustration using the ADAPT‐R trial," Biometrics, The International Biometric Society, vol. 79(3), pages 2577-2591, September.
    8. Ganesh Karapakula, 2023. "Stable Probability Weighting: Large-Sample and Finite-Sample Estimation and Inference Methods for Heterogeneous Causal Effects of Multivalued Treatments Under Limited Overlap," Papers 2301.05703, arXiv.org, revised Jan 2023.
    9. Sihui Zhao & Xinbo Wang & Lin Liu & Xin Zhang, 2024. "Covariate Adjustment in Randomized Experiments Motivated by Higher-Order Influence Functions," Papers 2411.08491, arXiv.org, revised Dec 2024.
    10. van de Walle, Dominique & Mu, Ren, 2007. "Fungibility and the flypaper effect of project aid: Micro-evidence for Vietnam," Journal of Development Economics, Elsevier, vol. 84(2), pages 667-685, November.
    11. Lechner, Michael, 2018. "Modified Causal Forests for Estimating Heterogeneous Causal Effects," IZA Discussion Papers 12040, Institute of Labor Economics (IZA).
    12. Turner, Alex J. & Fichera, Eleonora & Sutton, Matt, 2021. "The effects of in-utero exposure to influenza on mental health and mortality risk throughout the life-course," Economics & Human Biology, Elsevier, vol. 43(C).
    13. Roxana Elena Manea, 2021. "School Feeding Programmes, Education and Food Security in Rural Malawi," CIES Research Paper series 63-2020, Centre for International Environmental Studies, The Graduate Institute.
    14. repec:ags:jrapmc:122316 is not listed on IDEAS
    15. Gunther Bensch & Jörg Peters, 2013. "Alleviating Deforestation Pressures? Impacts of Improved Stove Dissemination on Charcoal Consumption in Urban Senegal," Land Economics, University of Wisconsin Press, vol. 89(4), pages 676-698.
    16. Michael Lechner & Ruth Miquel & Conny Wunsch, 2011. "Long‐Run Effects Of Public Sector Sponsored Training In West Germany," Journal of the European Economic Association, European Economic Association, vol. 9(4), pages 742-784, August.
    17. Ralf Becker & Maggy Fostier, 2015. "Evaluating non-compulsory educational interventions - the case of peer assisted study groups," Economics Discussion Paper Series 1509, Economics, The University of Manchester.
    18. Katie Meara & Francesco Pastore & Allan Webster, 2020. "The gender pay gap in the USA: a matching study," Journal of Population Economics, Springer;European Society for Population Economics, vol. 33(1), pages 271-305, January.
    19. Lou, Jiehong & Shen, Xingchi & Niemeier, Deb, 2020. "Are stay-at-home orders more difficult to follow for low-income groups?," Journal of Transport Geography, Elsevier, vol. 89(C).
    20. Gernandt, Johannes & Maier, Michael & Pfeiffer, Friedhelm & Rat-Wirtzler, Julie, 2006. "Distributional effects of the high school degree in Germany," ZEW Discussion Papers 06-088, ZEW - Leibniz Centre for European Economic Research.
    21. Naguib, Costanza, 2019. "Estimating the Heterogeneous Impact of the Free Movement of Persons on Relative Wage Mobility," Economics Working Paper Series 1903, University of St. Gallen, School of Economics and Political Science.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:k56v8_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.