IDEAS home Printed from https://ideas.repec.org/a/bla/biomet/v77y2021i4p1467-1481.html
   My bibliography  Save this article

Improving precision and power in randomized trials for COVID‐19 treatments using covariate adjustment, for binary, ordinal, and time‐to‐event outcomes

Author

Listed:
  • David Benkeser
  • Iván Díaz
  • Alex Luedtke
  • Jodi Segal
  • Daniel Scharfstein
  • Michael Rosenblum

Abstract

Time is of the essence in evaluating potential drugs and biologics for the treatment and prevention of COVID‐19. There are currently 876 randomized clinical trials (phase 2 and 3) of treatments for COVID‐19 registered on clinicaltrials.gov. Covariate adjustment is a statistical analysis method with potential to improve precision and reduce the required sample size for a substantial number of these trials. Though covariate adjustment is recommended by the U.S. Food and Drug Administration and the European Medicines Agency, it is underutilized, especially for the types of outcomes (binary, ordinal, and time‐to‐event) that are common in COVID‐19 trials. To demonstrate the potential value added by covariate adjustment in this context, we simulated two‐arm, randomized trials comparing a hypothetical COVID‐19 treatment versus standard of care, where the primary outcome is binary, ordinal, or time‐to‐event. Our simulated distributions are derived from two sources: longitudinal data on over 500 patients hospitalized at Weill Cornell Medicine New York Presbyterian Hospital and a Centers for Disease Control and Prevention preliminary description of 2449 cases. In simulated trials with sample sizes ranging from 100 to 1000 participants, we found substantial precision gains from using covariate adjustment–equivalent to 4–18% reductions in the required sample size to achieve a desired power. This was the case for a variety of estimands (targets of inference). From these simulations, we conclude that covariate adjustment is a low‐risk, high‐reward approach to streamlining COVID‐19 treatment trials. We provide an R package and practical recommendations for implementation.

Suggested Citation

  • David Benkeser & Iván Díaz & Alex Luedtke & Jodi Segal & Daniel Scharfstein & Michael Rosenblum, 2021. "Improving precision and power in randomized trials for COVID‐19 treatments using covariate adjustment, for binary, ordinal, and time‐to‐event outcomes," Biometrics, The International Biometric Society, vol. 77(4), pages 1467-1481, December.
    • Handle: RePEc:bla:biomet:v:77:y:2021:i:4:p:1467-1481
    DOI: 10.1111/biom.13377
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/biom.13377
    Download Restriction: no
    File URL: https://libkey.io/10.1111/biom.13377?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Fei Jiang & Lu Tian & Haoda Fu & Takahiro Hasegawa & L. J. Wei, 2019. "Robust Alternatives to ANCOVA for Estimating the Treatment Effect via a Randomized Comparative Study," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(528), pages 1854-1864, October.
    2. Iván Díaz & Elizabeth Colantuoni & Michael Rosenblum, 2016. "Enhanced precision in the analysis of randomized trials with ordinal outcomes," Biometrics, The International Biometric Society, vol. 72(2), pages 422-431, June.
    3. David Benkeser & Peter B. Gilbert & Marco Carone, 2019. "Estimating and Testing Vaccine Sieve Effects Using Machine Learning," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(527), pages 1038-1049, July.
    4. Min Zhang & Anastasios A. Tsiatis & Marie Davidian, 2008. "Improving Efficiency of Inferences in Randomized Clinical Trials Using Auxiliary Covariates," Biometrics, The International Biometric Society, vol. 64(3), pages 707-715, September.
    5. Yang L. & Tsiatis A. A., 2001. "Efficiency Study of Estimators for a Treatment Effect in a Pretest-Posttest Trial," The American Statistician, American Statistical Association, vol. 55, pages 314-321, November.
    6. Rubin Daniel B & van der Laan Mark J., 2008. "Empirical Efficiency Maximization: Improved Locally Efficient Covariate Adjustment in Randomized Experiments and Survival Analysis," The International Journal of Biostatistics, De Gruyter, vol. 4(1), pages 1-42, May.
    7. Iván Díaz & Elizabeth Colantuoni & Daniel F. Hanley & Michael Rosenblum, 2019. "Improved precision in the analysis of randomized trials with survival outcomes, without assuming proportional hazards," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 25(3), pages 439-468, July.
    8. Layla Parast & Lu Tian & Tianxi Cai, 2014. "Landmark Estimation of Survival and Treatment Effect in a Randomized Clinical Trial," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(505), pages 384-394, March.
    9. Pei-Yun Chen & Anastasios A. Tsiatis, 2001. "Causal Inference on the Difference of the Restricted Mean Lifetime Between Two Groups," Biometrics, The International Biometric Society, vol. 57(4), pages 1030-1038, December.
    10. Brooks Jordan C. & van der Laan Mark J. & Singer Daniel E. & Go Alan S., 2013. "Targeted Minimum Loss-Based Estimation of Causal Effects in Right-Censored Survival Data with Time-Dependent Covariates: Warfarin, Stroke, and Death in Atrial Fibrillation," Journal of Causal Inference, De Gruyter, vol. 1(2), pages 235-254, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michael A. Proschan, 2021. "Discussion on “Improving precision and power in randomized trials for COVID‐19 treatments using covariate adjustment for binary, ordinal, and time‐to‐event outcomes”," Biometrics, The International Biometric Society, vol. 77(4), pages 1482-1484, December.
    2. Lina M. Montoya & Michael R. Kosorok & Elvin H. Geng & Joshua Schwab & Thomas A. Odeny & Maya L. Petersen, 2023. "Efficient and robust approaches for analysis of sequential multiple assignment randomized trials: Illustration using the ADAPT‐R trial," Biometrics, The International Biometric Society, vol. 79(3), pages 2577-2591, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicholas Williams & Michael Rosenblum & Iván Díaz, 2022. "Optimising precision and power by machine learning in randomised trials with ordinal and time‐to‐event outcomes with an application to COVID‐19," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(4), pages 2156-2178, October.
    2. Iván Díaz & Elizabeth Colantuoni & Daniel F. Hanley & Michael Rosenblum, 2019. "Improved precision in the analysis of randomized trials with survival outcomes, without assuming proportional hazards," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 25(3), pages 439-468, July.
    3. Layla Parast & Beth Ann Griffin, 2017. "Landmark estimation of survival and treatment effects in observational studies," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 23(2), pages 161-182, April.
    4. Rosenblum Michael & van der Laan Mark J., 2010. "Simple, Efficient Estimators of Treatment Effects in Randomized Trials Using Generalized Linear Models to Leverage Baseline Variables," The International Journal of Biostatistics, De Gruyter, vol. 6(1), pages 1-44, April.
    5. Wang, Qihua & Su, Miaomiao & Wang, Ruoyu, 2021. "A beyond multiple robust approach for missing response problem," Computational Statistics & Data Analysis, Elsevier, vol. 155(C).
    6. Qi Gong & Douglas E. Schaubel, 2017. "Estimating the average treatment effect on survival based on observational data and using partly conditional modeling," Biometrics, The International Biometric Society, vol. 73(1), pages 134-144, March.
    7. Zhiwei Zhang & Wei Li & Hui Zhang, 2020. "Efficient Estimation of Mann–Whitney-Type Effect Measures for Right-Censored Survival Outcomes in Randomized Clinical Trials," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 12(2), pages 246-262, July.
    8. Zhao, Anqi & Ding, Peng, 2021. "Covariate-adjusted Fisher randomization tests for the average treatment effect," Journal of Econometrics, Elsevier, vol. 225(2), pages 278-294.
    9. Wei Zhang & Zhiwei Zhang & Aiyi Liu, 2023. "Optimizing treatment allocation in randomized clinical trials by leveraging baseline covariates," Biometrics, The International Biometric Society, vol. 79(4), pages 2815-2829, December.
    10. Chi Hyun Lee & Jing Ning & Yu Shen, 2018. "Analysis of restricted mean survival time for length†biased data," Biometrics, The International Biometric Society, vol. 74(2), pages 575-583, June.
    11. Jiannan Lu & Peng Ding & Tirthankar Dasgupta, 2018. "Treatment Effects on Ordinal Outcomes: Causal Estimands and Sharp Bounds," Journal of Educational and Behavioral Statistics, , vol. 43(5), pages 540-567, October.
    12. Peisong Han & Linglong Kong & Jiwei Zhao & Xingcai Zhou, 2019. "A general framework for quantile estimation with incomplete data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 81(2), pages 305-333, April.
    13. Yu Zheng & Tianxi Cai, 2017. "Augmented estimation for t‐year survival with censored regression models," Biometrics, The International Biometric Society, vol. 73(4), pages 1169-1178, December.
    14. Jiang, Liang & Phillips, Peter C.B. & Tao, Yubo & Zhang, Yichong, 2023. "Regression-adjusted estimation of quantile treatment effects under covariate-adaptive randomizations," Journal of Econometrics, Elsevier, vol. 234(2), pages 758-776.
    15. Yuehao Bai & Jizhou Liu & Azeem M. Shaikh & Max Tabord-Meehan, 2023. "On the Efficiency of Finely Stratified Experiments," Papers 2307.15181, arXiv.org, revised Aug 2024.
    16. Jitendra Ganju, 2004. "Some Unexamined Aspects of Analysis of Covariance in Pretest–Posttest Studies," Biometrics, The International Biometric Society, vol. 60(3), pages 829-833, September.
    17. Douglas E. Schaubel & Guanghui Wei, 2011. "Double Inverse-Weighted Estimation of Cumulative Treatment Effects Under Nonproportional Hazards and Dependent Censoring," Biometrics, The International Biometric Society, vol. 67(1), pages 29-38, March.
    18. J. R. Lockwood & Daniel F. McCaffrey, 2019. "Impact Evaluation Using Analysis of Covariance With Error-Prone Covariates That Violate Surrogacy," Evaluation Review, , vol. 43(6), pages 335-369, December.
    19. Peter Z. Schochet, 2013. "Estimators for Clustered Education RCTs Using the Neyman Model for Causal Inference," Journal of Educational and Behavioral Statistics, , vol. 38(3), pages 219-238, June.
    20. Undral Byambadalai & Tatsushi Oka & Shota Yasui, 2024. "Estimating Distributional Treatment Effects in Randomized Experiments: Machine Learning for Variance Reduction," Papers 2407.16037, arXiv.org.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:biomet:v:77:y:2021:i:4:p:1467-1481. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0006-341X .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.