IDEAS home Printed from https://ideas.repec.org/a/bpj/ijbist/v18y2022i2p329-356n12.html
   My bibliography  Save this article

Increasing the efficiency of randomized trial estimates via linear adjustment for a prognostic score

Author

Listed:
  • Schuler Alejandro

    (UC Berkeley Center for Targeted Learning, Berkeley, CA, USA)

  • Walsh David

    (Unlearn.AI, Inc., San Francisco, CA, USA)

  • Hall Diana

    (Unlearn.AI, Inc., San Francisco, CA, USA)

  • Walsh Jon

    (Unlearn.AI, Inc., San Francisco, CA, USA)

  • Fisher Charles

    (Unlearn.AI, Inc., San Francisco, CA, USA
    UC Berkeley Center for Targeted Learning, Berkeley, CA, USA
    UC Berkeley Center for Targeted Learning, Berkeley, CA, USA
    UC Berkeley Center for Targeted Learning, Berkeley, CA, USA)

Abstract

Estimating causal effects from randomized experiments is central to clinical research. Reducing the statistical uncertainty in these analyses is an important objective for statisticians. Registries, prior trials, and health records constitute a growing compendium of historical data on patients under standard-of-care that may be exploitable to this end. However, most methods for historical borrowing achieve reductions in variance by sacrificing strict type-I error rate control. Here, we propose a use of historical data that exploits linear covariate adjustment to improve the efficiency of trial analyses without incurring bias. Specifically, we train a prognostic model on the historical data, then estimate the treatment effect using a linear regression while adjusting for the trial subjects’ predicted outcomes (their prognostic scores). We prove that, under certain conditions, this prognostic covariate adjustment procedure attains the minimum variance possible among a large class of estimators. When those conditions are not met, prognostic covariate adjustment is still more efficient than raw covariate adjustment and the gain in efficiency is proportional to a measure of the predictive accuracy of the prognostic model above and beyond the linear relationship with the raw covariates. We demonstrate the approach using simulations and a reanalysis of an Alzheimer’s disease clinical trial and observe meaningful reductions in mean-squared error and the estimated variance. Lastly, we provide a simplified formula for asymptotic variance that enables power calculations that account for these gains. Sample size reductions between 10% and 30% are attainable when using prognostic models that explain a clinically realistic percentage of the outcome variance.

Suggested Citation

  • Schuler Alejandro & Walsh David & Hall Diana & Walsh Jon & Fisher Charles, 2022. "Increasing the efficiency of randomized trial estimates via linear adjustment for a prognostic score," The International Journal of Biostatistics, De Gruyter, vol. 18(2), pages 329-356, November.
  • Handle: RePEc:bpj:ijbist:v:18:y:2022:i:2:p:329-356:n:12
    DOI: 10.1515/ijb-2021-0072
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/ijb-2021-0072
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.

    File URL: https://libkey.io/10.1515/ijb-2021-0072?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:ijbist:v:18:y:2022:i:2:p:329-356:n:12. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.