IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2411.08491.html
   My bibliography  Save this paper

Covariate Adjustment in Randomized Experiments Motivated by Higher-Order Influence Functions

Author

Listed:
  • Sihui Zhao
  • Xinbo Wang
  • Lin Liu
  • Xin Zhang

Abstract

Higher-Order Influence Functions (HOIF), developed in a series of papers over the past twenty years, is a fundamental theoretical device for constructing rate-optimal causal-effect estimators from observational studies. However, the value of HOIF for analyzing well-conducted randomized controlled trials (RCTs) has not been explicitly explored. In the recent U.S. Food and Drug Administration (FDA) and European Medicines Agency (EMA) guidelines on the practice of covariate adjustment in analyzing RCTs, in addition to the simple, unadjusted difference-in-mean estimator, it was also recommended to report the estimator adjusting for baseline covariates via a simple parametric working model, such as a linear model. In this paper, we show that a HOIF-motivated estimator for the treatment-specific mean has significantly improved statistical properties compared to popular adjusted estimators in practice when the number of baseline covariates $p$ is relatively large compared to the sample size $n$. We also characterize the conditions under which the HOIF-motivated estimator improves upon the unadjusted one. Furthermore, we demonstrate that a novel debiased adjusted estimator proposed recently by Lu et al. is, in fact, another HOIF-motivated estimator in disguise. Numerical and empirical studies are conducted to corroborate our theoretical findings.

Suggested Citation

  • Sihui Zhao & Xinbo Wang & Lin Liu & Xin Zhang, 2024. "Covariate Adjustment in Randomized Experiments Motivated by Higher-Order Influence Functions," Papers 2411.08491, arXiv.org, revised Dec 2024.
  • Handle: RePEc:arx:papers:2411.08491
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2411.08491
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bingkai Wang & Ryoko Susukida & Ramin Mojtabai & Masoumeh Amin-Esmaeili & Michael Rosenblum, 2023. "Model-Robust Inference for Clinical Trials that Improve Precision by Stratified Randomization and Covariate Adjustment," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(542), pages 1152-1163, April.
    2. Yuta Koike, 2023. "High-Dimensional Central Limit Theorems for Homogeneous Sums," Journal of Theoretical Probability, Springer, vol. 36(1), pages 1-45, March.
    3. Liu, Lin & Mukherjee, Rajarshi & Robins, James M., 2024. "Assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators," Journal of Econometrics, Elsevier, vol. 240(2).
    4. Aaron Fisher & Edward H. Kennedy, 2021. "Visually Communicating and Teaching Intuition for Influence Functions," The American Statistician, Taylor & Francis Journals, vol. 75(2), pages 162-172, May.
    5. Zhao, Anqi & Ding, Peng, 2021. "Covariate-adjusted Fisher randomization tests for the average treatment effect," Journal of Econometrics, Elsevier, vol. 225(2), pages 278-294.
    6. Isaiah Andrews & Jesse M. Shapiro, 2021. "A Model of Scientific Communication," Econometrica, Econometric Society, vol. 89(5), pages 2117-2142, September.
    7. Rajarshi Mukherjee & Whitney K. Newey & James Robins, 2017. "Semiparametric efficient empirical higher order influence function estimators," CeMMAP working papers 30/17, Institute for Fiscal Studies.
    8. P L Cohen & C B Fogarty, 2024. "No-harm calibration for generalized Oaxaca–Blinder estimators," Biometrika, Biometrika Trust, vol. 111(1), pages 331-338.
    9. Bhattacharya, Rabi N. & Ghosh, Jayanta K., 1992. "A class of U-statistics and asymptotic normality of the number of k-clusters," Journal of Multivariate Analysis, Elsevier, vol. 43(2), pages 300-330, November.
    10. Ting Ye & Jun Shao & Yanyao Yi & Qingyuan Zhao, 2023. "Toward Better Practice of Covariate Adjustment in Analyzing Randomized Clinical Trials," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(544), pages 2370-2382, October.
    11. Rosenbaum, Paul R., 2010. "Design Sensitivity and Efficiency in Observational Studies," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 692-702.
    12. Chen, Xiaohong & Liu, Ying & Ma, Shujie & Zhang, Zheng, 2024. "Causal inference of general treatment effects using neural networks with a diverging number of confounders," Journal of Econometrics, Elsevier, vol. 238(1).
    13. Andrea Rotnitzky & Quanhong Lei & Mariela Sued & James M. Robins, 2012. "Improved double-robust estimation in missing data and causal inference models," Biometrika, Biometrika Trust, vol. 99(2), pages 439-456.
    14. Ting Ye & Yanyao Yi & Jun Shao, 2022. "Inference on the average treatment effect under minimization and other covariate-adaptive randomization methods [Optimum biased coin designs for sequential clinical trials with prognostic factors]," Biometrika, Biometrika Trust, vol. 109(1), pages 33-47.
    15. Kevin Guo & Guillaume Basse, 2023. "The Generalized Oaxaca-Blinder Estimator," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(541), pages 524-536, January.
    16. Lihua Lei & Peng Ding, 2021. "Regression adjustment in completely randomized experiments with a diverging number of covariates [Covariance adjustments for the analysis of randomized field experiments]," Biometrika, Biometrika Trust, vol. 108(4), pages 815-828.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jun Wang & Yahe Yu, 2024. "Improved estimation of average treatment effects under covariate‐adaptive randomization methods," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 78(2), pages 310-333, May.
    2. Jiang, Liang & Phillips, Peter C.B. & Tao, Yubo & Zhang, Yichong, 2023. "Regression-adjusted estimation of quantile treatment effects under covariate-adaptive randomizations," Journal of Econometrics, Elsevier, vol. 234(2), pages 758-776.
    3. Zhao, Anqi & Ding, Peng, 2024. "No star is good news: A unified look at rerandomization based on p-values from covariate balance tests," Journal of Econometrics, Elsevier, vol. 241(1).
    4. Xingyu Chen & Lin Liu & Rajarshi Mukherjee, 2024. "Method-of-Moments Inference for GLMs and Doubly Robust Functionals under Proportional Asymptotics," Papers 2408.06103, arXiv.org.
    5. Magirr, Dominic & Wang, Craig & Przybylski, Alexander & Baillie, Mark, 2024. "Estimating the variance of covariate-adjusted estimators of average treatment effects in clinical trials with binary endpoints," OSF Preprints k56v8, Center for Open Science.
    6. Liang Jiang & Oliver B. Linton & Haihan Tang & Yichong Zhang, 2022. "Improving Estimation Efficiency via Regression-Adjustment in Covariate-Adaptive Randomizations with Imperfect Compliance," Papers 2201.13004, arXiv.org, revised Jun 2023.
    7. Abhinandan Dalal & Patrick Blobaum & Shiva Kasiviswanathan & Aaditya Ramdas, 2024. "Anytime-Valid Inference for Double/Debiased Machine Learning of Causal Parameters," Papers 2408.09598, arXiv.org, revised Sep 2024.
    8. Bai, Yuehao & Jiang, Liang & Romano, Joseph P. & Shaikh, Azeem M. & Zhang, Yichong, 2024. "Covariate adjustment in experiments with matched pairs," Journal of Econometrics, Elsevier, vol. 241(1).
    9. Ke Zhu & Hanzhong Liu, 2023. "Pair‐switching rerandomization," Biometrics, The International Biometric Society, vol. 79(3), pages 2127-2142, September.
    10. Liu, Lin & Mukherjee, Rajarshi & Robins, James M., 2024. "Assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators," Journal of Econometrics, Elsevier, vol. 240(2).
    11. Yujia Gu & Hanzhong Liu & Wei Ma, 2023. "Regression‐based multiple treatment effect estimation under covariate‐adaptive randomization," Biometrics, The International Biometric Society, vol. 79(4), pages 2869-2880, December.
    12. Yuehao Bai & Azeem M. Shaikh & Max Tabord-Meehan, 2024. "A Primer on the Analysis of Randomized Experiments and a Survey of some Recent Advances," Papers 2405.03910, arXiv.org.
    13. Lin Liu & Chang Li, 2023. "New $\sqrt{n}$-consistent, numerically stable higher-order influence function estimators," Papers 2302.08097, arXiv.org.
    14. Fangzhou Su & Peng Ding, 2021. "Model‐assisted analyses of cluster‐randomized experiments," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(5), pages 994-1015, November.
    15. Liang Jiang & Liyao Li & Ke Miao & Yichong Zhang, 2023. "Adjustment with Many Regressors Under Covariate-Adaptive Randomizations," Papers 2304.08184, arXiv.org, revised Nov 2024.
    16. Alexander Frankel & Maximilian Kasy, 2022. "Which Findings Should Be Published?," American Economic Journal: Microeconomics, American Economic Association, vol. 14(1), pages 1-38, February.
    17. Harrison, Ann E. & Lin, Justin Yifu & Xu, Lixin Colin, 2014. "Explaining Africa’s (Dis)advantage," World Development, Elsevier, vol. 63(C), pages 59-77.
    18. Anand Acharya & Lynda Khalaf & Marcel Voia & Myra Yazbeck & David Wensley, 2021. "Severity of Illness and the Duration of Intensive Care," Working Papers 2021-003, Human Capital and Economic Opportunity Working Group.
    19. Martín-García, Jaime & Gómez-Limón, José A. & Arriaza, Manuel, 2024. "Conversion to organic farming: Does it change the economic and environmental performance of fruit farms?," Ecological Economics, Elsevier, vol. 220(C).
    20. Reed, Deborah K. & Aloe, Ariel M., 2020. "Interpreting the effectiveness of a summer reading program: The eye of the beholder," Evaluation and Program Planning, Elsevier, vol. 83(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2411.08491. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.