IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1902.03327.html
   My bibliography  Save this paper

Censored Quantile Regression Forests

Author

Listed:
  • Alexander Hanbo Li
  • Jelena Bradic

Abstract

Random forests are powerful non-parametric regression method but are severely limited in their usage in the presence of randomly censored observations, and naively applied can exhibit poor predictive performance due to the incurred biases. Based on a local adaptive representation of random forests, we develop its regression adjustment for randomly censored regression quantile models. Regression adjustment is based on new estimating equations that adapt to censoring and lead to quantile score whenever the data do not exhibit censoring. The proposed procedure named censored quantile regression forest, allows us to estimate quantiles of time-to-event without any parametric modeling assumption. We establish its consistency under mild model specifications. Numerical studies showcase a clear advantage of the proposed procedure.

Suggested Citation

  • Alexander Hanbo Li & Jelena Bradic, 2019. "Censored Quantile Regression Forests," Papers 1902.03327, arXiv.org.
    • Handle: RePEc:arx:papers:1902.03327
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1902.03327
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Susan Athey & Julie Tibshirani & Stefan Wager, 2016. "Generalized Random Forests," Papers 1610.01271, arXiv.org, revised Apr 2018.
    2. Patrick J. Heagerty & Yingye Zheng, 2005. "Survival Model Predictive Accuracy and ROC Curves," Biometrics, The International Biometric Society, vol. 61(1), pages 92-105, March.
    3. Lin, Yi & Jeon, Yongho, 2006. "Random Forests and Adaptive Nearest Neighbors," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 578-590, June.
    4. Zeng, Donglin & Lin, D.Y., 2007. "Efficient Estimation for the Accelerated Failure Time Model," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1387-1396, December.
    5. Benjamin A. Olken, 2015. "Promises and Perils of Pre-analysis Plans," Journal of Economic Perspectives, American Economic Association, vol. 29(3), pages 61-80, Summer.
    6. Zhezhen Jin, 2003. "Rank-based inference for the accelerated failure time model," Biometrika, Biometrika Trust, vol. 90(2), pages 341-353, June.
    7. Ruoqing Zhu & Michael R. Kosorok, 2012. "Recursively Imputed Survival Trees," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 331-340, March.
    8. Portnoy S., 2003. "Censored Regression Quantiles," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 1001-1012, January.
    9. Peng, Limin & Huang, Yijian, 2008. "Survival Analysis With Quantile Regression Models," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 637-649, June.
    10. Molinaro, Annette M. & Dudoit, Sandrine & van der Laan, M.J.Mark J., 2004. "Tree-based multivariate regression and density estimation with right-censored data," Journal of Multivariate Analysis, Elsevier, vol. 90(1), pages 154-177, July.
    11. Koenker, Roger, 2008. "Censored Quantile Regression Redux," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i06).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yifei Sun & Sy Han Chiou & Mei‐Cheng Wang, 2020. "ROC‐guided survival trees and ensembles," Biometrics, The International Biometric Society, vol. 76(4), pages 1177-1189, December.
    2. Wang, Xiaoguang & Shi, Xinyong, 2014. "Robust estimation for survival partially linear single-index models," Computational Statistics & Data Analysis, Elsevier, vol. 80(C), pages 140-152.
    3. Akram Yazdani & Hojjat Zeraati & Mehdi Yaseri & Shahpar Haghighat & Ahmad Kaviani, 2022. "Laplace regression with clustered censored data," Computational Statistics, Springer, vol. 37(3), pages 1041-1068, July.
    4. Yuanshan Wu & Guosheng Yin, 2013. "Cure Rate Quantile Regression for Censored Data With a Survival Fraction," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(504), pages 1517-1531, December.
    5. Seoyun Hong, 2023. "Censored Quantile Regression with Many Controls," Papers 2303.02784, arXiv.org.
    6. Peng, Limin, 2012. "Self-consistent estimation of censored quantile regression," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 368-379.
    7. Polpo, A. & de Campos, C.P. & Sinha, D. & Lipsitz, S. & Lin, J., 2014. "Transform both sides model: A parametric approach," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 903-913.
    8. Bilias, Yannis & Florios, Kostas & Skouras, Spyros, 2019. "Exact computation of Censored Least Absolute Deviations estimator," Journal of Econometrics, Elsevier, vol. 212(2), pages 584-606.
    9. Chen, Songnian, 2018. "Sequential estimation of censored quantile regression models," Journal of Econometrics, Elsevier, vol. 207(1), pages 30-52.
    10. Yijian Huang, 2013. "Fast Censored Linear Regression," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 40(4), pages 789-806, December.
    11. Narisetty, Naveen & Koenker, Roger, 2022. "Censored quantile regression survival models with a cure proportion," Journal of Econometrics, Elsevier, vol. 226(1), pages 192-203.
    12. De Backer, Mickael & El Ghouch, Anouar & Van Keilegom, Ingrid, 2017. "An Adapted Loss Function for Censored Quantile Regression," LIDAM Discussion Papers ISBA 2017003, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    13. Xu, Linzhi & Zhang, Jiajia, 2010. "An EM-like algorithm for the semiparametric accelerated failure time gamma frailty model," Computational Statistics & Data Analysis, Elsevier, vol. 54(6), pages 1467-1474, June.
    14. Zhiping Qiu & Jing Qin & Yong Zhou, 2016. "Composite Estimating Equation Method for the Accelerated Failure Time Model with Length-biased Sampling Data," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(2), pages 396-415, June.
    15. Kyu Hyun Kim & Daniel J. Caplan & Sangwook Kang, 2023. "Smoothed quantile regression for censored residual life," Computational Statistics, Springer, vol. 38(2), pages 1001-1022, June.
    16. Marcelo Cajias & Philipp Freudenreich & Anna Heller & Wolfgang Schaefers, 2018. "Censored Quantile Regressions and the Determinants of Real Estate Liquidity," ERES eres2018_203, European Real Estate Society (ERES).
    17. Xu, Linzhi & Zhang, Jiajia, 2010. "Multiple imputation method for the semiparametric accelerated failure time mixture cure model," Computational Statistics & Data Analysis, Elsevier, vol. 54(7), pages 1808-1816, July.
    18. Jiang, Rong & Qian, Weimin & Zhou, Zhangong, 2012. "Variable selection and coefficient estimation via composite quantile regression with randomly censored data," Statistics & Probability Letters, Elsevier, vol. 82(2), pages 308-317.
    19. Zhang, Jiajia & Peng, Yingwei, 2009. "Crossing hazard functions in common survival models," Statistics & Probability Letters, Elsevier, vol. 79(20), pages 2124-2130, October.
    20. Jon Arni Steingrimsson & Robert L. Strawderman, 2017. "Estimation in the Semiparametric Accelerated Failure Time Model With Missing Covariates: Improving Efficiency Through Augmentation," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1221-1235, July.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1902.03327. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.