IDEAS home Printed from https://ideas.repec.org/a/spr/lifeda/v26y2020i4d10.1007_s10985-020-09503-3.html
   My bibliography  Save this article

Measuring the temporal prognostic utility of a baseline risk score

Author

Listed:
  • Sean M. Devlin

    (Memorial Sloan Kettering Cancer Center)

  • Mithat Gönen

    (Memorial Sloan Kettering Cancer Center)

  • Glenn Heller

    (Memorial Sloan Kettering Cancer Center)

Abstract

In the time-to-event setting, the concordance probability assesses the relative level of agreement between a model-based risk score and the survival time of a patient. While it provides a measure of discrimination over the entire follow-up period of a study, the probability does not provide information on the longitudinal durability of a baseline risk score. It is possible that a baseline risk model is able to segregate short-term from long-term survivors but unable to maintain its discriminatory strength later in the follow-up period. As a consequence, this would motivate clinicians to re-evaluate the risk score longitudinally. This longitudinal re-evaluation may not, however, be feasible in many scenarios since a single baseline evaluation may be the only data collectible due to treatment or other clinical or ethical reasons. In these scenarios, an attenuation of the discriminatory power of the patient risk score over time would indicate decreased clinical utility and call into question whether this score should remain a prognostic tool at later time points. Working within the concordance probability paradigm, we propose a method to address this clinical scenario and evaluate the discriminatory power of a baseline derived risk score over time. The methodology is illustrated with two examples: a baseline risk score in colorectal cancer defined at the time of tumor resection, and for circulating tumor cells in metastatic prostate cancer.

Suggested Citation

  • Sean M. Devlin & Mithat Gönen & Glenn Heller, 2020. "Measuring the temporal prognostic utility of a baseline risk score," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 26(4), pages 856-871, October.
  • Handle: RePEc:spr:lifeda:v:26:y:2020:i:4:d:10.1007_s10985-020-09503-3
    DOI: 10.1007/s10985-020-09503-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10985-020-09503-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10985-020-09503-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mithat Gonen & Glenn Heller, 2005. "Concordance probability and discriminatory power in proportional hazards regression," Biometrika, Biometrika Trust, vol. 92(4), pages 965-970, December.
    2. Glenn Heller & Qianxing Mo, 2016. "Estimating the concordance probability in a survival analysis with a discrete number of risk groups," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 22(2), pages 263-279, April.
    3. Patrick J. Heagerty & Yingye Zheng, 2005. "Survival Model Predictive Accuracy and ROC Curves," Biometrics, The International Biometric Society, vol. 61(1), pages 92-105, March.
    4. Hans C. Van Houwelingen, 2007. "Dynamic Prediction by Landmarking in Event History Analysis," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 34(1), pages 70-85, March.
    5. Ronghui Xu & John O'Quigley, 2000. "Proportional hazards estimate of the conditional survival function," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(4), pages 667-680.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. P. Saha & P. J. Heagerty, 2010. "Time-Dependent Predictive Accuracy in the Presence of Competing Risks," Biometrics, The International Biometric Society, vol. 66(4), pages 999-1011, December.
    2. Jing Zhang & Jing Ning & Ruosha Li, 2023. "Evaluating Dynamic Discrimination Performance of Risk Prediction Models for Survival Outcomes," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 15(2), pages 353-371, July.
    3. Liang Li & Sheng Luo & Bo Hu & Tom Greene, 2017. "Dynamic Prediction of Renal Failure Using Longitudinal Biomarkers in a Cohort Study of Chronic Kidney Disease," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 9(2), pages 357-378, December.
    4. van Geloven, N. & He, Y. & Zwinderman, A.H. & Putter, H., 2021. "Estimation of incident dynamic AUC in practice," Computational Statistics & Data Analysis, Elsevier, vol. 154(C).
    5. Daniel Commenges & Benoit Liquet & Cécile Proust-Lima, 2012. "Choice of Prognostic Estimators in Joint Models by Estimating Differences of Expected Conditional Kullback–Leibler Risks," Biometrics, The International Biometric Society, vol. 68(2), pages 380-387, June.
    6. Schmid, Matthias & Tutz, Gerhard & Welchowski, Thomas, 2018. "Discrimination measures for discrete time-to-event predictions," Econometrics and Statistics, Elsevier, vol. 7(C), pages 153-164.
    7. Ruosha Li & Jing Ning & Ziding Feng, 2022. "Estimation and inference of predictive discrimination for survival outcome risk prediction models," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 28(2), pages 219-240, April.
    8. Wolf, Petra & Schmidt, Georg & Ulm, Kurt, 2011. "The use of ROC for defining the validity of the prognostic index in censored data," Statistics & Probability Letters, Elsevier, vol. 81(7), pages 783-791, July.
    9. Xin Wang & Douglas E. Schaubel, 2018. "Modeling restricted mean survival time under general censoring mechanisms," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 24(1), pages 176-199, January.
    10. Patrick Ten Eyck & Joseph E. Cavanaugh, 2018. "Model selection criteria based on cross-validatory concordance statistics," Computational Statistics, Springer, vol. 33(2), pages 595-621, June.
    11. Zhou, Fanyin & Fu, Lijun & Li, Zhiyong & Xu, Jiawei, 2022. "The recurrence of financial distress: A survival analysis," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1100-1115.
    12. Gustavo Soutinho & Luís Meira-Machado, 2023. "Nonparametric estimation of the distribution of gap times for recurrent events," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(1), pages 103-128, March.
    13. Yu Zheng & Tianxi Cai, 2017. "Augmented estimation for t‐year survival with censored regression models," Biometrics, The International Biometric Society, vol. 73(4), pages 1169-1178, December.
    14. Yanyuan Ma & Yuanjia Wang, 2014. "Estimating disease onset distribution functions in mutation carriers with censored mixture data," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 63(1), pages 1-23, January.
    15. Lin Lu & Laurent Dercle & Binsheng Zhao & Lawrence H. Schwartz, 2021. "Deep learning for the prediction of early on-treatment response in metastatic colorectal cancer from serial medical imaging," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    16. Arazmuradov, Annageldy, 2016. "Assessing sovereign debt default by efficiency," The Journal of Economic Asymmetries, Elsevier, vol. 13(C), pages 100-113.
    17. Nuriye Sancar & Deniz Inan, 2018. "A novel method as a diagnostic tool for the detection of influential observations in the Cox proportional hazards model," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(2), pages 1253-1266, December.
    18. Liu Xinhua & Jin Zhezhen, 2009. "A Non-Parametric Approach to Scale Reduction for Uni-Dimensional Screening Scales," The International Journal of Biostatistics, De Gruyter, vol. 5(1), pages 1-22, January.
    19. Pablo Mart�nez-Camblor & Jacobo de U�a-�lvarez & Carmen D�az Corte, 2015. "Expanded renal transplantation: a competing risk model approach," Journal of Applied Statistics, Taylor & Francis Journals, vol. 42(12), pages 2539-2553, December.
    20. Bin Qiu & Wei Guo & Fan Zhang & Fang Lv & Ying Ji & Yue Peng & Xiaoxi Chen & Hua Bao & Yang Xu & Yang Shao & Fengwei Tan & Qi Xue & Shugeng Gao & Jie He, 2021. "Dynamic recurrence risk and adjuvant chemotherapy benefit prediction by ctDNA in resected NSCLC," Nature Communications, Nature, vol. 12(1), pages 1-11, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:lifeda:v:26:y:2020:i:4:d:10.1007_s10985-020-09503-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.