IDEAS home Printed from https://ideas.repec.org/a/spr/topjnl/v32y2024i1d10.1007_s11750-023-00658-4.html
   My bibliography  Save this article

Cutting-plane algorithm for estimation of sparse Cox proportional hazards models

Author

Listed:
  • Hiroki Saishu

    (University of Tsukuba)

  • Kota Kudo

    (University of Tsukuba)

  • Yuichi Takano

    (University of Tsukuba)

Abstract

Survival analysis is a family of statistical methods for analyzing event occurrence times. We adopt a mixed-integer optimization approach to estimation of sparse Cox proportional hazards (PH) models for survival analysis. Specifically, we propose a high-performance cutting-plane algorithm based on a reformulation of our sparse estimation problem into a bilevel optimization problem. This algorithm solves the upper-level problem using cutting planes that are generated from the dual lower-level problem to approximate an upper-level nonlinear objective function. To solve the dual lower-level problem efficiently, we devise a quadratic approximation of the Fenchel conjugate of the loss function. We also develop a computationally efficient least-squares method for adjusting quadratic approximations to fit each dataset. Computational results demonstrate that our method outperforms regularized estimation methods in terms of accuracy for both prediction and subset selection especially for low-dimensional datasets. Moreover, our quadratic approximation of the Fenchel conjugate function accelerates the cutting-plane algorithm and maintains high generalization performance of sparse Cox PH models.

Suggested Citation

  • Hiroki Saishu & Kota Kudo & Yuichi Takano, 2024. "Cutting-plane algorithm for estimation of sparse Cox proportional hazards models," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(1), pages 57-82, April.
  • Handle: RePEc:spr:topjnl:v:32:y:2024:i:1:d:10.1007_s11750-023-00658-4
    DOI: 10.1007/s11750-023-00658-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11750-023-00658-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11750-023-00658-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ken Kobayashi & Yuichi Takano & Kazuhide Nakata, 2021. "Bilevel cutting-plane algorithm for cardinality-constrained mean-CVaR portfolio optimization," Journal of Global Optimization, Springer, vol. 81(2), pages 493-528, October.
    2. van Wieringen, Wessel N. & Kun, David & Hampel, Regina & Boulesteix, Anne-Laure, 2009. "Survival prediction using gene expression data: A review and comparison," Computational Statistics & Data Analysis, Elsevier, vol. 53(5), pages 1590-1603, March.
    3. Deng, Lifeng & Ding, Jieli & Liu, Yanyan & Wei, Chengdong, 2018. "Regression analysis for the proportional hazards model with parameter constraints under case-cohort design," Computational Statistics & Data Analysis, Elsevier, vol. 117(C), pages 194-206.
    4. Mee Young Park & Trevor Hastie, 2007. "L1‐regularization path algorithm for generalized linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(4), pages 659-677, September.
    5. Kobayashi, Ken & Takano, Yuichi & Nakata, Kazuhide, 2023. "Cardinality-constrained distributionally robust portfolio optimization," European Journal of Operational Research, Elsevier, vol. 309(3), pages 1173-1182.
    6. Hiroki Saishu & Kota Kudo & Yuichi Takano, 2021. "Sparse Poisson regression via mixed-integer optimization," PLOS ONE, Public Library of Science, vol. 16(4), pages 1-17, April.
    7. Van den Poel, Dirk & Lariviere, Bart, 2004. "Customer attrition analysis for financial services using proportional hazard models," European Journal of Operational Research, Elsevier, vol. 157(1), pages 196-217, August.
    8. Young Woong Park & Diego Klabjan, 2020. "Subset selection for multiple linear regression via optimization," Journal of Global Optimization, Springer, vol. 77(3), pages 543-574, July.
    9. Ryuta Tamura & Ken Kobayashi & Yuichi Takano & Ryuhei Miyashiro & Kazuhide Nakata & Tomomi Matsui, 2019. "Mixed integer quadratic optimization formulations for eliminating multicollinearity based on variance inflation factor," Journal of Global Optimization, Springer, vol. 73(2), pages 431-446, February.
    10. Yuichi Takano & Ryuhei Miyashiro, 2020. "Best subset selection via cross-validation criterion," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(2), pages 475-488, July.
    11. Demyanyk, Yuliya & Hasan, Iftekhar, 2010. "Financial crises and bank failures: A review of prediction methods," Omega, Elsevier, vol. 38(5), pages 315-324, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Serrano, Breno & Minner, Stefan & Schiffer, Maximilian & Vidal, Thibaut, 2024. "Bilevel optimization for feature selection in the data-driven newsvendor problem," European Journal of Operational Research, Elsevier, vol. 315(2), pages 703-714.
    2. Tomokaze Shiratori & Ken Kobayashi & Yuichi Takano, 2020. "Prediction of hierarchical time series using structured regularization and its application to artificial neural networks," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-23, November.
    3. Wei Zhang & Takayo Ota & Viji Shridhar & Jeremy Chien & Baolin Wu & Rui Kuang, 2013. "Network-based Survival Analysis Reveals Subnetwork Signatures for Predicting Outcomes of Ovarian Cancer Treatment," PLOS Computational Biology, Public Library of Science, vol. 9(3), pages 1-16, March.
    4. Matteo Foglia & Eliana Angelini, 2019. "An explorative analysis of Italy banking financial stability," Economics Bulletin, AccessEcon, vol. 39(2), pages 1294-1308.
    5. Yen-Chun Chou & Howard Hao-Chun Chuang, 2018. "A predictive investigation of first-time customer retention in online reservation services," Service Business, Springer;Pan-Pacific Business Association, vol. 12(4), pages 685-699, December.
    6. Eling, Martin & Jia, Ruo, 2018. "Business failure, efficiency, and volatility: Evidence from the European insurance industry," International Review of Financial Analysis, Elsevier, vol. 59(C), pages 58-76.
    7. Le, Hong Hanh & Viviani, Jean-Laurent, 2018. "Predicting bank failure: An improvement by implementing a machine-learning approach to classical financial ratios," Research in International Business and Finance, Elsevier, vol. 44(C), pages 16-25.
    8. Wai-Kay Seto & Chun-Fan Lee & Ching-Lung Lai & Philip P C Ip & Daniel Yee-Tak Fong & James Fung & Danny Ka-Ho Wong & Man-Fung Yuen, 2011. "A New Model Using Routinely Available Clinical Parameters to Predict Significant Liver Fibrosis in Chronic Hepatitis B," PLOS ONE, Public Library of Science, vol. 6(8), pages 1-7, August.
    9. Bartosz Uniejewski, 2024. "Regularization for electricity price forecasting," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 34(3), pages 267-286.
    10. repec:ehu:cuader:7603 is not listed on IDEAS
    11. Carlos Serrano-Cinca & Yolanda Fuertes-Call鮠 & Bego uti鲲ez-Nieto & Beatriz Cuellar-Fernᮤez, 2014. "Path modelling to bankruptcy: causes and symptoms of the banking crisis," Applied Economics, Taylor & Francis Journals, vol. 46(31), pages 3798-3811, November.
    12. Ken Kobayashi & Yuichi Takano & Kazuhide Nakata, 2021. "Bilevel cutting-plane algorithm for cardinality-constrained mean-CVaR portfolio optimization," Journal of Global Optimization, Springer, vol. 81(2), pages 493-528, October.
    13. De Caigny, Arno & Coussement, Kristof & De Bock, Koen W. & Lessmann, Stefan, 2020. "Incorporating textual information in customer churn prediction models based on a convolutional neural network," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1563-1578.
    14. Andrés Gómez & Oleg A. Prokopyev, 2021. "A Mixed-Integer Fractional Optimization Approach to Best Subset Selection," INFORMS Journal on Computing, INFORMS, vol. 33(2), pages 551-565, May.
    15. Arno de Caigny & Kristof Coussement & Koen de Bock, 2020. "Leveraging fine-grained transaction data for customer life event predictions," Post-Print hal-02507998, HAL.
    16. Bian, Yuan & Yi, Grace Y. & He, Wenqing, 2024. "A unified framework of analyzing missing data and variable selection using regularized likelihood," Computational Statistics & Data Analysis, Elsevier, vol. 194(C).
    17. Liu, Zhenkun & Zhang, Ying & Abedin, Mohammad Zoynul & Wang, Jianzhou & Yang, Hufang & Gao, Yuyang & Chen, Yinghao, 2024. "Profit-driven fusion framework based on bagging and boosting classifiers for potential purchaser prediction," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    18. Maria Elvira Mancino & Simona Sanfelici, 2020. "Identifying financial instability conditions using high frequency data," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 15(1), pages 221-242, January.
    19. Mare, Davide Salvatore & Moreira, Fernando & Rossi, Roberto, 2017. "Nonstationary Z-Score measures," European Journal of Operational Research, Elsevier, vol. 260(1), pages 348-358.
    20. Savas Papadopoulos & Pantelis Stavroulias & Thomas Sager & Etti Baranoff, 2017. "A ternary-state early warning system for the European Union," Working Papers 222, Bank of Greece.
    21. Amir Gandomi & Amirhossein Bazargan & Saeed Zolfaghari, 2019. "Designing competitive loyalty programs: a stochastic game-theoretic model to guide the choice of reward structure," Annals of Operations Research, Springer, vol. 280(1), pages 267-298, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:topjnl:v:32:y:2024:i:1:d:10.1007_s11750-023-00658-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.