IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v320y2025i3p739-753.html
   My bibliography  Save this article

End-to-end, decision-based, cardinality-constrained portfolio optimization

Author

Listed:
  • Anis, Hassan T.
  • Kwon, Roy H.

Abstract

Portfolios employing a (factor) risk model are usually constructed using a two step process: first, the risk model parameters are estimated, then the portfolio is constructed. Recent works have shown that this decoupled approach may be improved using an integrated framework that takes the downstream portfolio optimization into account during parameter estimation. In this work we implement an integrated, end-to-end, predict-&-optimize framework to the cardinality-constrained portfolio optimization problem. To the best of our knowledge, we are the first to implement the framework to a nonlinear mixed integer programming problem. Since the feasible region of the problem is discontinuous, we are unable to directly differentiate through it. Thus, we compare three different continuous relaxations of increasing tightness to the problem which are placed as an implicit layers in a neural network. The parameters of the factor model governing the problem’s covariance matrix structure are learned using a loss function that directly corresponds to the decision quality made based on the factor model’s predictions. Using real world financial data, our proposed end-to-end, decision based model is compared to two decoupled alternatives. Results show significant improvements over the traditional decoupled approaches across all cardinality sizes and model variations while highlighting the need of additional research into the interplay between experimental design, problem size and structure, and relaxation tightness in a combinatorial setting.

Suggested Citation

  • Anis, Hassan T. & Kwon, Roy H., 2025. "End-to-end, decision-based, cardinality-constrained portfolio optimization," European Journal of Operational Research, Elsevier, vol. 320(3), pages 739-753.
  • Handle: RePEc:eee:ejores:v:320:y:2025:i:3:p:739-753
    DOI: 10.1016/j.ejor.2024.08.030
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221724006866
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2024.08.030?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xiaojin Zheng & Xiaoling Sun & Duan Li, 2014. "Improving the Performance of MIQP Solvers for Quadratic Programs with Cardinality and Minimum Threshold Constraints: A Semidefinite Program Approach," INFORMS Journal on Computing, INFORMS, vol. 26(4), pages 690-703, November.
    2. Brendan O’Donoghue & Eric Chu & Neal Parikh & Stephen Boyd, 2016. "Conic Optimization via Operator Splitting and Homogeneous Self-Dual Embedding," Journal of Optimization Theory and Applications, Springer, vol. 169(3), pages 1042-1068, June.
    3. Anis, Hassan T. & Kwon, Roy H., 2022. "Cardinality-constrained risk parity portfolios," European Journal of Operational Research, Elsevier, vol. 302(1), pages 392-402.
    4. Best, Michael J & Grauer, Robert R, 1991. "On the Sensitivity of Mean-Variance-Efficient Portfolios to Changes in Asset Means: Some Analytical and Computational Results," The Review of Financial Studies, Society for Financial Studies, vol. 4(2), pages 315-342.
    5. X. Cui & X. Zheng & S. Zhu & X. Sun, 2013. "Convex relaxations and MIQCQP reformulations for a class of cardinality-constrained portfolio selection problems," Journal of Global Optimization, Springer, vol. 56(4), pages 1409-1423, August.
    6. Fama, Eugene F. & French, Kenneth R., 2015. "A five-factor asset pricing model," Journal of Financial Economics, Elsevier, vol. 116(1), pages 1-22.
    7. Dimitris Bertsimas & Ryan Cory-Wright, 2022. "A Scalable Algorithm for Sparse Portfolio Selection," INFORMS Journal on Computing, INFORMS, vol. 34(3), pages 1489-1511, May.
    8. Yongjae Lee & Min Jeong Kim & Jang Ho Kim & Ju Ri Jang & Woo Chang Kim, 2020. "Sparse and robust portfolio selection via semi-definite relaxation," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 71(5), pages 687-699, May.
    9. Antonio Frangioni & Fabio Furini & Claudio Gentile, 2016. "Approximated perspective relaxations: a project and lift approach," Computational Optimization and Applications, Springer, vol. 63(3), pages 705-735, April.
    10. Alwosheel, Ahmad & van Cranenburgh, Sander & Chorus, Caspar G., 2018. "Is your dataset big enough? Sample size requirements when using artificial neural networks for discrete choice analysis," Journal of choice modelling, Elsevier, vol. 28(C), pages 167-182.
    11. Levi, Yaron & Welch, Ivo, 2017. "Best Practice for Cost-of-Capital Estimates," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 52(2), pages 427-463, April.
    12. Merton, Robert C., 1980. "On estimating the expected return on the market : An exploratory investigation," Journal of Financial Economics, Elsevier, vol. 8(4), pages 323-361, December.
    13. Angelika Wiegele & Shudian Zhao, 2022. "Tight SDP Relaxations for Cardinality-Constrained Problems," Lecture Notes in Operations Research, in: Norbert Trautmann & Mario Gnägi (ed.), Operations Research Proceedings 2021, pages 167-172, Springer.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carmine De Franco & Johann Nicolle & Huyên Pham, 2019. "Dealing with Drift Uncertainty: A Bayesian Learning Approach," Risks, MDPI, vol. 7(1), pages 1-18, January.
    2. Dimitris Bertsimas & Ryan Cory-Wright, 2022. "A Scalable Algorithm for Sparse Portfolio Selection," INFORMS Journal on Computing, INFORMS, vol. 34(3), pages 1489-1511, May.
    3. Ni, Xuanming & Zheng, Tiantian & Zhao, Huimin & Zhu, Shushang, 2023. "High-dimensional portfolio optimization based on tree-structured factor model," Pacific-Basin Finance Journal, Elsevier, vol. 81(C).
    4. Antonio Frangioni & Claudio Gentile & James Hungerford, 2020. "Decompositions of Semidefinite Matrices and the Perspective Reformulation of Nonseparable Quadratic Programs," Mathematics of Operations Research, INFORMS, vol. 45(1), pages 15-33, February.
    5. Thomas Conlon & John Cotter & Iason Kynigakis, 2021. "Machine Learning and Factor-Based Portfolio Optimization," Papers 2107.13866, arXiv.org.
    6. Fan, Qingliang & Wu, Ruike & Yang, Yanrong & Zhong, Wei, 2024. "Time-varying minimum variance portfolio," Journal of Econometrics, Elsevier, vol. 239(2).
    7. Carina Moreira Costa & Dennis Kreber & Martin Schmidt, 2022. "An Alternating Method for Cardinality-Constrained Optimization: A Computational Study for the Best Subset Selection and Sparse Portfolio Problems," INFORMS Journal on Computing, INFORMS, vol. 34(6), pages 2968-2988, November.
    8. Wolfgang Karl Hardle & Yegor Klochkov & Alla Petukhina & Nikita Zhivotovskiy, 2022. "Robustifying Markowitz," Papers 2212.13996, arXiv.org.
    9. Hui, Yongchang & Shi, Mengjie & Wong, Wing-Keung & Zheng, Shurong, 2024. "Pragmatic attitude to large-scale Markowitz’s portfolio optimization and factor-augmented derating," International Review of Financial Analysis, Elsevier, vol. 96(PA).
    10. Xiaojin Zheng & Yutong Pan & Zhaolin Hu, 2021. "Perspective Reformulations of Semicontinuous Quadratically Constrained Quadratic Programs," INFORMS Journal on Computing, INFORMS, vol. 33(1), pages 163-179, January.
    11. Petukhina, Alla & Klochkov, Yegor & Härdle, Wolfgang Karl & Zhivotovskiy, Nikita, 2024. "Robustifying Markowitz," Journal of Econometrics, Elsevier, vol. 239(2).
    12. Matthias M. M. Buehlmaier & Kit Pong Wong, 2020. "Should investors join the index revolution? Evidence from around the world," Journal of Asset Management, Palgrave Macmillan, vol. 21(3), pages 192-218, May.
    13. Muhinyuza, Stanislas & Bodnar, Taras & Lindholm, Mathias, 2020. "A test on the location of the tangency portfolio on the set of feasible portfolios," Applied Mathematics and Computation, Elsevier, vol. 386(C).
    14. Candelon, B. & Hurlin, C. & Tokpavi, S., 2012. "Sampling error and double shrinkage estimation of minimum variance portfolios," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 511-527.
    15. Mishra, Anil V., 2016. "Foreign bias in Australian-domiciled mutual fund holdings," Pacific-Basin Finance Journal, Elsevier, vol. 39(C), pages 101-123.
    16. Vaughn Gambeta & Roy Kwon, 2020. "Risk Return Trade-Off in Relaxed Risk Parity Portfolio Optimization," JRFM, MDPI, vol. 13(10), pages 1-28, October.
    17. Seyoung Park & Eun Ryung Lee & Sungchul Lee & Geonwoo Kim, 2019. "Dantzig Type Optimization Method with Applications to Portfolio Selection," Sustainability, MDPI, vol. 11(11), pages 1-32, June.
    18. Andrew Butler & Roy H. Kwon, 2023. "Efficient differentiable quadratic programming layers: an ADMM approach," Computational Optimization and Applications, Springer, vol. 84(2), pages 449-476, March.
    19. Min Dai & Yuchao Dong & Yanwei Jia, 2023. "Learning equilibrium mean‐variance strategy," Mathematical Finance, Wiley Blackwell, vol. 33(4), pages 1166-1212, October.
    20. da Costa, B. Freitas Paulo & Pesenti, Silvana M. & Targino, Rodrigo S., 2023. "Risk budgeting portfolios from simulations," European Journal of Operational Research, Elsevier, vol. 311(3), pages 1040-1056.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:320:y:2025:i:3:p:739-753. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.