IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2103.01123.html
   My bibliography  Save this paper

A combinatorial optimization approach to scenario filtering in portfolio selection

Author

Listed:
  • Justo Puerto
  • Federica Ricca
  • Mois'es Rodr'iguez-Madrena
  • Andrea Scozzari

Abstract

Recent studies stressed the fact that covariance matrices computed from empirical financial time series appear to contain a high amount of noise. This makes the classical Markowitz Mean-Variance Optimization model unable to correctly evaluate the performance associated to selected portfolios. Since the Markowitz model is still one of the most used practitioner-oriented tool, several filtering methods have been proposed in the literature to fix the problem. Among them, the two most promising ones refer to the Random Matrix Theory or to the Power Mapping strategy. The basic idea of these methods is to transform the correlation matrix maintaining the Mean-Variance Optimization model. However, experimental analysis shows that these two strategies are not adequately effective when applied to real financial datasets. In this paper we propose an alternative filtering method based on Combinatorial Optimization. We advance a new Mixed Integer Quadratic Programming model to filter those observations that may influence the performance of a portfolio in the future. We discuss the properties of this new model and we test it on some real financial datasets. We compare the out-of-sample performance of our portfolios with the one of the portfolios provided by the two above mentioned alternative strategies. We show that our method outperforms them. Although our model can be solved efficiently with standard optimization solvers the computational burden increases for large datasets. To overcome this issue we also propose a heuristic procedure that empirically showed to be both efficient and effective.

Suggested Citation

  • Justo Puerto & Federica Ricca & Mois'es Rodr'iguez-Madrena & Andrea Scozzari, 2021. "A combinatorial optimization approach to scenario filtering in portfolio selection," Papers 2103.01123, arXiv.org.
  • Handle: RePEc:arx:papers:2103.01123
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2103.01123
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Tola, Vincenzo & Lillo, Fabrizio & Gallegati, Mauro & Mantegna, Rosario N., 2008. "Cluster analysis for portfolio optimization," Journal of Economic Dynamics and Control, Elsevier, vol. 32(1), pages 235-258, January.
    2. Jorion, Philippe, 1986. "Bayes-Stein Estimation for Portfolio Analysis," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 21(3), pages 279-292, September.
    3. Edwin J. Elton & Martin J. Gruber & Jonathan Spitzer, 2006. "Improved Estimates of Correlation Coefficients and their Impact on Optimum Portfolios," European Financial Management, European Financial Management Association, vol. 12(3), pages 303-318, June.
    4. Francesco Cesarone & Andrea Scozzari & Fabio Tardella, 2020. "An optimization–diversification approach to portfolio selection," Journal of Global Optimization, Springer, vol. 76(2), pages 245-265, February.
    5. Ledoit, Olivier & Wolf, Michael, 2003. "Improved estimation of the covariance matrix of stock returns with an application to portfolio selection," Journal of Empirical Finance, Elsevier, vol. 10(5), pages 603-621, December.
    6. Francesco Cesarone & Andrea Scozzari & Fabio Tardella, 2013. "A new method for mean-variance portfolio optimization with cardinality constraints," Annals of Operations Research, Springer, vol. 205(1), pages 213-234, May.
    7. Pafka, Szilárd & Kondor, Imre, 2004. "Estimated correlation matrices and portfolio optimization," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 343(C), pages 623-634.
    8. Bruni, Renato & Cesarone, Francesco & Scozzari, Andrea & Tardella, Fabio, 2017. "On exact and approximate stochastic dominance strategies for portfolio selection," European Journal of Operational Research, Elsevier, vol. 259(1), pages 322-329.
    9. J.-P. Onnela & K. Kaski & J. Kertész, 2004. "Clustering and information in correlation based financial networks," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 38(2), pages 353-362, March.
    10. Jansen, Dennis W & de Vries, Casper G, 1991. "On the Frequency of Large Stock Returns: Putting Booms and Busts into Perspective," The Review of Economics and Statistics, MIT Press, vol. 73(1), pages 18-24, February.
    11. Renata Mansini & Włodzimierz Ogryczak & M. Speranza, 2007. "Conditional value at risk and related linear programming models for portfolio optimization," Annals of Operations Research, Springer, vol. 152(1), pages 227-256, July.
    12. Pafka, Szilárd & Kondor, Imre, 2003. "Noisy covariance matrices and portfolio optimization II," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 319(C), pages 487-494.
    13. Benoit Mandelbrot, 2015. "The Variation of Certain Speculative Prices," World Scientific Book Chapters, in: Anastasios G Malliaris & William T Ziemba (ed.), THE WORLD SCIENTIFIC HANDBOOK OF FUTURES MARKETS, chapter 3, pages 39-78, World Scientific Publishing Co. Pte. Ltd..
    14. Stoyanov, Stoyan V. & Rachev, Svetlozar T. & Racheva-Iotova, Boryana & Fabozzi, Frank J., 2011. "Fat-tailed models for risk estimation," Working Paper Series in Economics 30, Karlsruhe Institute of Technology (KIT), Department of Economics and Management.
    15. Narasimhan Jegadeesh & Sheridan Titman, 2001. "Profitability of Momentum Strategies: An Evaluation of Alternative Explanations," Journal of Finance, American Finance Association, vol. 56(2), pages 699-720, April.
    16. Rockafellar, R. Tyrrell & Uryasev, Stanislav, 2002. "Conditional value-at-risk for general loss distributions," Journal of Banking & Finance, Elsevier, vol. 26(7), pages 1443-1471, July.
    17. Rudi Schafer & Nils Fredrik Nilsson & Thomas Guhr, 2010. "Power mapping with dynamical adjustment for improved portfolio optimization," Quantitative Finance, Taylor & Francis Journals, vol. 10(1), pages 107-119.
    18. Kondor, Imre & Pafka, Szilard & Nagy, Gabor, 2007. "Noise sensitivity of portfolio selection under various risk measures," Journal of Banking & Finance, Elsevier, vol. 31(5), pages 1545-1573, May.
    19. Laurent Laloux & Pierre Cizeau & Marc Potters & Jean-Philippe Bouchaud, 2000. "Random Matrix Theory And Financial Correlations," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 3(03), pages 391-397.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Justo Puerto & Moises Rodr'iguez-Madrena & Andrea Scozzari, 2019. "Location and portfolio selection problems: A unified framework," Papers 1907.07101, arXiv.org.
    2. Varga-Haszonits, Istvan & Caccioli, Fabio & Kondor, Imre, 2016. "Replica approach to mean-variance portfolio optimization," LSE Research Online Documents on Economics 68955, London School of Economics and Political Science, LSE Library.
    3. Istvan Varga-Haszonits & Fabio Caccioli & Imre Kondor, 2016. "Replica approach to mean-variance portfolio optimization," Papers 1606.08679, arXiv.org.
    4. Detlef Seese & Christof Weinhardt & Frank Schlottmann (ed.), 2008. "Handbook on Information Technology in Finance," International Handbooks on Information Systems, Springer, number 978-3-540-49487-4, November.
    5. Rudi Schafer & Nils Fredrik Nilsson & Thomas Guhr, 2010. "Power mapping with dynamical adjustment for improved portfolio optimization," Quantitative Finance, Taylor & Francis Journals, vol. 10(1), pages 107-119.
    6. Noureddine Kouaissah & Sergio Ortobelli Lozza & Ikram Jebabli, 2022. "Portfolio Selection Using Multivariate Semiparametric Estimators and a Copula PCA-Based Approach," Computational Economics, Springer;Society for Computational Economics, vol. 60(3), pages 833-859, October.
    7. Alessandra Carleo & Francesco Cesarone & Andrea Gheno & Jacopo Maria Ricci, 2017. "Approximating exact expected utility via portfolio efficient frontiers," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 40(1), pages 115-143, November.
    8. Schäfer, Rudi & Guhr, Thomas, 2010. "Local normalization: Uncovering correlations in non-stationary financial time series," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 389(18), pages 3856-3865.
    9. Kouaissah, Noureddine, 2021. "Using multivariate stochastic dominance to enhance portfolio selection and warn of financial crises," The Quarterly Review of Economics and Finance, Elsevier, vol. 80(C), pages 480-493.
    10. Fabio Caccioli & Imre Kondor & G'abor Papp, 2015. "Portfolio Optimization under Expected Shortfall: Contour Maps of Estimation Error," Papers 1510.04943, arXiv.org.
    11. Fabio Caccioli & Imre Kondor & Matteo Marsili & Susanne Still, 2016. "Liquidity Risk And Instabilities In Portfolio Optimization," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 19(05), pages 1-28, August.
    12. Fabio Caccioli & Imre Kondor & G'abor Papp, 2015. "Portfolio Optimization under Expected Shortfall: Contour Maps of Estimation Error," Papers 1510.04943, arXiv.org.
    13. Varga-Haszonits, I. & Kondor, I., 2007. "Noise sensitivity of portfolio selection in constant conditional correlation GARCH models," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 385(1), pages 307-318.
    14. Leonidas Sandoval Junior & Italo De Paula Franca, 2011. "Correlation of financial markets in times of crisis," Papers 1102.1339, arXiv.org, revised Mar 2011.
    15. Plachel, Lukas, 2019. "A unified model for regularized and robust portfolio optimization," Journal of Economic Dynamics and Control, Elsevier, vol. 109(C).
    16. Cesarone, Francesco & Mango, Fabiomassimo & Mottura, Carlo Domenico & Ricci, Jacopo Maria & Tardella, Fabio, 2020. "On the stability of portfolio selection models," Journal of Empirical Finance, Elsevier, vol. 59(C), pages 210-234.
    17. Caccioli, Fabio & Kondor, Imre & Papp, Gábor, 2015. "Portfolio optimization under expected shortfall: contour maps of estimation error," LSE Research Online Documents on Economics 119463, London School of Economics and Political Science, LSE Library.
    18. Sandoval, Leonidas & Franca, Italo De Paula, 2012. "Correlation of financial markets in times of crisis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(1), pages 187-208.
    19. Malavasi, Matteo & Ortobelli Lozza, Sergio & Trück, Stefan, 2021. "Second order of stochastic dominance efficiency vs mean variance efficiency," European Journal of Operational Research, Elsevier, vol. 290(3), pages 1192-1206.
    20. Sebastiano Michele Zema & Giorgio Fagiolo & Tiziano Squartini & Diego Garlaschelli, 2021. "Mesoscopic Structure of the Stock Market and Portfolio Optimization," Papers 2112.06544, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2103.01123. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.