IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2112.15499.html
   My bibliography  Save this paper

Dynamic Portfolio Optimization with Inverse Covariance Clustering

Author

Listed:
  • Yuanrong Wang
  • Tomaso Aste

Abstract

Market conditions change continuously. However, in portfolio's investment strategies, it is hard to account for this intrinsic non-stationarity. In this paper, we propose to address this issue by using the Inverse Covariance Clustering (ICC) method to identify inherent market states and then integrate such states into a dynamic portfolio optimization process. Extensive experiments across three different markets, NASDAQ, FTSE and HS300, over a period of ten years, demonstrate the advantages of our proposed algorithm, termed Inverse Covariance Clustering-Portfolio Optimization (ICC-PO). The core of the ICC-PO methodology concerns the identification and clustering of market states from the analytics of past data and the forecasting of the future market state. It is therefore agnostic to the specific portfolio optimization method of choice. By applying the same portfolio optimization technique on a ICC temporal cluster, instead of the whole train period, we show that one can generate portfolios with substantially higher Sharpe Ratios, which are statistically more robust and resilient with great reductions in maximum loss in extreme situations. This is shown to be consistent across markets, periods, optimization methods and selection of portfolio assets.

Suggested Citation

  • Yuanrong Wang & Tomaso Aste, 2021. "Dynamic Portfolio Optimization with Inverse Covariance Clustering," Papers 2112.15499, arXiv.org, revised Jan 2022.
    • Handle: RePEc:arx:papers:2112.15499
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2112.15499
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Andrew Ang & Geert Bekaert, 2004. "How Regimes Affect Asset Allocation," Financial Analysts Journal, Taylor & Francis Journals, vol. 60(2), pages 86-99, March.
    2. Barfuss, Wolfram & Massara, Guido Previde & Di Matteo, T. & Aste, Tomaso, 2016. "Parsimonious modeling with information filtering networks," LSE Research Online Documents on Economics 68860, London School of Economics and Political Science, LSE Library.
    3. Harry M. Markowitz & David Starer & Harvey Fram & Sander Gerber, 2020. "Avoiding the Downside: A Practical Review of the Critical Line Algorithm for Mean–Semivariance Portfolio Optimization," World Scientific Book Chapters, in: John B Guerard & William T Ziemba (ed.), HANDBOOK OF APPLIED INVESTMENT RESEARCH, chapter 17, pages 369-415, World Scientific Publishing Co. Pte. Ltd..
    4. Coronel-Brizio, H.F. & Hernández-Montoya, A.R., 2005. "On fitting the Pareto–Levy distribution to stock market index data: Selecting a suitable cutoff value," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 354(C), pages 437-449.
    5. Tae-Hwy Lee & Ekaterina Seregina, 2024. "Optimal Portfolio Using Factor Graphical Lasso," Journal of Financial Econometrics, Oxford University Press, vol. 22(3), pages 670-695.
    6. repec:dau:papers:123456789/5717 is not listed on IDEAS
    7. Andrew Ang & Geert Bekaert, 2002. "International Asset Allocation With Regime Shifts," The Review of Financial Studies, Society for Financial Studies, vol. 15(4), pages 1137-1187.
    8. Thaleia Zariphopoulou, 2001. "A solution approach to valuation with unhedgeable risks," Finance and Stochastics, Springer, vol. 5(1), pages 61-82.
    9. Isabelle Bajeux-Besnainou & James V. Jordan & Roland Portait, 2001. "An Asset Allocation Puzzle: Comment," American Economic Review, American Economic Association, vol. 91(4), pages 1170-1179, September.
    10. Merton, Robert C., 1971. "Optimum consumption and portfolio rules in a continuous-time model," Journal of Economic Theory, Elsevier, vol. 3(4), pages 373-413, December.
    11. M Jackson & M D Staunton, 1999. "Quadratic programming applications in finance using Excel," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 50(12), pages 1256-1266, December.
    12. Jason Narsoo, 2017. "Performance Analysis of Portfolio Optimisation Strategies: Evidence from the Exchange Market," International Journal of Economics and Finance, Canadian Center of Science and Education, vol. 9(6), pages 124-132, June.
    13. He, Hua & Pearson, Neil D., 1991. "Consumption and portfolio policies with incomplete markets and short-sale constraints: The infinite dimensional case," Journal of Economic Theory, Elsevier, vol. 54(2), pages 259-304, August.
    14. Robert R. Grauer & Nils H. Hakansson, 1993. "On the Use of Mean-Variance and Quadratic Approximations in Implementing Dynamic Investment Strategies: A Comparison of Returns and Investment Policies," Management Science, INFORMS, vol. 39(7), pages 856-871, July.
    15. Olivier Ledoit & Michael Wolf, 2003. "Honey, I Shrunk the Sample Covariance Matrix," Working Papers 92, Barcelona School of Economics.
    16. Hua He & Neil D. Pearson, 1991. "Consumption and Portfolio Policies With Incomplete Markets and Short‐Sale Constraints: the Finite‐Dimensional Case1," Mathematical Finance, Wiley Blackwell, vol. 1(3), pages 1-10, July.
    17. Merton, Robert C, 1969. "Lifetime Portfolio Selection under Uncertainty: The Continuous-Time Case," The Review of Economics and Statistics, MIT Press, vol. 51(3), pages 247-257, August.
    18. Eckhard Limpert & Werner A Stahel, 2011. "Problems with Using the Normal Distribution – and Ways to Improve Quality and Efficiency of Data Analysis," PLOS ONE, Public Library of Science, vol. 6(7), pages 1-8, July.
    19. Cox, John C. & Huang, Chi-fu, 1989. "Optimal consumption and portfolio policies when asset prices follow a diffusion process," Journal of Economic Theory, Elsevier, vol. 49(1), pages 33-83, October.
    20. Nicol'o Musmeci & Tomaso Aste & Tiziana Di Matteo, 2016. "What does past correlation structure tell us about the future? An answer from network filtering," Papers 1605.08908, arXiv.org.
    21. Ramchand, Latha & Susmel, Raul, 1998. "Volatility and cross correlation across major stock markets," Journal of Empirical Finance, Elsevier, vol. 5(4), pages 397-416, October.
    22. Brennan, Michael J. & Xia, Yihong, 2000. "Dynamic Asset Allocation under Inflation," University of California at Los Angeles, Anderson Graduate School of Management qt8p95456t, Anderson Graduate School of Management, UCLA.
    23. Tomaso Aste & T. Di Matteo, 2017. "Sparse Causality Network Retrieval from Short Time Series," Complexity, Hindawi, vol. 2017, pages 1-13, November.
    24. Buckley, Ian & Saunders, David & Seco, Luis, 2008. "Portfolio optimization when asset returns have the Gaussian mixture distribution," European Journal of Operational Research, Elsevier, vol. 185(3), pages 1434-1461, March.
    25. Bollerslev, Tim, 1990. "Modelling the Coherence in Short-run Nominal Exchange Rates: A Multivariate Generalized ARCH Model," The Review of Economics and Statistics, MIT Press, vol. 72(3), pages 498-505, August.
    26. Gah-Yi Ban & Noureddine El Karoui & Andrew E. B. Lim, 2018. "Machine Learning and Portfolio Optimization," Management Science, INFORMS, vol. 64(3), pages 1136-1154, March.
    27. Zeitsch, Peter J., 2019. "A jump model for credit default swaps with hierarchical clustering," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 524(C), pages 737-775.
    28. Yves-Laurent Kom Samo & Alexander Vervuurt, 2016. "Stochastic Portfolio Theory: A Machine Learning Perspective," Papers 1605.02654, arXiv.org.
    29. Pier Francesco Procacci & Tomaso Aste, 2021. "Portfolio Optimization with Sparse Multivariate Modelling," Papers 2103.15232, arXiv.org.
    30. Ying Jiao & Huyên Pham, 2011. "Optimal investment with counterparty risk: a default-density model approach," Finance and Stochastics, Springer, vol. 15(4), pages 725-753, December.
    31. Engle, Robert, 2002. "Dynamic Conditional Correlation: A Simple Class of Multivariate Generalized Autoregressive Conditional Heteroskedasticity Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 339-350, July.
    32. Ahn, Hee-Joon & Cai, Jun & Cheung, Yan Leung, 2005. "Price clustering on the limit-order book: Evidence from the Stock Exchange of Hong Kong," Journal of Financial Markets, Elsevier, vol. 8(4), pages 421-451, November.
    33. Hakansson, Nils H., 1971. "Capital Growth and the Mean-Variance Approach to Portfolio Selection," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 6(1), pages 517-557, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Danial Saef & Yuanrong Wang & Tomaso Aste, 2022. "Regime-based Implied Stochastic Volatility Model for Crypto Option Pricing," Papers 2208.12614, arXiv.org, revised Sep 2022.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yuanrong & Aste, Tomaso, 2023. "Dynamic portfolio optimization with inverse covariance clustering," LSE Research Online Documents on Economics 117701, London School of Economics and Political Science, LSE Library.
    2. Gerrard, Russell & Kyriakou, Ioannis & Nielsen, Jens Perch & Vodička, Peter, 2023. "On optimal constrained investment strategies for long-term savers in stochastic environments and probability hedging," European Journal of Operational Research, Elsevier, vol. 307(2), pages 948-962.
    3. Mahan Tahvildari, 2021. "Forward indifference valuation and hedging of basis risk under partial information," Papers 2101.00251, arXiv.org.
    4. Michael W. Brandt & Amit Goyal & Pedro Santa-Clara & Jonathan R. Stroud, 2005. "A Simulation Approach to Dynamic Portfolio Choice with an Application to Learning About Return Predictability," The Review of Financial Studies, Society for Financial Studies, vol. 18(3), pages 831-873.
    5. Suresh M. Sundaresan, 2000. "Continuous‐Time Methods in Finance: A Review and an Assessment," Journal of Finance, American Finance Association, vol. 55(4), pages 1569-1622, August.
    6. L. Rüschendorf & Steven Vanduffel, 2020. "On the construction of optimal payoffs," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 43(1), pages 129-153, June.
    7. Goll, Thomas & Kallsen, Jan, 2000. "Optimal portfolios for logarithmic utility," Stochastic Processes and their Applications, Elsevier, vol. 89(1), pages 31-48, September.
    8. Jouini, Elyes, 2001. "Arbitrage and control problems in finance: A presentation," Journal of Mathematical Economics, Elsevier, vol. 35(2), pages 167-183, April.
    9. Zhu, Huiming & Deng, Chao & Yue, Shengjie & Deng, Yingchun, 2015. "Optimal reinsurance and investment problem for an insurer with counterparty risk," Insurance: Mathematics and Economics, Elsevier, vol. 61(C), pages 242-254.
    10. Chenxu Li & O. Scaillet & Yiwen Shen, 2020. "Decomposition of Optimal Dynamic Portfolio Choice with Wealth-Dependent Utilities in Incomplete Markets," Swiss Finance Institute Research Paper Series 20-22, Swiss Finance Institute.
    11. Oleksii Mostovyi, 2011. "Necessary and sufficient conditions in the problem of optimal investment with intermediate consumption," Papers 1107.5852, arXiv.org, revised Jul 2012.
    12. Ruili Sun & Tiefeng Ma & Shuangzhe Liu & Milind Sathye, 2019. "Improved Covariance Matrix Estimation for Portfolio Risk Measurement: A Review," JRFM, MDPI, vol. 12(1), pages 1-34, March.
    13. Sanjiv Ranjan Das & Rangarajan K. Sundaram, 2002. "An approximation algorithm for optimal consumption/investment problems," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 11(2), pages 55-69, April.
    14. Chen, An & Vellekoop, Michel, 2017. "Optimal investment and consumption when allowing terminal debt," European Journal of Operational Research, Elsevier, vol. 258(1), pages 385-397.
    15. André Palma & Jean-Luc Prigent, 2009. "Standardized versus customized portfolio: a compensating variation approach," Annals of Operations Research, Springer, vol. 165(1), pages 161-185, January.
    16. Francesco Menoncin & Olivier Scaillet, 2003. "Mortality Risk and Real Optimal Asset Allocation for Pension Funds," FAME Research Paper Series rp101, International Center for Financial Asset Management and Engineering.
    17. Oleksii Mostovyi, 2015. "Necessary and sufficient conditions in the problem of optimal investment with intermediate consumption," Finance and Stochastics, Springer, vol. 19(1), pages 135-159, January.
    18. Michael J. Brennan & Yihong Xia, 2002. "Dynamic Asset Allocation under Inflation," Journal of Finance, American Finance Association, vol. 57(3), pages 1201-1238, June.
    19. Lioui, Abraham, 2013. "Time consistent vs. time inconsistent dynamic asset allocation: Some utility cost calculations for mean variance preferences," Journal of Economic Dynamics and Control, Elsevier, vol. 37(5), pages 1066-1096.
    20. Feyzullah Egriboyun & H. Soner, 2010. "Optimal investment strategies with a reallocation constraint," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 71(3), pages 551-585, June.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2112.15499. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.