IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1709.08755.html
   My bibliography  Save this paper

Analytic approach to variance optimization under an $\ell_1$ constraint

Author

Listed:
  • Imre Kondor
  • G'abor Papp
  • Fabio Caccioli

Abstract

The optimization of the variance supplemented by a budget constraint and an asymmetric $\ell_1$ regularizer is carried out analytically by the replica method borrowed from the theory of disordered systems. The asymmetric regularizer allows us to penalize short and long positions differently, so the present treatment includes the no-short-constrained portfolio optimization problem as a special case. Results are presented for the out-of-sample and the in-sample estimator of the regularized variance, the relative estimation error, the density of the assets eliminated from the portfolio by the regularizer, and the distribution of the optimal portfolio weights. We have studied the dependence of these quantities on the ratio $r$ of the portfolio's dimension $N$ to the sample size $T$, and on the strength of the regularizer. We have checked the analytic results by numerical simulations, and found general agreement. Regularization extends the interval where the optimization can be carried out, and suppresses the large sample fluctuations, but the performance of $\ell_1$ regularization is rather disappointing: if the sample size is large relative to the dimension, i.e. $r$ is small, the regularizer does not play any role, while for $r$'s where the regularizer starts to be felt the estimation error is already so large as to make the whole optimization exercise pointless. We find that the $\ell_1$ regularization can eliminate at most half the assets from the portfolio, corresponding to this there is a critical ratio $r=2$ beyond which the $\ell_1$ regularized variance cannot be optimized: the regularized variance becomes constant over the simplex. These facts do not seem to have been noticed in the literature.

Suggested Citation

  • Imre Kondor & G'abor Papp & Fabio Caccioli, 2017. "Analytic approach to variance optimization under an $\ell_1$ constraint," Papers 1709.08755, arXiv.org, revised Jul 2018.
  • Handle: RePEc:arx:papers:1709.08755
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1709.08755
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    2. Jorion, Philippe, 1986. "Bayes-Stein Estimation for Portfolio Analysis," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 21(3), pages 279-292, September.
    3. Istvan Varga-Haszonits & Fabio Caccioli & Imre Kondor, 2016. "Replica approach to mean-variance portfolio optimization," Papers 1606.08679, arXiv.org.
    4. Ledoit, Olivier & Wolf, Michael, 2003. "Improved estimation of the covariance matrix of stock returns with an application to portfolio selection," Journal of Empirical Finance, Elsevier, vol. 10(5), pages 603-621, December.
    5. Vasyl Golosnoy & Yarema Okhrin, 2007. "Multivariate Shrinkage for Optimal Portfolio Weights," The European Journal of Finance, Taylor & Francis Journals, vol. 13(5), pages 441-458.
    6. Giannone, Domenico & De Mol, Christine & Daubechies, Ingrid & Brodie, Joshua, 2007. "Sparse and Stable Markowitz Portfolios," CEPR Discussion Papers 6474, C.E.P.R. Discussion Papers.
    7. Varga-Haszonits, Istvan & Caccioli, Fabio & Kondor, Imre, 2016. "Replica approach to mean-variance portfolio optimization," LSE Research Online Documents on Economics 68955, London School of Economics and Political Science, LSE Library.
    8. Victor DeMiguel & Lorenzo Garlappi & Francisco J. Nogales & Raman Uppal, 2009. "A Generalized Approach to Portfolio Optimization: Improving Performance by Constraining Portfolio Norms," Management Science, INFORMS, vol. 55(5), pages 798-812, May.
    9. Imre Kondor & G'abor Papp & Fabio Caccioli, 2016. "Analytic solution to variance optimization with no short-selling," Papers 1612.07067, arXiv.org, revised Jan 2017.
    10. Olivier Ledoit & Michael Wolf, 2011. "Nonlinear shrinkage estimation of large-dimensional covariance matrices," IEW - Working Papers 515, Institute for Empirical Research in Economics - University of Zurich.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Imre Kondor & G'abor Papp & Fabio Caccioli, 2016. "Analytic solution to variance optimization with no short-selling," Papers 1612.07067, arXiv.org, revised Jan 2017.
    2. Fabio Caccioli & Imre Kondor & Matteo Marsili & Susanne Still, 2014. "$L_p$ regularized portfolio optimization," Papers 1404.4040, arXiv.org.
    3. Istvan Varga-Haszonits & Fabio Caccioli & Imre Kondor, 2016. "Replica approach to mean-variance portfolio optimization," Papers 1606.08679, arXiv.org.
    4. Imre Kondor, 2014. "Estimation Error of Expected Shortfall," Papers 1402.5534, arXiv.org.
    5. Yen, Yu-Min & Yen, Tso-Jung, 2014. "Solving norm constrained portfolio optimization via coordinate-wise descent algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 737-759.
    6. Varga-Haszonits, Istvan & Caccioli, Fabio & Kondor, Imre, 2016. "Replica approach to mean-variance portfolio optimization," LSE Research Online Documents on Economics 68955, London School of Economics and Political Science, LSE Library.
    7. Candelon, B. & Hurlin, C. & Tokpavi, S., 2012. "Sampling error and double shrinkage estimation of minimum variance portfolios," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 511-527.
    8. Mishra, Anil V., 2016. "Foreign bias in Australian-domiciled mutual fund holdings," Pacific-Basin Finance Journal, Elsevier, vol. 39(C), pages 101-123.
    9. Mishra, Anil V., 2015. "Measures of equity home bias puzzle," Journal of Empirical Finance, Elsevier, vol. 34(C), pages 293-312.
    10. Thomas Trier Bjerring & Omri Ross & Alex Weissensteiner, 2017. "Feature selection for portfolio optimization," Annals of Operations Research, Springer, vol. 256(1), pages 21-40, September.
    11. G'abor Papp & Fabio Caccioli & Imre Kondor, 2016. "Bias-variance trade-off in portfolio optimization under Expected Shortfall with $\ell_2$ regularization," Papers 1602.08297, arXiv.org, revised Jul 2018.
    12. Nathan Lassance & Frédéric Vrins, 2021. "Minimum Rényi entropy portfolios," Annals of Operations Research, Springer, vol. 299(1), pages 23-46, April.
    13. Fabio Caccioli & Imre Kondor & G'abor Papp, 2015. "Portfolio Optimization under Expected Shortfall: Contour Maps of Estimation Error," Papers 1510.04943, arXiv.org.
    14. Kourtis, Apostolos & Dotsis, George & Markellos, Raphael N., 2012. "Parameter uncertainty in portfolio selection: Shrinking the inverse covariance matrix," Journal of Banking & Finance, Elsevier, vol. 36(9), pages 2522-2531.
    15. Behr, Patrick & Guettler, Andre & Miebs, Felix, 2013. "On portfolio optimization: Imposing the right constraints," Journal of Banking & Finance, Elsevier, vol. 37(4), pages 1232-1242.
    16. Takuya Kinkawa & Nobuo Shinozaki, 2010. "Dominance of a Class of Stein type Estimators for Optimal Portfolio Weights When the Covariance Matrix is Unknown," Asia-Pacific Financial Markets, Springer;Japanese Association of Financial Economics and Engineering, vol. 17(1), pages 19-50, March.
    17. Lim Hao Shen Keith, 2024. "Covariance Matrix Analysis for Optimal Portfolio Selection," Papers 2407.08748, arXiv.org.
    18. Daniel Kinn, 2018. "Reducing Estimation Risk in Mean-Variance Portfolios with Machine Learning," Papers 1804.01764, arXiv.org, revised Jul 2018.
    19. Johannes Bock, 2018. "An updated review of (sub-)optimal diversification models," Papers 1811.08255, arXiv.org.
    20. Fabio Caccioli & Imre Kondor & Matteo Marsili & Susanne Still, 2016. "Liquidity Risk And Instabilities In Portfolio Optimization," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 19(05), pages 1-28, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1709.08755. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.