IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v301y2022i2p694-707.html
   My bibliography  Save this article

Why estimation alone causes Markowitz portfolio selection to fail and what we might do about it

Author

Listed:
  • Mynbayeva, Elmira
  • Lamb, John D.
  • Zhao, Yuan

Abstract

Markowitz optimisation is well known to work poorly in practice, but it has not been clear why this happens. We show both theoretically and empirically that Markowitz optimisation is likely to fail badly, even with normally-distributed data, with no time series or correlation effects, and even with shrinkage estimators to reduce estimation risk. A core problem is that very often we cannot confidently distinguish between the mean returns of most assets. We develop a method, based on a sequentially rejective test procedure, to help remedy this problem by identifying subsets of assets indistinguishable in mean or variance. We test our method against naive Markowitz and compare it to other methods, including bootstrap aggregation, proposed to remedy the poor practical performance of Markowitz optimisation. We use out-of-sample and bootstrap tests on data from several market indices and hedge funds. We find our method is more robust than naive Markowitz and outperforms equally weighted portfolios but bootstrap aggregation works, as expected, better when we cannot distinguish among means. We also find evidence that covariance shrinkage improves performance.

Suggested Citation

  • Mynbayeva, Elmira & Lamb, John D. & Zhao, Yuan, 2022. "Why estimation alone causes Markowitz portfolio selection to fail and what we might do about it," European Journal of Operational Research, Elsevier, vol. 301(2), pages 694-707.
  • Handle: RePEc:eee:ejores:v:301:y:2022:i:2:p:694-707
    DOI: 10.1016/j.ejor.2021.11.036
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221721009863
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2021.11.036?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    2. Jorion, Philippe, 1985. "International Portfolio Diversification with Estimation Risk," The Journal of Business, University of Chicago Press, vol. 58(3), pages 259-278, July.
    3. Jorion, Philippe, 1986. "Bayes-Stein Estimation for Portfolio Analysis," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 21(3), pages 279-292, September.
    4. Richard H. Thaler & Shlomo Benartzi, 2001. "Naive Diversification Strategies in Defined Contribution Saving Plans," American Economic Review, American Economic Association, vol. 91(1), pages 79-98, March.
    5. Harry Markowitz, 1952. "Portfolio Selection," Journal of Finance, American Finance Association, vol. 7(1), pages 77-91, March.
    6. Victor DeMiguel & Lorenzo Garlappi & Raman Uppal, 2009. "Optimal Versus Naive Diversification: How Inefficient is the 1-N Portfolio Strategy?," The Review of Financial Studies, Society for Financial Studies, vol. 22(5), pages 1915-1953, May.
    7. Olivier Ledoit & Michael Wolf, 2017. "Nonlinear Shrinkage of the Covariance Matrix for Portfolio Selection: Markowitz Meets Goldilocks," The Review of Financial Studies, Society for Financial Studies, vol. 30(12), pages 4349-4388.
    8. Fliege, Jörg & Werner, Ralf, 2014. "Robust multiobjective optimization & applications in portfolio optimization," European Journal of Operational Research, Elsevier, vol. 234(2), pages 422-433.
    9. Hwang, Inchang & Xu, Simon & In, Francis, 2018. "Naive versus optimal diversification: Tail risk and performance," European Journal of Operational Research, Elsevier, vol. 265(1), pages 372-388.
    10. Kolm, Petter N. & Tütüncü, Reha & Fabozzi, Frank J., 2014. "60 Years of portfolio optimization: Practical challenges and current trends," European Journal of Operational Research, Elsevier, vol. 234(2), pages 356-371.
    11. Meade, N. & Beasley, J.E. & Adcock, C.J., 2021. "Quantitative portfolio selection: Using density forecasting to find consistent portfolios," European Journal of Operational Research, Elsevier, vol. 288(3), pages 1053-1067.
    12. Kan, Raymond & Zhou, Guofu, 2007. "Optimal Portfolio Choice with Parameter Uncertainty," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 42(3), pages 621-656, September.
    13. Kenneth J. Arrow, 1950. "A Difficulty in the Concept of Social Welfare," Journal of Political Economy, University of Chicago Press, vol. 58(4), pages 328-328.
    14. Panos Xidonas & Ralph Steuer & Christis Hassapis, 2020. "Robust portfolio optimization: a categorized bibliographic review," Annals of Operations Research, Springer, vol. 292(1), pages 533-552, September.
    15. Cerrato, Mario & Crosby, John & Kim, Minjoo & Zhao, Yang, 2017. "Relation between higher order comoments and dependence structure of equity portfolio," Journal of Empirical Finance, Elsevier, vol. 40(C), pages 101-120.
    16. Yuanyuan Zhang & Xiang Li & Sini Guo, 2018. "Portfolio selection problems with Markowitz’s mean–variance framework: a review of literature," Fuzzy Optimization and Decision Making, Springer, vol. 17(2), pages 125-158, June.
    17. Vinod, H. D., 2004. "Ranking mutual funds using unconventional utility theory and stochastic dominance," Journal of Empirical Finance, Elsevier, vol. 11(3), pages 353-377, June.
    18. Lamb, John D. & Tee, Kai-Hong, 2012. "Resampling DEA estimates of investment fund performance," European Journal of Operational Research, Elsevier, vol. 223(3), pages 834-841.
    19. Campbell Harvey & John Liechty & Merrill Liechty & Peter Muller, 2010. "Portfolio selection with higher moments," Quantitative Finance, Taylor & Francis Journals, vol. 10(5), pages 469-485.
    20. Merton, Robert C., 1980. "On estimating the expected return on the market : An exploratory investigation," Journal of Financial Economics, Elsevier, vol. 8(4), pages 323-361, December.
    21. Gabriel Frahm, 2015. "A theoretical foundation of portfolio resampling," Theory and Decision, Springer, vol. 79(1), pages 107-132, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Platanakis, Emmanouil & Sutcliffe, Charles & Ye, Xiaoxia, 2021. "Horses for courses: Mean-variance for asset allocation and 1/N for stock selection," European Journal of Operational Research, Elsevier, vol. 288(1), pages 302-317.
    2. Yan, Cheng & Zhang, Huazhu, 2017. "Mean-variance versus naïve diversification: The role of mispricing," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 48(C), pages 61-81.
    3. Lassance, Nathan, 2022. "Reconciling mean-variance portfolio theory with non-Gaussian returns," European Journal of Operational Research, Elsevier, vol. 297(2), pages 729-740.
    4. Chavez-Bedoya, Luis & Rosales, Francisco, 2022. "Orthogonal portfolios to assess estimation risk," International Review of Economics & Finance, Elsevier, vol. 80(C), pages 906-937.
    5. Petukhina, Alla & Klochkov, Yegor & Härdle, Wolfgang Karl & Zhivotovskiy, Nikita, 2024. "Robustifying Markowitz," Journal of Econometrics, Elsevier, vol. 239(2).
    6. Chakrabarti, Deepayan, 2021. "Parameter-free robust optimization for the maximum-Sharpe portfolio problem," European Journal of Operational Research, Elsevier, vol. 293(1), pages 388-399.
    7. Lassance, Nathan & Vrins, Frédéric, 2019. "Robust portfolio selection using sparse estimation of comoment tensors," LIDAM Discussion Papers LFIN 2019007, Université catholique de Louvain, Louvain Finance (LFIN).
    8. Lim Hao Shen Keith, 2024. "Covariance Matrix Analysis for Optimal Portfolio Selection," Papers 2407.08748, arXiv.org.
    9. Johannes Bock, 2018. "An updated review of (sub-)optimal diversification models," Papers 1811.08255, arXiv.org.
    10. Hwang, Inchang & Xu, Simon & In, Francis, 2018. "Naive versus optimal diversification: Tail risk and performance," European Journal of Operational Research, Elsevier, vol. 265(1), pages 372-388.
    11. Kircher, Felix & Rösch, Daniel, 2021. "A shrinkage approach for Sharpe ratio optimal portfolios with estimation risks," Journal of Banking & Finance, Elsevier, vol. 133(C).
    12. Meade, N. & Beasley, J.E. & Adcock, C.J., 2021. "Quantitative portfolio selection: Using density forecasting to find consistent portfolios," European Journal of Operational Research, Elsevier, vol. 288(3), pages 1053-1067.
    13. Härdle, Wolfgang & Klochkov, Yegor & Petukhina, Alla & Zhivotovskiy, Nikita, 2021. "Robustifying Markowitz," IRTG 1792 Discussion Papers 2021-018, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    14. Hsu, Po-Hsuan & Han, Qiheng & Wu, Wensheng & Cao, Zhiguang, 2018. "Asset allocation strategies, data snooping, and the 1 / N rule," Journal of Banking & Finance, Elsevier, vol. 97(C), pages 257-269.
    15. Behr, Patrick & Guettler, Andre & Miebs, Felix, 2013. "On portfolio optimization: Imposing the right constraints," Journal of Banking & Finance, Elsevier, vol. 37(4), pages 1232-1242.
    16. Kremer, Philipp J. & Lee, Sangkyun & Bogdan, Małgorzata & Paterlini, Sandra, 2020. "Sparse portfolio selection via the sorted ℓ1-Norm," Journal of Banking & Finance, Elsevier, vol. 110(C).
    17. Ding, Wenliang & Shu, Lianjie & Gu, Xinhua, 2023. "A robust Glasso approach to portfolio selection in high dimensions," Journal of Empirical Finance, Elsevier, vol. 70(C), pages 22-37.
    18. Wolfgang Karl Hardle & Yegor Klochkov & Alla Petukhina & Nikita Zhivotovskiy, 2022. "Robustifying Markowitz," Papers 2212.13996, arXiv.org.
    19. Platanakis, Emmanouil & Sakkas, Athanasios & Sutcliffe, Charles, 2019. "Harmful diversification: Evidence from alternative investments," The British Accounting Review, Elsevier, vol. 51(1), pages 1-23.
    20. Behr, Patrick & Guettler, Andre & Truebenbach, Fabian, 2012. "Using industry momentum to improve portfolio performance," Journal of Banking & Finance, Elsevier, vol. 36(5), pages 1414-1423.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:301:y:2022:i:2:p:694-707. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.