IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2311.01985.html
   My bibliography  Save this paper

Maximizing Portfolio Predictability with Machine Learning

Author

Listed:
  • Michael Pinelis
  • David Ruppert

Abstract

We construct the maximally predictable portfolio (MPP) of stocks using machine learning. Solving for the optimal constrained weights in the multi-asset MPP gives portfolios with a high monthly coefficient of determination, given the sample covariance matrix of predicted return errors from a machine learning model. Various models for the covariance matrix are tested. The MPPs of S&P 500 index constituents with estimated returns from Elastic Net, Random Forest, and Support Vector Regression models can outperform or underperform the index depending on the time period. Portfolios that take advantage of the high predictability of the MPP's returns and employ a Kelly criterion style strategy consistently outperform the benchmark.

Suggested Citation

  • Michael Pinelis & David Ruppert, 2023. "Maximizing Portfolio Predictability with Machine Learning," Papers 2311.01985, arXiv.org.
    • Handle: RePEc:arx:papers:2311.01985
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2311.01985
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Michael C. Jensen, 1968. "The Performance Of Mutual Funds In The Period 1945–1964," Journal of Finance, American Finance Association, vol. 23(2), pages 389-416, May.
    3. Lo, Andrew W. & Mackinlay, A. Craig, 1997. "Maximizing Predictability In The Stock And Bond Markets," Macroeconomic Dynamics, Cambridge University Press, vol. 1(1), pages 102-134, January.
    4. Henriksson, Roy D & Merton, Robert C, 1981. "On Market Timing and Investment Performance. II. Statistical Procedures for Evaluating Forecasting Skills," The Journal of Business, University of Chicago Press, vol. 54(4), pages 513-533, October.
    5. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
    6. Harry Markowitz, 1952. "Portfolio Selection," Journal of Finance, American Finance Association, vol. 7(1), pages 77-91, March.
    7. Hiroshi Konno & Yuuhei Morita & Rei Yamamoto, 2010. "A maximal predictability portfolio using absolute deviation reformulation," Computational Management Science, Springer, vol. 7(1), pages 47-60, January.
    8. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    9. Hiroshi Konno & Yoshihiro Takaya & Rei Yamamoto, 2010. "A Maximal Predictability Portfolio Using Dynamic Factor Selection Strategy," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 13(03), pages 355-366.
    10. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    11. R. Yamamoto & H. Konno, 2007. "An Efficient Algorithm for Solving Convex–Convex Quadratic Fractional Programs," Journal of Optimization Theory and Applications, Springer, vol. 133(2), pages 241-255, May.
    12. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    13. Huerta, Ramon & Corbacho, Fernando & Elkan, Charles, 2013. "Nonlinear support vector machines can systematically identify stocks with high and low future returns," Algorithmic Finance, IOS Press, vol. 2(1), pages 45-58.
    14. Rei Yamamoto & Daisuke Ishii & Hiroshi Konno, 2007. "A Maximal Predictability Portfolio Model: Algorithm And Performance Evaluation," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 10(06), pages 1095-1109.
    15. Merton, Robert C, 1981. "On Market Timing and Investment Performance. I. An Equilibrium Theory of Value for Market Forecasts," The Journal of Business, University of Chicago Press, vol. 54(3), pages 363-406, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Pinelis & David Ruppert, 2020. "Machine Learning Portfolio Allocation," Papers 2003.00656, arXiv.org, revised Nov 2021.
    2. Philippe Goulet Coulombe & Maximilian Goebel, 2023. "Maximally Machine-Learnable Portfolios," Papers 2306.05568, arXiv.org, revised Apr 2024.
    3. Philippe Goulet Coulombe & Maximilian Gobel, 2023. "Maximally Machine-Learnable Portfolios," Working Papers 23-01, Chair in macroeconomics and forecasting, University of Quebec in Montreal's School of Management, revised Apr 2023.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Chia-Lin Chang & Jukka Ilomäki & Hannu Laurila & Michael McAleer, 2018. "Long Run Returns Predictability and Volatility with Moving Averages," Risks, MDPI, vol. 6(4), pages 1-18, September.
    6. Ding, Jing & Jiang, Lei & Liu, Xiaohui & Peng, Liang, 2023. "Nonparametric tests for market timing ability using daily mutual fund returns," Journal of Economic Dynamics and Control, Elsevier, vol. 150(C).
    7. Massimiliano Caporin & Grégory M. Jannin & Francesco Lisi & Bertrand B. Maillet, 2014. "A Survey On The Four Families Of Performance Measures," Journal of Economic Surveys, Wiley Blackwell, vol. 28(5), pages 917-942, December.
    8. Zhu, Haibin & Bai, Lu & He, Lidan & Liu, Zhi, 2023. "Forecasting realized volatility with machine learning: Panel data perspective," Journal of Empirical Finance, Elsevier, vol. 73(C), pages 251-271.
    9. Francisco Peñaranda & Enrique Sentana, 2024. "Portfolio management with big data," Working Papers wp2024_2411, CEMFI.
    10. Graham, John R. & Harvey, Campbell R., 1996. "Market timing ability and volatility implied in investment newsletters' asset allocation recommendations," Journal of Financial Economics, Elsevier, vol. 42(3), pages 397-421, November.
    11. Zhao, Albert Bo & Cheng, Tingting, 2022. "Stock return prediction: Stacking a variety of models," Journal of Empirical Finance, Elsevier, vol. 67(C), pages 288-317.
    12. , & Stein, Tobias, 2021. "Equity premium predictability over the business cycle," CEPR Discussion Papers 16357, C.E.P.R. Discussion Papers.
    13. Xue Gong & Weiguo Zhang & Yuan Zhao & Xin Ye, 2023. "Forecasting stock volatility with a large set of predictors: A new forecast combination method," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1622-1647, November.
    14. Jonathan Fletcher, 2011. "An Examination of Dynamic Trading Stategies in UK and US Stock Returns," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 38(9-10), pages 1290-1310, November.
    15. Becker, Janis & Leschinski, Christian, 2018. "Directional Predictability of Daily Stock Returns," Hannover Economic Papers (HEP) dp-624, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    16. Alex Hsu & Francisco Palomino & Liang Qian, 2023. "Gone with the Vol: A Decline in Asset Return Predictability During the Great Moderation," Management Science, INFORMS, vol. 69(5), pages 3025-3047, May.
    17. Òscar Jordà & Alan M. Taylor, 2011. "Performance Evaluation of Zero Net-Investment Strategies," NBER Working Papers 17150, National Bureau of Economic Research, Inc.
    18. Lutzenberger, Fabian T., 2014. "The predictability of aggregate returns on commodity futures," Review of Financial Economics, Elsevier, vol. 23(3), pages 120-130.
    19. Lansing, Kevin J. & LeRoy, Stephen F. & Ma, Jun, 2022. "Examining the sources of excess return predictability: Stochastic volatility or market inefficiency?," Journal of Economic Behavior & Organization, Elsevier, vol. 197(C), pages 50-72.
    20. Fernando Rubio, 2005. "Eficiencia De Mercado, Administracion De Carteras De Fondos Y Behavioural Finance," Finance 0503028, University Library of Munich, Germany, revised 23 Jul 2005.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2311.01985. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.