IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v598y2022ics0378437122002928.html
   My bibliography  Save this article

Out-of-sample forecasting of cryptocurrency returns: A comprehensive comparison of predictors and algorithms

Author

Listed:
  • Yae, James
  • Tian, George Zhe

Abstract

Existing evidence shows that daily cryptocurrency returns are predictable by publicly available variables. However, a majority of evidence relies on potentially over-fitted in-sample estimation. This paper provides a comprehensive comparison of predictors and forecasting methods in the literature for out-of-sample return predictions of Bitcoin, Ethereum, and Ripple. We find that (1) well-known in-sample predictors such as investor attention and trading volume fail to produce statistically significant out-of-sample predictability, (2) a change in stochastic correlation with stock markets is the only meaningful predictor with out-of-sample R2 up to 2.69%, 1.71%, and 2.12% for Bitcoin, Ethereum, and Ripple, respectively, and (3) forecasting methods greatly differ in their performances; methods that are inspired by economic mechanism outperform universal forecasting methods such as shrinkage estimators, combination forecasts, monitoring forecasts, and various machine learning algorithms that are commonly used in practice.

Suggested Citation

  • Yae, James & Tian, George Zhe, 2022. "Out-of-sample forecasting of cryptocurrency returns: A comprehensive comparison of predictors and algorithms," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 598(C).
  • Handle: RePEc:eee:phsmap:v:598:y:2022:i:c:s0378437122002928
    DOI: 10.1016/j.physa.2022.127379
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437122002928
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2022.127379?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Bruno Biais & Christophe Bisière & Matthieu Bouvard & Catherine Casamatta & Albert J. Menkveld, 2023. "Equilibrium Bitcoin Pricing," Journal of Finance, American Finance Association, vol. 78(2), pages 967-1014, April.
    3. Pavel Ciaian & Miroslava Rajcaniova & d’Artis Kancs, 2016. "The economics of BitCoin price formation," Applied Economics, Taylor & Francis Journals, vol. 48(19), pages 1799-1815, April.
    4. Demir, Ender & Gozgor, Giray & Lau, Chi Keung Marco & Vigne, Samuel A., 2018. "Does economic policy uncertainty predict the Bitcoin returns? An empirical investigation," Finance Research Letters, Elsevier, vol. 26(C), pages 145-149.
    5. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    6. Chowdhury, Reaz & Rahman, M. Arifur & Rahman, M. Sohel & Mahdy, M.R.C., 2020. "An approach to predict and forecast the price of constituents and index of cryptocurrency using machine learning," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 551(C).
    7. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    8. Admati, Anat R & Pfleiderer, Paul, 1989. "Divide and Conquer: A Theory of Intraday and Day-of-the-Week Mean Effects," The Review of Financial Studies, Society for Financial Studies, vol. 2(2), pages 189-223.
    9. Zhang, Wei & Wang, Pengfei & Li, Xiao & Shen, Dehua, 2018. "Quantifying the cross-correlations between online searches and Bitcoin market," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 509(C), pages 657-672.
    10. Guégan, Dominique & Renault, Thomas, 2021. "Does investor sentiment on social media provide robust information for Bitcoin returns predictability?," Finance Research Letters, Elsevier, vol. 38(C).
    11. Stambaugh, Robert F., 1999. "Predictive regressions," Journal of Financial Economics, Elsevier, vol. 54(3), pages 375-421, December.
    12. Shen, Dehua & Urquhart, Andrew & Wang, Pengfei, 2019. "Does twitter predict Bitcoin?," Economics Letters, Elsevier, vol. 174(C), pages 118-122.
    13. Whitney K. Newey & Kenneth D. West, 1994. "Automatic Lag Selection in Covariance Matrix Estimation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 61(4), pages 631-653.
    14. R. David Mclean & Jeffrey Pontiff, 2016. "Does Academic Research Destroy Stock Return Predictability?," Journal of Finance, American Finance Association, vol. 71(1), pages 5-32, February.
    15. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    16. Łukasz Goczek & Ivan Skliarov, 2019. "What drives the Bitcoin price? A factor augmented error correction mechanism investigation," Applied Economics, Taylor & Francis Journals, vol. 51(59), pages 6393-6410, December.
    17. Wang, Yudong & Liu, Li & Ma, Feng & Diao, Xundi, 2018. "Momentum of return predictability," Journal of Empirical Finance, Elsevier, vol. 45(C), pages 141-156.
    18. Bouri, Elie & Lau, Chi Keung Marco & Lucey, Brian & Roubaud, David, 2019. "Trading volume and the predictability of return and volatility in the cryptocurrency market," Finance Research Letters, Elsevier, vol. 29(C), pages 340-346.
    19. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    20. Erdinc Akyildirim & Ahmet Goncu & Ahmet Sensoy, 2021. "Prediction of cryptocurrency returns using machine learning," Annals of Operations Research, Springer, vol. 297(1), pages 3-36, February.
    21. Kyle, Albert S, 1985. "Continuous Auctions and Insider Trading," Econometrica, Econometric Society, vol. 53(6), pages 1315-1335, November.
    22. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," The Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
    23. Naeem, Muhammad Abubakr & Mbarki, Imen & Shahzad, Syed Jawad Hussain, 2021. "Predictive role of online investor sentiment for cryptocurrency market: Evidence from happiness and fears," International Review of Economics & Finance, Elsevier, vol. 73(C), pages 496-514.
    24. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    25. Hongwei Zhang & Qiang He & Ben Jacobsen & Fuwei Jiang, 2020. "Forecasting stock returns with model uncertainty and parameter instability," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 629-644, August.
    26. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    27. Balcilar, Mehmet & Bouri, Elie & Gupta, Rangan & Roubaud, David, 2017. "Can volume predict Bitcoin returns and volatility? A quantiles-based approach," Economic Modelling, Elsevier, vol. 64(C), pages 74-81.
    28. Narayan, Paresh Kumar & Liu, Ruipeng, 2018. "A new GARCH model with higher moments for stock return predictability," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 56(C), pages 93-103.
    29. Engle, Robert, 2002. "Dynamic Conditional Correlation: A Simple Class of Multivariate Generalized Autoregressive Conditional Heteroskedasticity Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 339-350, July.
    30. Aalborg, Halvor Aarhus & Molnár, Peter & de Vries, Jon Erik, 2019. "What can explain the price, volatility and trading volume of Bitcoin?," Finance Research Letters, Elsevier, vol. 29(C), pages 255-265.
    31. Athey, Susan & Parashkevov, Ivo & Sarukkai, Vishnu & Xia, Jing, 2016. "Bitcoin Pricing, Adoption, and Usage: Theory and Evidence," Research Papers 3469, Stanford University, Graduate School of Business.
    32. David F. Hendry & Michael P. Clements, 2004. "Pooling of forecasts," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 1-31, June.
    33. Yukun Liu & Aleh Tsyvinski, 2021. "Risks and Returns of Cryptocurrency," The Review of Financial Studies, Society for Financial Studies, vol. 34(6), pages 2689-2727.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nicolás Magner & Nicolás Hardy, 2022. "Cryptocurrency Forecasting: More Evidence of the Meese-Rogoff Puzzle," Mathematics, MDPI, vol. 10(13), pages 1-27, July.
    2. Liu, Yujun & Li, Zhongfei & Nekhili, Ramzi & Sultan, Jahangir, 2023. "Forecasting cryptocurrency returns with machine learning," Research in International Business and Finance, Elsevier, vol. 64(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tan, Xilong & Tao, Yubo, 2023. "Trend-based forecast of cryptocurrency returns," Economic Modelling, Elsevier, vol. 124(C).
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Smith, Simon C., 2021. "International stock return predictability," International Review of Financial Analysis, Elsevier, vol. 78(C).
    4. Zhao, Albert Bo & Cheng, Tingting, 2022. "Stock return prediction: Stacking a variety of models," Journal of Empirical Finance, Elsevier, vol. 67(C), pages 288-317.
    5. Dunbar, Kwamie & Owusu-Amoako, Johnson, 2023. "Predictability of crypto returns: The impact of trading behavior," Journal of Behavioral and Experimental Finance, Elsevier, vol. 39(C).
    6. Cakici, Nusret & Shahzad, Syed Jawad Hussain & Będowska-Sójka, Barbara & Zaremba, Adam, 2024. "Machine learning and the cross-section of cryptocurrency returns," International Review of Financial Analysis, Elsevier, vol. 94(C).
    7. Allan Timmermann, 2018. "Forecasting Methods in Finance," Annual Review of Financial Economics, Annual Reviews, vol. 10(1), pages 449-479, November.
    8. Yi, Yongsheng & Ma, Feng & Zhang, Yaojie & Huang, Dengshi, 2019. "Forecasting stock returns with cycle-decomposed predictors," International Review of Financial Analysis, Elsevier, vol. 64(C), pages 250-261.
    9. Ahmed, Walid M.A., 2022. "Robust drivers of Bitcoin price movements: An extreme bounds analysis," The North American Journal of Economics and Finance, Elsevier, vol. 62(C).
    10. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    11. Ahmed, Walid M.A. & Al Mafrachi, Mustafa, 2021. "Do higher-order realized moments matter for cryptocurrency returns?," International Review of Economics & Finance, Elsevier, vol. 72(C), pages 483-499.
    12. Wan, Runqing & Fulop, Andras & Li, Junye, 2022. "Real-time Bayesian learning and bond return predictability," Journal of Econometrics, Elsevier, vol. 230(1), pages 114-130.
    13. Hoang, Lai T. & Baur, Dirk G., 2022. "Loaded for bear: Bitcoin private wallets, exchange reserves and prices," Journal of Banking & Finance, Elsevier, vol. 144(C).
    14. Davide Pettenuzzo & Francesco Ravazzolo, 2016. "Optimal Portfolio Choice Under Decision‐Based Model Combinations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(7), pages 1312-1332, November.
    15. Aurelio F. Bariviera & Ignasi Merediz‐Solà, 2021. "Where Do We Stand In Cryptocurrencies Economic Research? A Survey Based On Hybrid Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 35(2), pages 377-407, April.
    16. Leland E. Farmer & Lawrence Schmidt & Allan Timmermann, 2023. "Pockets of Predictability," Journal of Finance, American Finance Association, vol. 78(3), pages 1279-1341, June.
    17. , & Stein, Tobias, 2021. "Equity premium predictability over the business cycle," CEPR Discussion Papers 16357, C.E.P.R. Discussion Papers.
    18. Back, Kerry & Crotty, Kevin & Kazempour, Seyed Mohammad, 2022. "Validity, tightness, and forecasting power of risk premium bounds," Journal of Financial Economics, Elsevier, vol. 144(3), pages 732-760.
    19. Bennett, Donyetta & Mekelburg, Erik & Strauss, Jack & Williams, T.H., 2024. "Unlocking the black box of sentiment and cryptocurrency: What, which, why, when and how?," Global Finance Journal, Elsevier, vol. 60(C).
    20. Xue Gong & Weiguo Zhang & Yuan Zhao & Xin Ye, 2023. "Forecasting stock volatility with a large set of predictors: A new forecast combination method," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1622-1647, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:598:y:2022:i:c:s0378437122002928. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.