IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2204.12914.html
   My bibliography  Save this paper

Forecasting foreign exchange rates with regression networks tuned by Bayesian optimization

Author

Listed:
  • Linwei Li
  • Paul-Amaury Matt
  • Christian Heumann

Abstract

The article is concerned with the problem of multi-step financial time series forecasting of Foreign Exchange (FX) rates. To address this problem, we introduce a regression network termed RegPred Net. The exchange rate to forecast is treated as a stochastic process. It is assumed to follow a generalization of Brownian motion and the mean-reverting process referred to as the generalized Ornstein-Uhlenbeck (OU) process, with time-dependent coefficients. Using past observed values of the input time series, these coefficients can be regressed online by the cells of the first half of the network (Reg). The regressed coefficients depend only on - but are very sensitive to - a small number of hyperparameters required to be set by a global optimization procedure for which, Bayesian optimization is an adequate heuristic. Thanks to its multi-layered architecture, the second half of the regression network (Pred) can project time-dependent values for the OU process coefficients and generate realistic trajectories of the time series. Predictions can be easily derived in the form of expected values estimated by averaging values obtained by Monte Carlo simulation. The forecasting accuracy on a 100 days horizon is evaluated for several of the most important FX rates such as EUR/USD, EUR/CNY, and EUR/GBP. Our experimental results show that the RegPred Net significantly outperforms ARMA, ARIMA, LSTMs, and Autoencoder-LSTM models in terms of metrics measuring the absolute error (RMSE) and correlation between predicted and actual values (Pearson R, R-squared, MDA). Compared to black-box deep learning models such as LSTM, RegPred Net has better interpretability, simpler structure, and fewer parameters.

Suggested Citation

  • Linwei Li & Paul-Amaury Matt & Christian Heumann, 2022. "Forecasting foreign exchange rates with regression networks tuned by Bayesian optimization," Papers 2204.12914, arXiv.org, revised May 2022.
    • Handle: RePEc:arx:papers:2204.12914
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2204.12914
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wei Bao & Jun Yue & Yulei Rao, 2017. "A deep learning framework for financial time series using stacked autoencoders and long-short term memory," PLOS ONE, Public Library of Science, vol. 12(7), pages 1-24, July.
    2. Zhiqiang Guo & Huaiqing Wang & Quan Liu & Jie Yang, 2014. "A Feature Fusion Based Forecasting Model for Financial Time Series," PLOS ONE, Public Library of Science, vol. 9(6), pages 1-13, June.
    3. Fischer, Thomas & Krauss, Christopher, 2017. "Deep learning with long short-term memory networks for financial market predictions," FAU Discussion Papers in Economics 11/2017, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Taewook Kim & Ha Young Kim, 2019. "Forecasting stock prices with a feature fusion LSTM-CNN model using different representations of the same data," PLOS ONE, Public Library of Science, vol. 14(2), pages 1-23, February.
    2. Zihao Zhang & Stefan Zohren & Stephen Roberts, 2018. "DeepLOB: Deep Convolutional Neural Networks for Limit Order Books," Papers 1808.03668, arXiv.org, revised Jan 2020.
    3. Mahla Nikou & Gholamreza Mansourfar & Jamshid Bagherzadeh, 2019. "Stock price prediction using DEEP learning algorithm and its comparison with machine learning algorithms," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 26(4), pages 164-174, October.
    4. Sang Il Lee & Seong Joon Yoo, 2019. "Multimodal Deep Learning for Finance: Integrating and Forecasting International Stock Markets," Papers 1903.06478, arXiv.org, revised Sep 2019.
    5. Jian Huang & Junyi Chai & Stella Cho, 2020. "Deep learning in finance and banking: A literature review and classification," Frontiers of Business Research in China, Springer, vol. 14(1), pages 1-24, December.
    6. Kamaladdin Fataliyev & Aneesh Chivukula & Mukesh Prasad & Wei Liu, 2021. "Stock Market Analysis with Text Data: A Review," Papers 2106.12985, arXiv.org, revised Jul 2021.
    7. Andrea Bucci, 2020. "Realized Volatility Forecasting with Neural Networks," Journal of Financial Econometrics, Oxford University Press, vol. 18(3), pages 502-531.
    8. Jaydip Sen & Sidra Mehtab & Abhishek Dutta & Saikat Mondal, 2022. "Precise Stock Price Prediction for Optimized Portfolio Design Using an LSTM Model," Papers 2203.01326, arXiv.org.
    9. Jaydip Sen & Sidra Mehtab, 2021. "Design and Analysis of Robust Deep Learning Models for Stock Price Prediction," Papers 2106.09664, arXiv.org.
    10. Umut Ugurlu & Ilkay Oksuz & Oktay Tas, 2018. "Electricity Price Forecasting Using Recurrent Neural Networks," Energies, MDPI, vol. 11(5), pages 1-23, May.
    11. Adebayo Oshingbesan & Eniola Ajiboye & Peruth Kamashazi & Timothy Mbaka, 2022. "Model-Free Reinforcement Learning for Asset Allocation," Papers 2209.10458, arXiv.org.
    12. Rian Dolphin & Barry Smyth & Ruihai Dong, 2024. "Contrastive Learning of Asset Embeddings from Financial Time Series," Papers 2407.18645, arXiv.org.
    13. Tomoshiro Ochiai & Jose C. Nacher, 2020. "Unveiling the directional network behind the financial statements data using volatility constraint correlation," Papers 2008.07836, arXiv.org, revised Jun 2023.
    14. Junyi Li & Xitong Wang & Yaoyang Lin & Arunesh Sinha & Micheal P. Wellman, 2020. "Generating Realistic Stock Market Order Streams," Papers 2006.04212, arXiv.org.
    15. James Wallbridge, 2020. "Transformers for Limit Order Books," Papers 2003.00130, arXiv.org.
    16. Antoine Proteau & Antoine Tahan & Ryad Zemouri & Marc Thomas, 2023. "Predicting the quality of a machined workpiece with a variational autoencoder approach," Journal of Intelligent Manufacturing, Springer, vol. 34(2), pages 719-737, February.
    17. Yang Qiao & Yiping Xia & Xiang Li & Zheng Li & Yan Ge, 2023. "Higher-order Graph Attention Network for Stock Selection with Joint Analysis," Papers 2306.15526, arXiv.org.
    18. Daiki Matsunaga & Toyotaro Suzumura & Toshihiro Takahashi, 2019. "Exploring Graph Neural Networks for Stock Market Predictions with Rolling Window Analysis," Papers 1909.10660, arXiv.org, revised Nov 2019.
    19. Raphael Paulo Beal Piovezan & Pedro Paulo Andrade Junior & Sérgio Luciano Ávila, 2024. "Machine Learning Method for Return Direction Forecast of Exchange Traded Funds (ETFs) Using Classification and Regression Models," Computational Economics, Springer;Society for Computational Economics, vol. 63(5), pages 1827-1852, May.
    20. Kambombo Mtonga & Santhi Kumaran & Chomora Mikeka & Kayalvizhi Jayavel & Jimmy Nsenga, 2019. "Machine Learning-Based Patient Load Prediction and IoT Integrated Intelligent Patient Transfer Systems," Future Internet, MDPI, vol. 11(11), pages 1-24, November.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2204.12914. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.