IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2301.08359.html
   My bibliography  Save this paper

Domain-adapted Learning and Interpretability: DRL for Gas Trading

Author

Listed:
  • Yuanrong Wang
  • Yinsen Miao
  • Alexander CY Wong
  • Nikita P Granger
  • Christian Michler

Abstract

Deep Reinforcement Learning (Deep RL) has been explored for a number of applications in finance and stock trading. In this paper, we present a practical implementation of Deep RL for trading natural gas futures contracts. The Sharpe Ratio obtained exceeds benchmarks given by trend following and mean reversion strategies as well as results reported in literature. Moreover, we propose a simple but effective ensemble learning scheme for trading, which significantly improves performance through enhanced model stability and robustness as well as lower turnover and hence lower transaction cost. We discuss the resulting Deep RL strategy in terms of model explainability, trading frequency and risk measures.

Suggested Citation

  • Yuanrong Wang & Yinsen Miao & Alexander CY Wong & Nikita P Granger & Christian Michler, 2023. "Domain-adapted Learning and Interpretability: DRL for Gas Trading," Papers 2301.08359, arXiv.org, revised Sep 2023.
    • Handle: RePEc:arx:papers:2301.08359
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2301.08359
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Francis X. Diebold & Neil A. Doherty & Richard J. Herring, 2010. "The Known, the Unknown, and the Unknowable in Financial Risk Management: Measurement and Theory Advancing Practice," Economics Books, Princeton University Press, edition 1, number 9223.
    2. Yuanrong Wang & Tomaso Aste, 2022. "Sparsification and Filtering for Spatial-temporal GNN in Multivariate Time-series," Papers 2203.03991, arXiv.org.
    3. Ling Tang & Wei Dai & Lean Yu & Shouyang Wang, 2015. "A Novel CEEMD-Based EELM Ensemble Learning Paradigm for Crude Oil Price Forecasting," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 14(01), pages 141-169.
    4. Zihao Zhang & Stefan Zohren & Stephen Roberts, 2019. "Deep Reinforcement Learning for Trading," Papers 1911.10107, arXiv.org.
    5. Vangelis Bacoyannis & Vacslav Glukhov & Tom Jin & Jonathan Kochems & Doo Re Song, 2018. "Idiosyncrasies and challenges of data driven learning in electronic trading," Papers 1811.09549, arXiv.org, revised Nov 2018.
    6. Saeed Moshiri & Faezeh Foroutan, 2006. "Forecasting Nonlinear Crude Oil Futures Prices," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 81-96.
    7. Safari, Ali & Davallou, Maryam, 2018. "Oil price forecasting using a hybrid model," Energy, Elsevier, vol. 148(C), pages 49-58.
    8. Zhao, Lu-Tao & Wang, Yi & Guo, Shi-Qiu & Zeng, Guan-Rong, 2018. "A novel method based on numerical fitting for oil price trend forecasting," Applied Energy, Elsevier, vol. 220(C), pages 154-163.
    9. Svetlana Borovkova & Ioannis Tsiamas, 2019. "An ensemble of LSTM neural networks for high‐frequency stock market classification," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 38(6), pages 600-619, September.
    10. Saeed Moshiri & Faezeh Foroutan, 2006. "Forecasting Nonlinear Crude Oil Futures Prices," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 81-96.
    11. Thomas Spooner & John Fearnley & Rahul Savani & Andreas Koukorinis, 2018. "Market Making via Reinforcement Learning," Papers 1804.04216, arXiv.org.
    12. Jacobo Roa-Vicens & Cyrine Chtourou & Angelos Filos & Francisco Rullan & Yarin Gal & Ricardo Silva, 2019. "Towards Inverse Reinforcement Learning for Limit Order Book Dynamics," Papers 1906.04813, arXiv.org.
    13. Zhao, Yang & Li, Jianping & Yu, Lean, 2017. "A deep learning ensemble approach for crude oil price forecasting," Energy Economics, Elsevier, vol. 66(C), pages 9-16.
    14. Yu, Lean & Wang, Shouyang & Lai, Kin Keung, 2008. "Forecasting crude oil price with an EMD-based neural network ensemble learning paradigm," Energy Economics, Elsevier, vol. 30(5), pages 2623-2635, September.
    15. Zhang, Jin-Liang & Zhang, Yue-Jun & Zhang, Lu, 2015. "A novel hybrid method for crude oil price forecasting," Energy Economics, Elsevier, vol. 49(C), pages 649-659.
    16. Lubnau, Thorben & Todorova, Neda, 2015. "Trading on mean-reversion in energy futures markets," Energy Economics, Elsevier, vol. 51(C), pages 312-319.
    17. Godarzi, Ali Abbasi & Amiri, Rohollah Madadi & Talaei, Alireza & Jamasb, Tooraj, 2014. "Predicting oil price movements: A dynamic Artificial Neural Network approach," Energy Policy, Elsevier, vol. 68(C), pages 371-382.
    18. Jammazi, Rania & Aloui, Chaker, 2012. "Crude oil price forecasting: Experimental evidence from wavelet decomposition and neural network modeling," Energy Economics, Elsevier, vol. 34(3), pages 828-841.
    19. Bertsimas, Dimitris & Lo, Andrew W., 1998. "Optimal control of execution costs," Journal of Financial Markets, Elsevier, vol. 1(1), pages 1-50, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lin, Ling & Jiang, Yong & Xiao, Helu & Zhou, Zhongbao, 2020. "Crude oil price forecasting based on a novel hybrid long memory GARCH-M and wavelet analysis model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 543(C).
    2. Abdollahi, Hooman & Ebrahimi, Seyed Babak, 2020. "A new hybrid model for forecasting Brent crude oil price," Energy, Elsevier, vol. 200(C).
    3. Liyang Tang, 2020. "Application of Nonlinear Autoregressive with Exogenous Input (NARX) neural network in macroeconomic forecasting, national goal setting and global competitiveness assessment," Papers 2005.08735, arXiv.org.
    4. Wang, Minggang & Zhao, Longfeng & Du, Ruijin & Wang, Chao & Chen, Lin & Tian, Lixin & Eugene Stanley, H., 2018. "A novel hybrid method of forecasting crude oil prices using complex network science and artificial intelligence algorithms," Applied Energy, Elsevier, vol. 220(C), pages 480-495.
    5. Abdollahi, Hooman, 2020. "A novel hybrid model for forecasting crude oil price based on time series decomposition," Applied Energy, Elsevier, vol. 267(C).
    6. Manickavasagam, Jeevananthan & Visalakshmi, S. & Apergis, Nicholas, 2020. "A novel hybrid approach to forecast crude oil futures using intraday data," Technological Forecasting and Social Change, Elsevier, vol. 158(C).
    7. Safari, Ali & Davallou, Maryam, 2018. "Oil price forecasting using a hybrid model," Energy, Elsevier, vol. 148(C), pages 49-58.
    8. Yulian Zhang & Shigeyuki Hamori, 2020. "Forecasting Crude Oil Market Crashes Using Machine Learning Technologies," Energies, MDPI, vol. 13(10), pages 1-14, May.
    9. Cheng, Zishu & Li, Mingchen & Sun, Yuying & Hong, Yongmiao & Wang, Shouyang, 2024. "Climate change and crude oil prices: An interval forecast model with interval-valued textual data," Energy Economics, Elsevier, vol. 134(C).
    10. Zhao, Yang & Li, Jianping & Yu, Lean, 2017. "A deep learning ensemble approach for crude oil price forecasting," Energy Economics, Elsevier, vol. 66(C), pages 9-16.
    11. Zhang, Tingting & Tang, Zhenpeng & Wu, Junchuan & Du, Xiaoxu & Chen, Kaijie, 2021. "Multi-step-ahead crude oil price forecasting based on two-layer decomposition technique and extreme learning machine optimized by the particle swarm optimization algorithm," Energy, Elsevier, vol. 229(C).
    12. Li, Jinchao & Zhu, Shaowen & Wu, Qianqian, 2019. "Monthly crude oil spot price forecasting using variational mode decomposition," Energy Economics, Elsevier, vol. 83(C), pages 240-253.
    13. Sen, Abhibasu & Dutta Choudhury, Karabi, 2024. "Forecasting the Crude Oil prices for last four decades using deep learning approach," Resources Policy, Elsevier, vol. 88(C).
    14. Nademi, Arash & Nademi, Younes, 2018. "Forecasting crude oil prices by a semiparametric Markov switching model: OPEC, WTI, and Brent cases," Energy Economics, Elsevier, vol. 74(C), pages 757-766.
    15. Wang, Yudong & Liu, Li & Diao, Xundi & Wu, Chongfeng, 2015. "Forecasting the real prices of crude oil under economic and statistical constraints," Energy Economics, Elsevier, vol. 51(C), pages 599-608.
    16. Karasu, Seçkin & Altan, Aytaç, 2022. "Crude oil time series prediction model based on LSTM network with chaotic Henry gas solubility optimization," Energy, Elsevier, vol. 242(C).
    17. Qi Zhang & Yi Hu & Jianbin Jiao & Shouyang Wang, 2022. "Exploring the Trend of Commodity Prices: A Review and Bibliometric Analysis," Sustainability, MDPI, vol. 14(15), pages 1-22, August.
    18. Bai, Yun & Li, Xixi & Yu, Hao & Jia, Suling, 2022. "Crude oil price forecasting incorporating news text," International Journal of Forecasting, Elsevier, vol. 38(1), pages 367-383.
    19. Wu, Yu-Xi & Wu, Qing-Biao & Zhu, Jia-Qi, 2019. "Improved EEMD-based crude oil price forecasting using LSTM networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 516(C), pages 114-124.
    20. Taiyong Li & Yingrui Zhou & Xinsheng Li & Jiang Wu & Ting He, 2019. "Forecasting Daily Crude Oil Prices Using Improved CEEMDAN and Ridge Regression-Based Predictors," Energies, MDPI, vol. 12(19), pages 1-25, September.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2301.08359. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.