IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v231y2021ics0360544221012111.html
   My bibliography  Save this article

A combined architecture of multivariate LSTM with Mahalanobis and Z-Score transformations for oil price forecasting

Author

Listed:
  • Urolagin, Siddhaling
  • Sharma, Nikhil
  • Datta, Tapan Kumar

Abstract

Oil price plays a vital role in a country's economy. Oil price forecasting helps in making better economic planning and decisions. The fluctuation in the oil price occurs due to several factors that make oil price forecasting a challenging task. Deep learning models such as Recurrent Neural Networks (RNN) have emerged as a successful method in solving many nonlinear and complex problems. In this research, a combined architecture of Multivariate Long Short Term Memory (MLSTM) is proposed with Mahalanobis and Z-score transformations. These transformations improve the data to uncorrelated and standardized variance, thus making data more suitable for regression analysis. The available historical time-series data on the West Texas Intermediate (WTI) oil prices and the factors affecting the oil prices are collected to form the data set. The feature selection process using selectKBest and correlation analysis is carried out. We develop six variants of MLSTM models with different features, transformations, and outlier elimination. The MLSTM model with Z-score transformation on the selected features and outlier eliminated data gives an RMSE of 0.212 and an R2 score of 0.954. This indicates that our model performed well.

Suggested Citation

  • Urolagin, Siddhaling & Sharma, Nikhil & Datta, Tapan Kumar, 2021. "A combined architecture of multivariate LSTM with Mahalanobis and Z-Score transformations for oil price forecasting," Energy, Elsevier, vol. 231(C).
    • Handle: RePEc:eee:energy:v:231:y:2021:i:c:s0360544221012111
    DOI: 10.1016/j.energy.2021.120963
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544221012111
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2021.120963?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xiaodan Liang & Zhaodi Ge & Liling Sun & Maowei He & Hanning Chen, 2019. "LSTM with Wavelet Transform Based Data Preprocessing for Stock Price Prediction," Mathematical Problems in Engineering, Hindawi, vol. 2019, pages 1-8, July.
    2. Li, Xuerong & Shang, Wei & Wang, Shouyang, 2019. "Text-based crude oil price forecasting: A deep learning approach," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1548-1560.
    3. Jia Liao & Yu Shi & Xiangyun Xu, 2018. "Why Is the Correlation between Crude Oil Prices and the US Dollar Exchange Rate Time-Varying?—Explanations Based on the Role of Key Mediators," IJFS, MDPI, vol. 6(3), pages 1-13, June.
    4. Xuluo Yin & Jiangang Peng & Tian Tang, 2018. "Improving the Forecasting Accuracy of Crude Oil Prices," Sustainability, MDPI, vol. 10(2), pages 1-9, February.
    5. Wu, Yu-Xi & Wu, Qing-Biao & Zhu, Jia-Qi, 2019. "Improved EEMD-based crude oil price forecasting using LSTM networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 516(C), pages 114-124.
    6. Chai, Jian & Xing, Li-Min & Zhou, Xiao-Yang & Zhang, Zhe George & Li, Jie-Xun, 2018. "Forecasting the WTI crude oil price by a hybrid-refined method," Energy Economics, Elsevier, vol. 71(C), pages 114-127.
    7. Alexopoulos, Thomas A., 2017. "The growing importance of natural gas as a predictor for retail electricity prices in US," Energy, Elsevier, vol. 137(C), pages 219-233.
    8. Cen, Zhongpei & Wang, Jun, 2019. "Crude oil price prediction model with long short term memory deep learning based on prior knowledge data transfer," Energy, Elsevier, vol. 169(C), pages 160-171.
    9. Safari, Ali & Davallou, Maryam, 2018. "Oil price forecasting using a hybrid model," Energy, Elsevier, vol. 148(C), pages 49-58.
    10. Lee, Bi-Juan & Yang, Chin Wei & Huang, Bwo-Nung, 2012. "Oil price movements and stock markets revisited: A case of sector stock price indexes in the G-7 countries," Energy Economics, Elsevier, vol. 34(5), pages 1284-1300.
    11. Hamilton, James D, 1983. "Oil and the Macroeconomy since World War II," Journal of Political Economy, University of Chicago Press, vol. 91(2), pages 228-248, April.
    12. Zhang, Yue-Jun & Wei, Yi-Ming, 2010. "The crude oil market and the gold market: Evidence for cointegration, causality and price discovery," Resources Policy, Elsevier, vol. 35(3), pages 168-177, September.
    13. Zhaojie Luo & Xiaojing Cai & Katsuyuki Tanaka & Tetsuya Takiguchi & Takuji Kinkyo & Shigeyuki Hamori, 2019. "Can We Forecast Daily Oil Futures Prices? Experimental Evidence from Convolutional Neural Networks," JRFM, MDPI, vol. 12(1), pages 1-13, January.
    14. Andreas Breitenfellner & Jesus Crespo Cuaresma, 2008. "Crude Oil Prices and the USD/EUR Exchange Rate," Monetary Policy & the Economy, Oesterreichische Nationalbank (Austrian Central Bank), issue 4.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Huang, Haichi & Bian, Chong & Wu, Mengdan & An, Dong & Yang, Shunkun, 2024. "A novel integrated SOC–SOH estimation framework for whole-life-cycle lithium-ion batteries," Energy, Elsevier, vol. 288(C).
    2. Faramarz Saghi & Mustafa Jahangoshai Rezaee, 2023. "Integrating Wavelet Decomposition and Fuzzy Transformation for Improving the Accuracy of Forecasting Crude Oil Price," Computational Economics, Springer;Society for Computational Economics, vol. 61(2), pages 559-591, February.
    3. Di Zhu & Yinghong Wang & Fenglin Zhang, 2022. "Energy Price Prediction Integrated with Singular Spectrum Analysis and Long Short-Term Memory Network against the Background of Carbon Neutrality," Energies, MDPI, vol. 15(21), pages 1-20, October.
    4. Lei, Yang & Chen, Yuming & Chen, Jinghai & Liu, Xinyan & Wu, Xiaoqin & Chen, Yuqiu, 2023. "A novel modeling strategy for the prediction on the concentration of H2 and CH4 in raw coke oven gas," Energy, Elsevier, vol. 273(C).
    5. Liang, Chao & Xia, Zhenglan & Lai, Xiaodong & Wang, Lu, 2022. "Natural gas volatility prediction: Fresh evidence from extreme weather and extended GARCH-MIDAS-ES model," Energy Economics, Elsevier, vol. 116(C).
    6. Max Olinto Moreira & Betania Mafra Kaizer & Takaaki Ohishi & Benedito Donizeti Bonatto & Antonio Carlos Zambroni de Souza & Pedro Paulo Balestrassi, 2022. "Multivariate Strategy Using Artificial Neural Networks for Seasonal Photovoltaic Generation Forecasting," Energies, MDPI, vol. 16(1), pages 1-30, December.
    7. Zhao, Geya & Xue, Minggao & Cheng, Li, 2023. "A new hybrid model for multi-step WTI futures price forecasting based on self-attention mechanism and spatial–temporal graph neural network," Resources Policy, Elsevier, vol. 85(PB).
    8. Du, Xiaoxu & Tang, Zhenpeng & Chen, Kaijie, 2023. "A novel crude oil futures trading strategy based on volume-price time-frequency decomposition with ensemble deep reinforcement learning," Energy, Elsevier, vol. 285(C).
    9. Li, Ye & Chen, Yiyan & Lean, Hooi Hooi, 2024. "Geopolitical risk and crude oil price predictability: Novel decomposition ensemble approach based ternary interval number series," Resources Policy, Elsevier, vol. 92(C).
    10. Bingchun Liu & Xia Zhang & Yuan Gao & Minghui Xu & Xiaobo Wang, 2025. "China’s Energy Stock Price Index Prediction Based on VECM–BiLSTM Model," Energies, MDPI, vol. 18(5), pages 1-21, March.
    11. Faheem Jan & Ismail Shah & Sajid Ali, 2022. "Short-Term Electricity Prices Forecasting Using Functional Time Series Analysis," Energies, MDPI, vol. 15(9), pages 1-15, May.
    12. Gu, Xinyu & See, K.W. & Li, Penghua & Shan, Kangheng & Wang, Yunpeng & Zhao, Liang & Lim, Kai Chin & Zhang, Neng, 2023. "A novel state-of-health estimation for the lithium-ion battery using a convolutional neural network and transformer model," Energy, Elsevier, vol. 262(PB).
    13. Ouyang, Zisheng & Lu, Min & Ouyang, Zhongzhe & Zhou, Xuewei & Wang, Ren, 2024. "A novel integrated method for improving the forecasting accuracy of crude oil: ESMD-CFastICA-BiLSTM-Attention," Energy Economics, Elsevier, vol. 138(C).
    14. Lijuan Peng & Zhenglan Xia & Yisu Huang & Zhigang Pan, 2023. "Role of weather in the natural gas market: Insights from the STL‐GARCH‐W method," International Finance, Wiley Blackwell, vol. 26(3), pages 304-323, December.
    15. Liang, Xuedong & Luo, Peng & Li, Xiaoyan & Wang, Xia & Shu, Lingli, 2023. "Crude oil price prediction using deep reinforcement learning," Resources Policy, Elsevier, vol. 81(C).
    16. Jiang, He & Hu, Weiqiang & Xiao, Ling & Dong, Yao, 2022. "A decomposition ensemble based deep learning approach for crude oil price forecasting," Resources Policy, Elsevier, vol. 78(C).
    17. Wu, Chunying & Wang, Jianzhou & Hao, Yan, 2022. "Deterministic and uncertainty crude oil price forecasting based on outlier detection and modified multi-objective optimization algorithm," Resources Policy, Elsevier, vol. 77(C).
    18. Elżbieta Szaruga & Elżbieta Załoga & Arkadiusz Drewnowski & Paulina Dąbrosz-Drewnowska, 2023. "Convergence of Energy Intensity of the Export of Goods by Rail Transport: Linkages with the Spatial Integration and Economic Condition of Countries," Energies, MDPI, vol. 16(9), pages 1-24, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Karasu, Seçkin & Altan, Aytaç, 2022. "Crude oil time series prediction model based on LSTM network with chaotic Henry gas solubility optimization," Energy, Elsevier, vol. 242(C).
    2. Göncü, Ahmet & Kuzubaş, Tolga U. & Saltoğlu, Burak, 2024. "Predicting oil prices: A comparative analysis of machine learning and image recognition algorithms for trend prediction," Finance Research Letters, Elsevier, vol. 67(PB).
    3. Xing, Li-Min & Zhang, Yue-Jun, 2022. "Forecasting crude oil prices with shrinkage methods: Can nonconvex penalty and Huber loss help?," Energy Economics, Elsevier, vol. 110(C).
    4. Drachal, Krzysztof, 2016. "Forecasting spot oil price in a dynamic model averaging framework — Have the determinants changed over time?," Energy Economics, Elsevier, vol. 60(C), pages 35-46.
    5. Hyeon-Seok Kim & Hui-Sang Kim & Sun-Yong Choi, 2024. "Investigating the Impact of Agricultural, Financial, Economic, and Political Factors on Oil Forward Prices and Volatility: A SHAP Analysis," Energies, MDPI, vol. 17(5), pages 1-24, February.
    6. Zhao, Geya & Xue, Minggao & Cheng, Li, 2023. "A new hybrid model for multi-step WTI futures price forecasting based on self-attention mechanism and spatial–temporal graph neural network," Resources Policy, Elsevier, vol. 85(PB).
    7. César Castro & Rebeca Jiménez-Rodríguez, 2020. "Dynamic interactions between oil price and exchange rate," PLOS ONE, Public Library of Science, vol. 15(8), pages 1-20, August.
    8. Priyanshi Gupta & Anurag Goyal, 2015. "Impact of oil price fluctuations on Indian economy," OPEC Energy Review, Organization of the Petroleum Exporting Countries, vol. 39(2), pages 141-161, June.
    9. Li, Jingmiao & Wang, Jun, 2020. "Forcasting of energy futures market and synchronization based on stochastic gated recurrent unit model," Energy, Elsevier, vol. 213(C).
    10. Manickavasagam, Jeevananthan & Visalakshmi, S. & Apergis, Nicholas, 2020. "A novel hybrid approach to forecast crude oil futures using intraday data," Technological Forecasting and Social Change, Elsevier, vol. 158(C).
    11. Guo, Jingjun & Zhao, Zhengling & Sun, Jingyun & Sun, Shaolong, 2022. "Multi-perspective crude oil price forecasting with a new decomposition-ensemble framework," Resources Policy, Elsevier, vol. 77(C).
    12. Li, Mingchen & Cheng, Zishu & Lin, Wencan & Wei, Yunjie & Wang, Shouyang, 2023. "What can be learned from the historical trend of crude oil prices? An ensemble approach for crude oil price forecasting," Energy Economics, Elsevier, vol. 123(C).
    13. Huang, Shupei & An, Haizhong & Gao, Xiangyun & Sun, Xiaoqi, 2017. "Do oil price asymmetric effects on the stock market persist in multiple time horizons?," Applied Energy, Elsevier, vol. 185(P2), pages 1799-1808.
    14. Bedoui, Rihab & Braiek, Sana & Guesmi, Khaled & Chevallier, Julien, 2019. "On the conditional dependence structure between oil, gold and USD exchange rates: Nested copula based GJR-GARCH model," Energy Economics, Elsevier, vol. 80(C), pages 876-889.
    15. Donghua Wang & Tianhui Fang, 2022. "Forecasting Crude Oil Prices with a WT-FNN Model," Energies, MDPI, vol. 15(6), pages 1-21, March.
    16. Westerlund, Joakim & Sharma, Susan Sunila, 2019. "Panel evidence on the ability of oil returns to predict stock returns in the G7 area," Energy Economics, Elsevier, vol. 77(C), pages 3-12.
    17. Chao Deng & Liang Ma & Taishan Zeng, 2021. "Crude Oil Price Forecast Based on Deep Transfer Learning: Shanghai Crude Oil as an Example," Sustainability, MDPI, vol. 13(24), pages 1-13, December.
    18. Nawaz Ahmad & Syed Kashif Rafi & Muhammad Tariq, 2018. "Modeling Nonlinear Granger Causality And Co-Integration Between Gold Price Returns And Crude Oil Price Returns," IBT Journal of Business Studies (JBS), Ilma University, Faculty of Management Science, vol. 14(2), pages 14-19.
    19. Radosław Puka & Bartosz Łamasz & Marek Michalski, 2021. "Effectiveness of Artificial Neural Networks in Hedging against WTI Crude Oil Price Risk," Energies, MDPI, vol. 14(11), pages 1-26, June.
    20. Kyritsis, Evangelos & Serletis, Apostolos, 2018. "The zero lower bound and market spillovers: Evidence from the G7 and Norway," Research in International Business and Finance, Elsevier, vol. 44(C), pages 100-123.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:231:y:2021:i:c:s0360544221012111. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.