IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v309y2024ics0360544224028779.html
   My bibliography  Save this article

A novel approach to Predict WTI crude spot oil price: LSTM-based feature extraction with Xgboost Regressor

Author

Listed:
  • Simsek, Ahmed Ihsan
  • Bulut, Emre
  • Gur, Yunus Emre
  • Gültekin Tarla, Esma

Abstract

This paper presents a novel model based on LSTM to predict future prices of WTI crude oil. The WTI price forecasting utilizes data on spot gold price, US 10-year bond yield, global economic activity, and US dollar index from January 1986 to May 2023. The model's performance is assessed using measures such as MAE, MSE, RMSE, MAPE, and R2 metrics. The results generated by the proposed new model are compared to those of the existing machine and deep learning methods, and it is observed that the new model performs better than the existing models in all statistical tests. The study further examined the decision-making processes of the model using SHAP analysis and assessed the individual contribution of each feature to the model's predictions. The correlation between the US Dollar Index and Gold prices and WTI crude oil prices is evident. The SHAP research has demonstrated that the model effectively captures complicated economic linkages and enhances the accuracy of forecasts. The results of this study enhance the development of models that are capable of predicting results, even in times of significant instability, such as economic crises. Using sophisticated data analytics and AI methods would improve the efficiency of energy market oversight.

Suggested Citation

  • Simsek, Ahmed Ihsan & Bulut, Emre & Gur, Yunus Emre & Gültekin Tarla, Esma, 2024. "A novel approach to Predict WTI crude spot oil price: LSTM-based feature extraction with Xgboost Regressor," Energy, Elsevier, vol. 309(C).
    • Handle: RePEc:eee:energy:v:309:y:2024:i:c:s0360544224028779
    DOI: 10.1016/j.energy.2024.133102
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224028779
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2024.133102?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ben Salem, Leila & Nouira, Ridha & Jeguirim, Khaled & Rault, Christophe, 2022. "The determinants of crude oil prices: Evidence from ARDL and nonlinear ARDL approaches," Resources Policy, Elsevier, vol. 79(C).
    2. Li, Xuerong & Shang, Wei & Wang, Shouyang, 2019. "Text-based crude oil price forecasting: A deep learning approach," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1548-1560.
    3. Dong, Minyi & Chang, Chun-Ping & Gong, Qiang & Chu, Yin, 2019. "Revisiting global economic activity and crude oil prices: A wavelet analysis," Economic Modelling, Elsevier, vol. 78(C), pages 134-149.
    4. Filip Novotný, 2012. "The Link Between the Brent Crude Oil Price and the US Dollar Exchange Rate," Prague Economic Papers, Prague University of Economics and Business, vol. 2012(2), pages 220-232.
    5. Mingming, Tang & Jinliang, Zhang, 2012. "A multiple adaptive wavelet recurrent neural network model to analyze crude oil prices," Journal of Economics and Business, Elsevier, vol. 64(4), pages 275-286.
    6. Hadi Jahanshahi & Süleyman Uzun & Sezgin Kaçar & Qijia Yao & Madini O. Alassafi, 2022. "Artificial Intelligence-Based Prediction of Crude Oil Prices Using Multiple Features under the Effect of Russia–Ukraine War and COVID-19 Pandemic," Mathematics, MDPI, vol. 10(22), pages 1-14, November.
    7. Chen, Bin-xia & Sun, Yan-lin, 2023. "Extreme risk contagion between international crude oil and China's energy-intensive sectors: New evidence from quantile Granger causality and spillover methods," Energy, Elsevier, vol. 285(C).
    8. Cen, Zhongpei & Wang, Jun, 2019. "Crude oil price prediction model with long short term memory deep learning based on prior knowledge data transfer," Energy, Elsevier, vol. 169(C), pages 160-171.
    9. Wang, Minggang & Zhao, Longfeng & Du, Ruijin & Wang, Chao & Chen, Lin & Tian, Lixin & Eugene Stanley, H., 2018. "A novel hybrid method of forecasting crude oil prices using complex network science and artificial intelligence algorithms," Applied Energy, Elsevier, vol. 220(C), pages 480-495.
    10. Huiting Zheng & Jiabin Yuan & Long Chen, 2017. "Short-Term Load Forecasting Using EMD-LSTM Neural Networks with a Xgboost Algorithm for Feature Importance Evaluation," Energies, MDPI, vol. 10(8), pages 1-20, August.
    11. Kayalar, Derya Ezgi & Küçüközmen, C. Coşkun & Selcuk-Kestel, A. Sevtap, 2017. "The impact of crude oil prices on financial market indicators: copula approach," Energy Economics, Elsevier, vol. 61(C), pages 162-173.
    12. Kilian, Lutz, 2019. "Measuring global real economic activity: Do recent critiques hold up to scrutiny?," Economics Letters, Elsevier, vol. 178(C), pages 106-110.
    13. Zhao, Yang & Li, Jianping & Yu, Lean, 2017. "A deep learning ensemble approach for crude oil price forecasting," Energy Economics, Elsevier, vol. 66(C), pages 9-16.
    14. Yu, Lean & Wang, Shouyang & Lai, Kin Keung, 2008. "Forecasting crude oil price with an EMD-based neural network ensemble learning paradigm," Energy Economics, Elsevier, vol. 30(5), pages 2623-2635, September.
    15. Chao Deng & Liang Ma & Taishan Zeng, 2021. "Crude Oil Price Forecast Based on Deep Transfer Learning: Shanghai Crude Oil as an Example," Sustainability, MDPI, vol. 13(24), pages 1-13, December.
    16. Liang, Xuedong & Luo, Peng & Li, Xiaoyan & Wang, Xia & Shu, Lingli, 2023. "Crude oil price prediction using deep reinforcement learning," Resources Policy, Elsevier, vol. 81(C).
    17. Michail Filippidis & George Filis & Georgios Magkonis & Panagiotis Tzouvanas, 2023. "Evaluating robust determinants of the WTI/Brent oil price differential: A dynamic model averaging analysis," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 43(6), pages 807-825, June.
    18. Dai, Zhifeng & Kang, Jie, 2021. "Bond yield and crude oil prices predictability," Energy Economics, Elsevier, vol. 97(C).
    19. Vasudharini Sridharan & Mingjian Tuo & Xingpeng Li, 2022. "Wholesale Electricity Price Forecasting Using Integrated Long-Term Recurrent Convolutional Network Model," Energies, MDPI, vol. 15(20), pages 1-16, October.
    20. Li, Mingchen & Cheng, Zishu & Lin, Wencan & Wei, Yunjie & Wang, Shouyang, 2023. "What can be learned from the historical trend of crude oil prices? An ensemble approach for crude oil price forecasting," Energy Economics, Elsevier, vol. 123(C).
    21. Siddhivinayak Kulkarni & Imad Haidar, 2009. "Forecasting Model for Crude Oil Price Using Artificial Neural Networks and Commodity Futures Prices," Papers 0906.4838, arXiv.org.
    22. John Wei-Shan Hu & Yi-Chung Hu & Ricky Ray-Wen Lin, 2012. "Applying Neural Networks to Prices Prediction of Crude Oil Futures," Mathematical Problems in Engineering, Hindawi, vol. 2012, pages 1-12, August.
    23. Hualing Lin & Qiubi Sun, 2020. "Crude Oil Prices Forecasting: An Approach of Using CEEMDAN-Based Multi-Layer Gated Recurrent Unit Networks," Energies, MDPI, vol. 13(7), pages 1-21, March.
    24. Muñoz, M. Pilar & Dickey, David A., 2009. "Are electricity prices affected by the US dollar to Euro exchange rate? The Spanish case," Energy Economics, Elsevier, vol. 31(6), pages 857-866, November.
    25. Wang, Jie & Wang, Jun, 2016. "Forecasting energy market indices with recurrent neural networks: Case study of crude oil price fluctuations," Energy, Elsevier, vol. 102(C), pages 365-374.
    26. Manel Hamdi & Chaker Aloui, 2015. "Forecasting Crude Oil Price Using Artificial Neural Networks: A Literature Survey," Economics Bulletin, AccessEcon, vol. 35(2), pages 1339-1359.
    27. Taiyong Li & Min Zhou & Chaoqi Guo & Min Luo & Jiang Wu & Fan Pan & Quanyi Tao & Ting He, 2016. "Forecasting Crude Oil Price Using EEMD and RVM with Adaptive PSO-Based Kernels," Energies, MDPI, vol. 9(12), pages 1-21, December.
    28. He, Yanan & Wang, Shouyang & Lai, Kin Keung, 2010. "Global economic activity and crude oil prices: A cointegration analysis," Energy Economics, Elsevier, vol. 32(4), pages 868-876, July.
    29. Wang, Jue & Athanasopoulos, George & Hyndman, Rob J. & Wang, Shouyang, 2018. "Crude oil price forecasting based on internet concern using an extreme learning machine," International Journal of Forecasting, Elsevier, vol. 34(4), pages 665-677.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Abdollahi, Hooman, 2020. "A novel hybrid model for forecasting crude oil price based on time series decomposition," Applied Energy, Elsevier, vol. 267(C).
    2. Guo, Jingjun & Zhao, Zhengling & Sun, Jingyun & Sun, Shaolong, 2022. "Multi-perspective crude oil price forecasting with a new decomposition-ensemble framework," Resources Policy, Elsevier, vol. 77(C).
    3. Jiang Wu & Feng Miu & Taiyong Li, 2020. "Daily Crude Oil Price Forecasting Based on Improved CEEMDAN, SCA, and RVFL: A Case Study in WTI Oil Market," Energies, MDPI, vol. 13(7), pages 1-20, April.
    4. Jha, Nimish & Kumar Tanneru, Hemanth & Palla, Sridhar & Hussain Mafat, Iradat, 2024. "Multivariate analysis and forecasting of the crude oil prices: Part I – Classical machine learning approaches," Energy, Elsevier, vol. 296(C).
    5. Abdollahi, Hooman & Ebrahimi, Seyed Babak, 2020. "A new hybrid model for forecasting Brent crude oil price," Energy, Elsevier, vol. 200(C).
    6. Lean Yu & Yueming Ma, 2021. "A Data-Trait-Driven Rolling Decomposition-Ensemble Model for Gasoline Consumption Forecasting," Energies, MDPI, vol. 14(15), pages 1-26, July.
    7. Wang, Jun & Cao, Junxing & Yuan, Shan & Cheng, Ming, 2021. "Short-term forecasting of natural gas prices by using a novel hybrid method based on a combination of the CEEMDAN-SE-and the PSO-ALS-optimized GRU network," Energy, Elsevier, vol. 233(C).
    8. Parisa Foroutan & Salim Lahmiri, 2024. "Deep learning systems for forecasting the prices of crude oil and precious metals," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 10(1), pages 1-40, December.
    9. Safari, Ali & Davallou, Maryam, 2018. "Oil price forecasting using a hybrid model," Energy, Elsevier, vol. 148(C), pages 49-58.
    10. Li, Jinchao & Zhu, Shaowen & Wu, Qianqian, 2019. "Monthly crude oil spot price forecasting using variational mode decomposition," Energy Economics, Elsevier, vol. 83(C), pages 240-253.
    11. Lu-Tao Zhao & Guan-Rong Zeng & Wen-Jing Wang & Zhi-Gang Zhang, 2019. "Forecasting Oil Price Using Web-based Sentiment Analysis," Energies, MDPI, vol. 12(22), pages 1-18, November.
    12. Lang, Korbinian & Auer, Benjamin R., 2020. "The economic and financial properties of crude oil: A review," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    13. Jiang Wu & Yu Chen & Tengfei Zhou & Taiyong Li, 2019. "An Adaptive Hybrid Learning Paradigm Integrating CEEMD, ARIMA and SBL for Crude Oil Price Forecasting," Energies, MDPI, vol. 12(7), pages 1-23, April.
    14. Guan, Keqin & Gong, Xu, 2023. "A new hybrid deep learning model for monthly oil prices forecasting," Energy Economics, Elsevier, vol. 128(C).
    15. Radosław Puka & Bartosz Łamasz & Marek Michalski, 2021. "Effectiveness of Artificial Neural Networks in Hedging against WTI Crude Oil Price Risk," Energies, MDPI, vol. 14(11), pages 1-26, June.
    16. Drachal, Krzysztof, 2016. "Forecasting spot oil price in a dynamic model averaging framework — Have the determinants changed over time?," Energy Economics, Elsevier, vol. 60(C), pages 35-46.
    17. Hao, Jun & Feng, Qianqian & Yuan, Jiaxin & Sun, Xiaolei & Li, Jianping, 2022. "A dynamic ensemble learning with multi-objective optimization for oil prices prediction," Resources Policy, Elsevier, vol. 79(C).
    18. Melike Bildirici & Nilgun Guler Bayazit & Yasemen Ucan, 2020. "Analyzing Crude Oil Prices under the Impact of COVID-19 by Using LSTARGARCHLSTM," Energies, MDPI, vol. 13(11), pages 1-18, June.
    19. Manel Hamdi & Chaker Aloui & Santosh kumar Nanda, 2016. "Comparing Functional Link Artificial Neural Network And Multilayer Feedforward Neural Network Model To Forecast Crude Oil Prices," Economics Bulletin, AccessEcon, vol. 36(4), pages 2430-2442.
    20. Jiang, He & Hu, Weiqiang & Xiao, Ling & Dong, Yao, 2022. "A decomposition ensemble based deep learning approach for crude oil price forecasting," Resources Policy, Elsevier, vol. 78(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:309:y:2024:i:c:s0360544224028779. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.