IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v290y2024ics0360544223033480.html
   My bibliography  Save this article

A novel secondary decomposition method for forecasting crude oil price with twitter sentiment

Author

Listed:
  • Li, Jieyi
  • Qian, Shuangyue
  • Li, Ling
  • Guo, Yuanxuan
  • Wu, Jun
  • Tang, Ling

Abstract

With the ubiquity of the Internet, valuable social media data have been generated, and a promising idea for using sentiment from social media has emerged in oil price forecasting. To address the complexity of oil price, this study proposed a novel secondary decomposition framework with Twitter sentiment, in which Twitter sentiment provides new information and secondary decomposition technique reduces the difficulty of oil price forecasting. This methodology involves three major steps: (1) sentiment extraction, to collect and extract Twitter sentiment via the state-of-the-art sentiment analysis technique—Bidirectional Encoder Representations from Transformers (BERT); (2) secondary decomposition, to extract scale-aligned components from crude oil price and Twitter sentiment using bivariate empirical mode decomposition (BEMD) first and then decomposing the residual terms through GA-VMD; and (3) oil price prediction, including individual prediction at each intrinsic mode function (IMF) and ensemble prediction across different IMFs. With WTI oil price as a sample, the empirical study results indicate that the proposed novel learning paradigms statistically outperform their corresponding original techniques (without Twitter sentiment and secondary decomposition), semi-improved variants (with either Twitter sentiment or secondary decomposition), and similar counterparts (with one-time decomposition analysis) in terms of prediction accuracy.

Suggested Citation

  • Li, Jieyi & Qian, Shuangyue & Li, Ling & Guo, Yuanxuan & Wu, Jun & Tang, Ling, 2024. "A novel secondary decomposition method for forecasting crude oil price with twitter sentiment," Energy, Elsevier, vol. 290(C).
  • Handle: RePEc:eee:energy:v:290:y:2024:i:c:s0360544223033480
    DOI: 10.1016/j.energy.2023.129954
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223033480
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2023.129954?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ravi Kumar, P. & Ravi, V., 2007. "Bankruptcy prediction in banks and firms via statistical and intelligent techniques - A review," European Journal of Operational Research, Elsevier, vol. 180(1), pages 1-28, July.
    2. Liu, Yuanyuan & Niu, Zibo & Suleman, Muhammad Tahir & Yin, Libo & Zhang, Hongwei, 2022. "Forecasting the volatility of crude oil futures: The role of oil investor attention and its regime switching characteristics under a high-frequency framework," Energy, Elsevier, vol. 238(PA).
    3. Abdollahi, Hooman, 2020. "A novel hybrid model for forecasting crude oil price based on time series decomposition," Applied Energy, Elsevier, vol. 267(C).
    4. Xu Gong & Keqin Guan & Qiyang Chen, 2022. "The role of textual analysis in oil futures price forecasting based on machine learning approach," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 42(10), pages 1987-2017, October.
    5. Wuyue An & Lin Wang & Dongfeng Zhang, 2023. "Comprehensive commodity price forecasting framework using text mining methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1865-1888, November.
    6. Wu, Binrong & Wang, Lin & Wang, Sirui & Zeng, Yu-Rong, 2021. "Forecasting the U.S. oil markets based on social media information during the COVID-19 pandemic," Energy, Elsevier, vol. 226(C).
    7. Tang, Ling & Zhang, Chengyuan & Li, Ling & Wang, Shouyang, 2020. "A multi-scale method for forecasting oil price with multi-factor search engine data," Applied Energy, Elsevier, vol. 257(C).
    8. Li, Jingjing & Tang, Ling & Wang, Shouyang, 2020. "Forecasting crude oil price with multilingual search engine data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 551(C).
    9. Xingrui Jiao & Yuping Song & Yang Kong & Xiaolong Tang, 2022. "Volatility forecasting for crude oil based on text information and deep learning PSO‐LSTM model," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(5), pages 933-944, August.
    10. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    11. Stephanie Beyer Díaz & Kristof Coussement & Arno de Caigny & Luis Fernando Pérez & Stefan Creemers, 2023. "Do the US president's tweets better predict oil prices? An empirical examination using long short-term memory networks," Post-Print hal-04543480, HAL.
    12. Weng, Futian & Zhang, Hongwei & Yang, Cai, 2021. "Volatility forecasting of crude oil futures based on a genetic algorithm regularization online extreme learning machine with a forgetting factor: The role of news during the COVID-19 pandemic," Resources Policy, Elsevier, vol. 73(C).
    13. Li, Jingmiao & Liu, Dehong, 2023. "Carbon price forecasting based on secondary decomposition and feature screening," Energy, Elsevier, vol. 278(PA).
    14. Tang, Ling & Wu, Yao & Yu, Lean, 2018. "A randomized-algorithm-based decomposition-ensemble learning methodology for energy price forecasting," Energy, Elsevier, vol. 157(C), pages 526-538.
    15. Jiang, Zhe & Zhang, Lin & Zhang, Lingling & Wen, Bo, 2022. "Investor sentiment and machine learning: Predicting the price of China's crude oil futures market," Energy, Elsevier, vol. 247(C).
    16. Zhao, Yuan & Zhang, Weiguo & Gong, Xue & Wang, Chao, 2021. "A novel method for online real-time forecasting of crude oil price," Applied Energy, Elsevier, vol. 303(C).
    17. Jiangwei Liu & Xiaohong Huang, 2021. "Forecasting Crude Oil Price Using Event Extraction," Papers 2111.09111, arXiv.org.
    18. Ling Tang & Chengyuan Zhang & Tingfei Li & Ling Li, 2021. "A novel BEMD-based method for forecasting tourist volume with search engine data," Tourism Economics, , vol. 27(5), pages 1015-1038, August.
    19. Lucey, Brian & Ren, Boru, 2021. "Does news tone help forecast oil?," Economic Modelling, Elsevier, vol. 104(C).
    20. Sun, Wei & Huang, Chenchen, 2020. "A novel carbon price prediction model combines the secondary decomposition algorithm and the long short-term memory network," Energy, Elsevier, vol. 207(C).
    21. Yu, Lean & Zhao, Yaqing & Tang, Ling & Yang, Zebin, 2019. "Online big data-driven oil consumption forecasting with Google trends," International Journal of Forecasting, Elsevier, vol. 35(1), pages 213-223.
    22. Guo, Jingjun & Zhao, Zhengling & Sun, Jingyun & Sun, Shaolong, 2022. "Multi-perspective crude oil price forecasting with a new decomposition-ensemble framework," Resources Policy, Elsevier, vol. 77(C).
    23. Abdollahi, Hooman, 2023. "Oil price volatility and new evidence from news and Twitter," Energy Economics, Elsevier, vol. 122(C).
    24. Lu, Quanying & Li, Yuze & Chai, Jian & Wang, Shouyang, 2020. "Crude oil price analysis and forecasting: A perspective of “new triangle”," Energy Economics, Elsevier, vol. 87(C).
    25. Lutz Kilian, 2009. "Not All Oil Price Shocks Are Alike: Disentangling Demand and Supply Shocks in the Crude Oil Market," American Economic Review, American Economic Association, vol. 99(3), pages 1053-1069, June.
    26. Ling Tang & Wei Dai & Lean Yu & Shouyang Wang, 2015. "A Novel CEEMD-Based EELM Ensemble Learning Paradigm for Crude Oil Price Forecasting," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 14(01), pages 141-169.
    27. Chen, Hao & Liao, Hua & Tang, Bao-Jun & Wei, Yi-Ming, 2016. "Impacts of OPEC's political risk on the international crude oil prices: An empirical analysis based on the SVAR models," Energy Economics, Elsevier, vol. 57(C), pages 42-49.
    28. Wang, Jianzhou & Zhou, Yilin & Li, Zhiwu, 2022. "Hour-ahead photovoltaic generation forecasting method based on machine learning and multi objective optimization algorithm," Applied Energy, Elsevier, vol. 312(C).
    29. Deyun Wang & Yanling Liu & Hongyuan Luo & Chenqiang Yue & Sheng Cheng, 2017. "Day-Ahead PM 2.5 Concentration Forecasting Using WT-VMD Based Decomposition Method and Back Propagation Neural Network Improved by Differential Evolution," IJERPH, MDPI, vol. 14(7), pages 1-22, July.
    30. Abdar, Moloud & Basiri, Mohammad Ehsan & Yin, Junjun & Habibnezhad, Mahmoud & Chi, Guangqing & Nemati, Shahla & Asadi, Somayeh, 2020. "Energy choices in Alaska: Mining people's perception and attitudes from geotagged tweets," Renewable and Sustainable Energy Reviews, Elsevier, vol. 124(C).
    31. Panas, Epaminondas & Ninni, Vassilia, 2000. "Are oil markets chaotic? A non-linear dynamic analysis," Energy Economics, Elsevier, vol. 22(5), pages 549-568, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. He, Huizi & Sun, Mei & Li, Xiuming & Mensah, Isaac Adjei, 2022. "A novel crude oil price trend prediction method: Machine learning classification algorithm based on multi-modal data features," Energy, Elsevier, vol. 244(PA).
    2. Zhao, Zhengling & Sun, Shaolong & Sun, Jingyun & Wang, Shouyang, 2024. "A novel hybrid model with two-layer multivariate decomposition for crude oil price forecasting," Energy, Elsevier, vol. 288(C).
    3. Xu, Kunliang & Niu, Hongli, 2023. "Denoising or distortion: Does decomposition-reconstruction modeling paradigm provide a reliable prediction for crude oil price time series?," Energy Economics, Elsevier, vol. 128(C).
    4. Marcus Vinicius Santos & Fernando Morgado-Dias & Thiago C. Silva, 2023. "Oil Sector and Sentiment Analysis—A Review," Energies, MDPI, vol. 16(12), pages 1-29, June.
    5. Li, Mingchen & Cheng, Zishu & Lin, Wencan & Wei, Yunjie & Wang, Shouyang, 2023. "What can be learned from the historical trend of crude oil prices? An ensemble approach for crude oil price forecasting," Energy Economics, Elsevier, vol. 123(C).
    6. Ling Tang & Chengyuan Zhang & Tingfei Li & Ling Li, 2021. "A novel BEMD-based method for forecasting tourist volume with search engine data," Tourism Economics, , vol. 27(5), pages 1015-1038, August.
    7. Zhao, Geya & Xue, Minggao & Cheng, Li, 2023. "A new hybrid model for multi-step WTI futures price forecasting based on self-attention mechanism and spatial–temporal graph neural network," Resources Policy, Elsevier, vol. 85(PB).
    8. Yang, Kun & Cheng, Zishu & Li, Mingchen & Wang, Shouyang & Wei, Yunjie, 2024. "Fortify the investment performance of crude oil market by integrating sentiment analysis and an interval-based trading strategy," Applied Energy, Elsevier, vol. 353(PA).
    9. Sun, Jingyun & Zhao, Panpan & Sun, Shaolong, 2022. "A new secondary decomposition-reconstruction-ensemble approach for crude oil price forecasting," Resources Policy, Elsevier, vol. 77(C).
    10. Li, Guohui & Yin, Shibo & Yang, Hong, 2022. "A novel crude oil prices forecasting model based on secondary decomposition," Energy, Elsevier, vol. 257(C).
    11. Guo, Jingjun & Zhao, Zhengling & Sun, Jingyun & Sun, Shaolong, 2022. "Multi-perspective crude oil price forecasting with a new decomposition-ensemble framework," Resources Policy, Elsevier, vol. 77(C).
    12. Qin Lu & Jingwen Liao & Kechi Chen & Yanhui Liang & Yu Lin, 2024. "Predicting Natural Gas Prices Based on a Novel Hybrid Model with Variational Mode Decomposition," Computational Economics, Springer;Society for Computational Economics, vol. 63(2), pages 639-678, February.
    13. Hao, Jun & Feng, Qianqian & Yuan, Jiaxin & Sun, Xiaolei & Li, Jianping, 2022. "A dynamic ensemble learning with multi-objective optimization for oil prices prediction," Resources Policy, Elsevier, vol. 79(C).
    14. Abdollahi, Hooman & Ebrahimi, Seyed Babak, 2020. "A new hybrid model for forecasting Brent crude oil price," Energy, Elsevier, vol. 200(C).
    15. Krzysztof Drachal, 2022. "Forecasting the Crude Oil Spot Price with Bayesian Symbolic Regression," Energies, MDPI, vol. 16(1), pages 1-29, December.
    16. Zhang, Dingxuan & Sun, Yuying & Duan, Hongbo & Hong, Yongmiao & Wang, Shouyang, 2023. "Speculation or currency? Multi-scale analysis of cryptocurrencies—The case of Bitcoin," International Review of Financial Analysis, Elsevier, vol. 88(C).
    17. Xu, Kunliang & Wang, Weiqing, 2023. "Limited information limits accuracy: Whether ensemble empirical mode decomposition improves crude oil spot price prediction?," International Review of Financial Analysis, Elsevier, vol. 87(C).
    18. Lean Yu & Yueming Ma, 2021. "A Data-Trait-Driven Rolling Decomposition-Ensemble Model for Gasoline Consumption Forecasting," Energies, MDPI, vol. 14(15), pages 1-26, July.
    19. Wang, Jun & Cao, Junxing & Yuan, Shan & Cheng, Ming, 2021. "Short-term forecasting of natural gas prices by using a novel hybrid method based on a combination of the CEEMDAN-SE-and the PSO-ALS-optimized GRU network," Energy, Elsevier, vol. 233(C).
    20. Zhang, Tingting & Tang, Zhenpeng & Wu, Junchuan & Du, Xiaoxu & Chen, Kaijie, 2021. "Multi-step-ahead crude oil price forecasting based on two-layer decomposition technique and extreme learning machine optimized by the particle swarm optimization algorithm," Energy, Elsevier, vol. 229(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:290:y:2024:i:c:s0360544223033480. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.