IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v38y2022i1p367-383.html
   My bibliography  Save this article

Crude oil price forecasting incorporating news text

Author

Listed:
  • Bai, Yun
  • Li, Xixi
  • Yu, Hao
  • Jia, Suling

Abstract

Sparse and short news headlines can be arbitrary, noisy, and ambiguous, making it difficult for classic topic model LDA (latent Dirichlet allocation) designed for accommodating long text to discover knowledge from them. Nonetheless, some of the existing research about text-based crude oil forecasting employs LDA to explore topics from news headlines, resulting in a mismatch between the short text and the topic model and further affecting the forecasting performance. Exploiting advanced and appropriate methods to construct high-quality features from news headlines becomes crucial in crude oil forecasting. This paper introduces two novel indicators of topic and sentiment for the short and sparse text data to tackle this issue. Empirical experiments show that AdaBoost.RT with our proposed text indicators, with a more comprehensive view and characterization of the short and sparse text data, outperforms the other benchmarks. Another significant merit is that our method also yields good forecasting performance when applied to other futures commodities.

Suggested Citation

  • Bai, Yun & Li, Xixi & Yu, Hao & Jia, Suling, 2022. "Crude oil price forecasting incorporating news text," International Journal of Forecasting, Elsevier, vol. 38(1), pages 367-383.
    • Handle: RePEc:eee:intfor:v:38:y:2022:i:1:p:367-383
    DOI: 10.1016/j.ijforecast.2021.06.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207021001060
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijforecast.2021.06.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mohammadi, Hassan & Su, Lixian, 2010. "International evidence on crude oil price dynamics: Applications of ARIMA-GARCH models," Energy Economics, Elsevier, vol. 32(5), pages 1001-1008, September.
    2. Li, Xuerong & Shang, Wei & Wang, Shouyang, 2019. "Text-based crude oil price forecasting: A deep learning approach," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1548-1560.
    3. Zhang, Jin-Liang & Zhang, Yue-Jun & Zhang, Lu, 2015. "A novel hybrid method for crude oil price forecasting," Energy Economics, Elsevier, vol. 49(C), pages 649-659.
    4. Ling Tang & Wei Dai & Lean Yu & Shouyang Wang, 2015. "A Novel CEEMD-Based EELM Ensemble Learning Paradigm for Crude Oil Price Forecasting," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 14(01), pages 141-169.
    5. Saeed Moshiri & Faezeh Foroutan, 2006. "Forecasting Nonlinear Crude Oil Futures Prices," The Energy Journal, , vol. 27(4), pages 81-96, October.
    6. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    7. Movagharnejad, Kamyar & Mehdizadeh, Bahman & Banihashemi, Morteza & Kordkheili, Masoud Sheikhi, 2011. "Forecasting the differences between various commercial oil prices in the Persian Gulf region by neural network," Energy, Elsevier, vol. 36(7), pages 3979-3984.
    8. Ivanov Ventzislav & Kilian Lutz, 2005. "A Practitioner's Guide to Lag Order Selection For VAR Impulse Response Analysis," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 9(1), pages 1-36, March.
    9. Demirer, RIza & Kutan, Ali M., 2010. "The behavior of crude oil spot and futures prices around OPEC and SPR announcements: An event study perspective," Energy Economics, Elsevier, vol. 32(6), pages 1467-1476, November.
    10. Wang, Jue & Athanasopoulos, George & Hyndman, Rob J. & Wang, Shouyang, 2018. "Crude oil price forecasting based on internet concern using an extreme learning machine," International Journal of Forecasting, Elsevier, vol. 34(4), pages 665-677.
    11. Yingrui Zhou & Taiyong Li & Jiayi Shi & Zijie Qian, 2019. "A CEEMDAN and XGBOOST-Based Approach to Forecast Crude Oil Prices," Complexity, Hindawi, vol. 2019, pages 1-15, February.
    12. Kaiser, Mark J. & Yu, Yunke, 2010. "The impact of Hurricanes Gustav and Ike on offshore oil and gas production in the Gulf of Mexico," Applied Energy, Elsevier, vol. 87(1), pages 284-297, January.
    13. Hou, Aijun & Suardi, Sandy, 2012. "A nonparametric GARCH model of crude oil price return volatility," Energy Economics, Elsevier, vol. 34(2), pages 618-626.
    14. Scott Deerwester & Susan T. Dumais & George W. Furnas & Thomas K. Landauer & Richard Harshman, 1990. "Indexing by latent semantic analysis," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 41(6), pages 391-407, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pan, Zhiyuan & Zhong, Hao & Wang, Yudong & Huang, Juan, 2024. "Forecasting oil futures returns with news," Energy Economics, Elsevier, vol. 134(C).
    2. Yilun Zhang & Yuping Song & Ying Peng & Hanchao Wang, 2024. "Volatility forecasting incorporating intraday positive and negative jumps based on deep learning model," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(7), pages 2749-2765, November.
    3. Yang, Kun & Cheng, Zishu & Li, Mingchen & Wang, Shouyang & Wei, Yunjie, 2024. "Fortify the investment performance of crude oil market by integrating sentiment analysis and an interval-based trading strategy," Applied Energy, Elsevier, vol. 353(PA).
    4. Parisa Foroutan & Salim Lahmiri, 2024. "Deep learning systems for forecasting the prices of crude oil and precious metals," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 10(1), pages 1-40, December.
    5. Wang, Delu & Gan, Jun & Mao, Jinqi & Chen, Fan & Yu, Lan, 2023. "Forecasting power demand in China with a CNN-LSTM model including multimodal information," Energy, Elsevier, vol. 263(PE).
    6. Mohsin, Muhammad & Jamaani, Fouad, 2023. "Green finance and the socio-politico-economic factors’ impact on the future oil prices: Evidence from machine learning," Resources Policy, Elsevier, vol. 85(PA).
    7. Guliyev, Hasraddin & Mustafayev, Eldayag, 2022. "Predicting the changes in the WTI crude oil price dynamics using machine learning models," Resources Policy, Elsevier, vol. 77(C).
    8. Marcus Vinicius Santos & Fernando Morgado-Dias & Thiago C. Silva, 2023. "Oil Sector and Sentiment Analysis—A Review," Energies, MDPI, vol. 16(12), pages 1-29, June.
    9. Liang, Xuedong & Luo, Peng & Li, Xiaoyan & Wang, Xia & Shu, Lingli, 2023. "Crude oil price prediction using deep reinforcement learning," Resources Policy, Elsevier, vol. 81(C).
    10. Wuyue An & Lin Wang & Dongfeng Zhang, 2023. "Comprehensive commodity price forecasting framework using text mining methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1865-1888, November.
    11. Hao, Jun & Feng, Qianqian & Yuan, Jiaxin & Sun, Xiaolei & Li, Jianping, 2022. "A dynamic ensemble learning with multi-objective optimization for oil prices prediction," Resources Policy, Elsevier, vol. 79(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yun Bai & Xixi Li & Hao Yu & Suling Jia, 2020. "Crude oil price forecasting incorporating news text," Papers 2002.02010, arXiv.org, revised Jul 2021.
    2. Ding, Yishan, 2018. "A novel decompose-ensemble methodology with AIC-ANN approach for crude oil forecasting," Energy, Elsevier, vol. 154(C), pages 328-336.
    3. Lin, Ling & Jiang, Yong & Xiao, Helu & Zhou, Zhongbao, 2020. "Crude oil price forecasting based on a novel hybrid long memory GARCH-M and wavelet analysis model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 543(C).
    4. Wang, Minggang & Zhao, Longfeng & Du, Ruijin & Wang, Chao & Chen, Lin & Tian, Lixin & Eugene Stanley, H., 2018. "A novel hybrid method of forecasting crude oil prices using complex network science and artificial intelligence algorithms," Applied Energy, Elsevier, vol. 220(C), pages 480-495.
    5. Cheng, Fangzheng & Li, Tian & Wei, Yi-ming & Fan, Tijun, 2019. "The VEC-NAR model for short-term forecasting of oil prices," Energy Economics, Elsevier, vol. 78(C), pages 656-667.
    6. Zhang, Tingting & Tang, Zhenpeng & Wu, Junchuan & Du, Xiaoxu & Chen, Kaijie, 2021. "Multi-step-ahead crude oil price forecasting based on two-layer decomposition technique and extreme learning machine optimized by the particle swarm optimization algorithm," Energy, Elsevier, vol. 229(C).
    7. Nademi, Arash & Nademi, Younes, 2018. "Forecasting crude oil prices by a semiparametric Markov switching model: OPEC, WTI, and Brent cases," Energy Economics, Elsevier, vol. 74(C), pages 757-766.
    8. Zhang, Yue-Jun & Yao, Ting & He, Ling-Yun & Ripple, Ronald, 2019. "Volatility forecasting of crude oil market: Can the regime switching GARCH model beat the single-regime GARCH models?," International Review of Economics & Finance, Elsevier, vol. 59(C), pages 302-317.
    9. Taiyong Li & Yingrui Zhou & Xinsheng Li & Jiang Wu & Ting He, 2019. "Forecasting Daily Crude Oil Prices Using Improved CEEMDAN and Ridge Regression-Based Predictors," Energies, MDPI, vol. 12(19), pages 1-25, September.
    10. Jiang Wu & Yu Chen & Tengfei Zhou & Taiyong Li, 2019. "An Adaptive Hybrid Learning Paradigm Integrating CEEMD, ARIMA and SBL for Crude Oil Price Forecasting," Energies, MDPI, vol. 12(7), pages 1-23, April.
    11. Manickavasagam, Jeevananthan & Visalakshmi, S. & Apergis, Nicholas, 2020. "A novel hybrid approach to forecast crude oil futures using intraday data," Technological Forecasting and Social Change, Elsevier, vol. 158(C).
    12. Guo, Jingjun & Zhao, Zhengling & Sun, Jingyun & Sun, Shaolong, 2022. "Multi-perspective crude oil price forecasting with a new decomposition-ensemble framework," Resources Policy, Elsevier, vol. 77(C).
    13. Babak Fazelabdolabadi, 2019. "A hybrid Bayesian-network proposition for forecasting the crude oil price," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 5(1), pages 1-21, December.
    14. Qin, Quande & Xie, Kangqiang & He, Huangda & Li, Li & Chu, Xianghua & Wei, Yi-Ming & Wu, Teresa, 2019. "An effective and robust decomposition-ensemble energy price forecasting paradigm with local linear prediction," Energy Economics, Elsevier, vol. 83(C), pages 402-414.
    15. Yuanrong Wang & Yinsen Miao & Alexander CY Wong & Nikita P Granger & Christian Michler, 2023. "Domain-adapted Learning and Interpretability: DRL for Gas Trading," Papers 2301.08359, arXiv.org, revised Sep 2023.
    16. Zied Ftiti & Kais Tissaoui & Sahbi Boubaker, 2022. "On the relationship between oil and gas markets: a new forecasting framework based on a machine learning approach," Annals of Operations Research, Springer, vol. 313(2), pages 915-943, June.
    17. Halkos, George & Tzirivis, Apostolos, 2018. "Effective energy commodities’ risk management: Econometric modeling of price volatility," MPRA Paper 90781, University Library of Munich, Germany.
    18. Xu, Kunliang & Wang, Weiqing, 2023. "Limited information limits accuracy: Whether ensemble empirical mode decomposition improves crude oil spot price prediction?," International Review of Financial Analysis, Elsevier, vol. 87(C).
    19. Jiang, He & Hu, Weiqiang & Xiao, Ling & Dong, Yao, 2022. "A decomposition ensemble based deep learning approach for crude oil price forecasting," Resources Policy, Elsevier, vol. 78(C).
    20. Stéphane Goutte & David Guerreiro & Bilel Sanhaji & Sophie Saglio & Julien Chevallier, 2019. "International Financial Markets," Post-Print halshs-02183053, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:38:y:2022:i:1:p:367-383. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.