IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v35y2019i4p1548-1560.html
   My bibliography  Save this article

Text-based crude oil price forecasting: A deep learning approach

Author

Listed:
  • Li, Xuerong
  • Shang, Wei
  • Wang, Shouyang

Abstract

This study proposes a new, novel crude oil price forecasting method based on online media text mining, with the aim of capturing the more immediate market antecedents of price fluctuations. Specifically, this is an early attempt to apply deep learning techniques to crude oil forecasting, and to extract hidden patterns within online news media using a convolutional neural network (CNN). While the news-text sentiment features and the features extracted by the CNN model reveal significant relationships with the price change, they need to be grouped according to their topics in the price forecasting in order to obtain a greater forecasting accuracy. This study further proposes a feature grouping method based on the Latent Dirichlet Allocation (LDA) topic model for distinguishing effects from various online news topics. Optimized input variable combination is constructed using lag order selection and feature selection methods. Our empirical results suggest that the proposed topic-sentiment synthesis forecasting models perform better than the older benchmark models. In addition, text features and financial features are shown to be complementary in producing more accurate crude oil price forecasts.

Suggested Citation

  • Li, Xuerong & Shang, Wei & Wang, Shouyang, 2019. "Text-based crude oil price forecasting: A deep learning approach," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1548-1560.
  • Handle: RePEc:eee:intfor:v:35:y:2019:i:4:p:1548-1560
    DOI: 10.1016/j.ijforecast.2018.07.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207018301110
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2018.07.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Baumeister, Christiane & Guérin, Pierre & Kilian, Lutz, 2015. "Do high-frequency financial data help forecast oil prices? The MIDAS touch at work," International Journal of Forecasting, Elsevier, vol. 31(2), pages 238-252.
    2. Sanjiv R. Das & Mike Y. Chen, 2007. "Yahoo! for Amazon: Sentiment Extraction from Small Talk on the Web," Management Science, INFORMS, vol. 53(9), pages 1375-1388, September.
    3. Atalla, Tarek & Joutz, Fred & Pierru, Axel, 2016. "Does disagreement among oil price forecasters reflect volatility? Evidence from the ECB surveys," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1178-1192.
    4. Hodrick, Robert J & Prescott, Edward C, 1997. "Postwar U.S. Business Cycles: An Empirical Investigation," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 29(1), pages 1-16, February.
    5. Dees, Stephane & Karadeloglou, Pavlos & Kaufmann, Robert K. & Sanchez, Marcelo, 2007. "Modelling the world oil market: Assessment of a quarterly econometric model," Energy Policy, Elsevier, vol. 35(1), pages 178-191, January.
    6. Abramson, Bruce & Finizza, Anthony, 1995. "Probabilistic forecasts from probabilistic models: A case study in the oil market," International Journal of Forecasting, Elsevier, vol. 11(1), pages 63-72, March.
    7. Cifarelli, Giulio & Paladino, Giovanna, 2010. "Oil price dynamics and speculation: A multivariate financial approach," Energy Economics, Elsevier, vol. 32(2), pages 363-372, March.
    8. Zhang, Xun & Yu, Lean & Wang, Shouyang & Lai, Kin Keung, 2009. "Estimating the impact of extreme events on crude oil price: An EMD-based event analysis method," Energy Economics, Elsevier, vol. 31(5), pages 768-778, September.
    9. Bekiros, Stelios D. & Diks, Cees G.H., 2008. "The relationship between crude oil spot and futures prices: Cointegration, linear and nonlinear causality," Energy Economics, Elsevier, vol. 30(5), pages 2673-2685, September.
    10. Yu, Lean & Wang, Shouyang & Lai, Kin Keung, 2008. "Forecasting crude oil price with an EMD-based neural network ensemble learning paradigm," Energy Economics, Elsevier, vol. 30(5), pages 2623-2635, September.
    11. Lutz Kilian, 2009. "Not All Oil Price Shocks Are Alike: Disentangling Demand and Supply Shocks in the Crude Oil Market," American Economic Review, American Economic Association, vol. 99(3), pages 1053-1069, June.
    12. Hu, J.Y. & Luo, E.C. & Dai, W. & Zhang, L.M., 2017. "Parameter sensitivity analysis of duplex Stirling coolers," Applied Energy, Elsevier, vol. 190(C), pages 1039-1046.
    13. Sadorsky, Perry, 1999. "Oil price shocks and stock market activity," Energy Economics, Elsevier, vol. 21(5), pages 449-469, October.
    14. Kaufmann, Robert K. & Ullman, Ben, 2009. "Oil prices, speculation, and fundamentals: Interpreting causal relations among spot and futures prices," Energy Economics, Elsevier, vol. 31(4), pages 550-558, July.
    15. Ye, Michael & Zyren, John & Shore, Joanne, 2005. "A monthly crude oil spot price forecasting model using relative inventories," International Journal of Forecasting, Elsevier, vol. 21(3), pages 491-501.
    16. Lizardo, Radhamés A. & Mollick, André V., 2010. "Oil price fluctuations and U.S. dollar exchange rates," Energy Economics, Elsevier, vol. 32(2), pages 399-408, March.
    17. Chen, Shiu-Sheng & Chen, Hung-Chyn, 2007. "Oil prices and real exchange rates," Energy Economics, Elsevier, vol. 29(3), pages 390-404, May.
    18. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    19. Granger, C W J, 1969. "Investigating Causal Relations by Econometric Models and Cross-Spectral Methods," Econometrica, Econometric Society, vol. 37(3), pages 424-438, July.
    20. Ivanov Ventzislav & Kilian Lutz, 2005. "A Practitioner's Guide to Lag Order Selection For VAR Impulse Response Analysis," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 9(1), pages 1-36, March.
    21. Maslyuk, Svetlana & Smyth, Russell, 2009. "Cointegration between oil spot and future prices of the same and different grades in the presence of structural change," Energy Policy, Elsevier, vol. 37(5), pages 1687-1693, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lang, Korbinian & Auer, Benjamin R., 2020. "The economic and financial properties of crude oil: A review," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    2. Wang, Yudong & Wu, Chongfeng, 2012. "Energy prices and exchange rates of the U.S. dollar: Further evidence from linear and nonlinear causality analysis," Economic Modelling, Elsevier, vol. 29(6), pages 2289-2297.
    3. Cheng, Xian & Wu, Peng & Liao, Stephen Shaoyi & Wang, Xuelian, 2023. "An integrated model for crude oil forecasting: Causality assessment and technical efficiency," Energy Economics, Elsevier, vol. 117(C).
    4. Kumeka, Terver Theophilus & Uzoma-Nwosu, Damian Chidozie & David-Wayas, Maria Onyinye, 2022. "The effects of COVID-19 on the interrelationship among oil prices, stock prices and exchange rates in selected oil exporting economies," Resources Policy, Elsevier, vol. 77(C).
    5. Qi Zhang & Yi Hu & Jianbin Jiao & Shouyang Wang, 2022. "Exploring the Trend of Commodity Prices: A Review and Bibliometric Analysis," Sustainability, MDPI, vol. 14(15), pages 1-22, August.
    6. Chul-Yong Lee & Sung-Yoon Huh, 2017. "Forecasting Long-Term Crude Oil Prices Using a Bayesian Model with Informative Priors," Sustainability, MDPI, vol. 9(2), pages 1-15, January.
    7. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    8. Qadan, Mahmoud & Idilbi-Bayaa, Yasmeen, 2020. "Risk appetite and oil prices," Energy Economics, Elsevier, vol. 85(C).
    9. Beckmann, Joscha & Belke, Ansgar & Czudaj, Robert, 2014. "Regime-dependent adjustment in energy spot and futures markets," Economic Modelling, Elsevier, vol. 40(C), pages 400-409.
    10. Tayfur Bayat & Saban Nazlioglu & Selim Kayhan, 2015. "Exchange Rate and Oil Price Interactions in Transition Economies: Czech Republic, Hungary and Poland," Panoeconomicus, Savez ekonomista Vojvodine, Novi Sad, Serbia, vol. 62(3), pages 267-285, June.
    11. Hammami Algia & Bouri Abdelfatteh, 2016. "The Volatility of Oil Prices: What Factors?," Bulletin of Energy Economics (BEE), The Economics and Social Development Organization (TESDO), vol. 4(1), pages 98-110, March.
    12. Alzahrani, Mohammed & Masih, Mansur & Al-Titi, Omar, 2014. "Linear and non-linear Granger causality between oil spot and futures prices: A wavelet based test," Journal of International Money and Finance, Elsevier, vol. 48(PA), pages 175-201.
    13. Yang, Lu & Cai, Xiao Jing & Hamori, Shigeyuki, 2018. "What determines the long-term correlation between oil prices and exchange rates?," The North American Journal of Economics and Finance, Elsevier, vol. 44(C), pages 140-152.
    14. Wang, Yudong & Liu, Li & Diao, Xundi & Wu, Chongfeng, 2015. "Forecasting the real prices of crude oil under economic and statistical constraints," Energy Economics, Elsevier, vol. 51(C), pages 599-608.
    15. Basher, Syed Abul & Haug, Alfred A. & Sadorsky, Perry, 2012. "Oil prices, exchange rates and emerging stock markets," Energy Economics, Elsevier, vol. 34(1), pages 227-240.
    16. Beckmann, Joscha & Czudaj, Robert L. & Arora, Vipin, 2020. "The relationship between oil prices and exchange rates: Revisiting theory and evidence," Energy Economics, Elsevier, vol. 88(C).
    17. Bai, Shuming & Koong, Kai S., 2018. "Oil prices, stock returns, and exchange rates: Empirical evidence from China and the United States," The North American Journal of Economics and Finance, Elsevier, vol. 44(C), pages 12-33.
    18. Fan, Ying & Xu, Jin-Hua, 2011. "What has driven oil prices since 2000? A structural change perspective," Energy Economics, Elsevier, vol. 33(6), pages 1082-1094.
    19. Chevillon, Guillaume & Rifflart, Christine, 2009. "Physical market determinants of the price of crude oil and the market premium," Energy Economics, Elsevier, vol. 31(4), pages 537-549, July.
    20. Jia Liao & Yu Shi & Xiangyun Xu, 2018. "Why Is the Correlation between Crude Oil Prices and the US Dollar Exchange Rate Time-Varying?—Explanations Based on the Role of Key Mediators," IJFS, MDPI, vol. 6(3), pages 1-13, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:35:y:2019:i:4:p:1548-1560. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.