IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v272y2019i1p162-175.html
   My bibliography  Save this article

News-based forecasts of macroeconomic indicators: A semantic path model for interpretable predictions

Author

Listed:
  • Feuerriegel, Stefan
  • Gordon, Julius

Abstract

The macroeconomic climate influences operations with regard to, e.g., raw material prices, financing, supply chain utilization and demand quotas. In order to adapt to the economic environment, decision-makers across the public and private sectors require accurate forecasts of the economic outlook. Existing predictive frameworks base their forecasts primarily on time series analysis, as well as the judgments of experts. As a consequence, current approaches are often biased and prone to error. In order to reduce forecast errors, this paper presents an innovative methodology that extends lag variables with unstructured data in the form of financial news: (1) we apply a variety of models from machine learning to word counts as a high-dimensional input. However, this approach suffers from low interpretability and overfitting, motivating the following remedies. (2) We follow the intuition that the economic climate is driven by general sentiments and suggest a projection of words onto latent semantic structures as a means of feature engineering. (3) We propose a semantic path model, together with estimation technique based on regularization, in order to yield full interpretability of the forecasts. We demonstrate the predictive performance of our approach by utilizing 80,813 ad hoc announcements in order to make long-term forecasts of up to 24 months ahead regarding key macroeconomic indicators. Back-testing reveals a considerable reduction in forecast errors.

Suggested Citation

  • Feuerriegel, Stefan & Gordon, Julius, 2019. "News-based forecasts of macroeconomic indicators: A semantic path model for interpretable predictions," European Journal of Operational Research, Elsevier, vol. 272(1), pages 162-175.
  • Handle: RePEc:eee:ejores:v:272:y:2019:i:1:p:162-175
    DOI: 10.1016/j.ejor.2018.05.068
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221718304879
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2018.05.068?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mahmoud, E & Motwani, J & Rice, G, 1990. "Forecasting US exports: An illustration using time series and econometric models," Omega, Elsevier, vol. 18(4), pages 375-382.
    2. Dovern, Jonas & Weisser, Johannes, 2011. "Accuracy, unbiasedness and efficiency of professional macroeconomic forecasts: An empirical comparison for the G7," International Journal of Forecasting, Elsevier, vol. 27(2), pages 452-465.
    3. Sun, Lili & Shenoy, Prakash P., 2007. "Using Bayesian networks for bankruptcy prediction: Some methodological issues," European Journal of Operational Research, Elsevier, vol. 180(2), pages 738-753, July.
    4. McKee, Thomas E. & Lensberg, Terje, 2002. "Genetic programming and rough sets: A hybrid approach to bankruptcy classification," European Journal of Operational Research, Elsevier, vol. 138(2), pages 436-451, April.
    5. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    6. Desai, Vijay S. & Crook, Jonathan N. & Overstreet, George A., 1996. "A comparison of neural networks and linear scoring models in the credit union environment," European Journal of Operational Research, Elsevier, vol. 95(1), pages 24-37, November.
    7. Sermpinis, Georgios & Theofilatos, Konstantinos & Karathanasopoulos, Andreas & Georgopoulos, Efstratios F. & Dunis, Christian, 2013. "Forecasting foreign exchange rates with adaptive neural networks using radial-basis functions and Particle Swarm Optimization," European Journal of Operational Research, Elsevier, vol. 225(3), pages 528-540.
    8. Miguel I. Aguirre-Urreta & George M. Marakas, 2014. "Research Note—Partial Least Squares and Models with Formatively Specified Endogenous Constructs: A Cautionary Note," Information Systems Research, INFORMS, vol. 25(4), pages 761-778, December.
    9. Aubert, B. A. & Rivard, S. & Patry, M., 1996. "Development of measures to assess dimensions of IS operation transactions," Omega, Elsevier, vol. 24(6), pages 661-680, December.
    10. Layton, Allan P. & Smith, Daniel R., 2007. "Business cycle dynamics with duration dependence and leading indicators," Journal of Macroeconomics, Elsevier, vol. 29(4), pages 855-875, December.
    11. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2015. "Bayesian VARs: Specification Choices and Forecast Accuracy," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(1), pages 46-73, January.
    12. Maurizio Bovi & Roy Cerqueti, 2016. "Forecasting macroeconomic fundamentals in economic crises," Annals of Operations Research, Springer, vol. 247(2), pages 451-469, December.
    13. Kuhn, Max, 2008. "Building Predictive Models in R Using the caret Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 28(i05).
    14. Mostard, Julien & Teunter, Ruud & de Koster, René, 2011. "Forecasting demand for single-period products: A case study in the apparel industry," European Journal of Operational Research, Elsevier, vol. 211(1), pages 139-147, May.
    15. Allen, P. Geoffrey & Morzuch, Bernard J., 2006. "Twenty-five years of progress, problems, and conflicting evidence in econometric forecasting. What about the next 25 years?," International Journal of Forecasting, Elsevier, vol. 22(3), pages 475-492.
    16. Yuqian Xu & Michael Pinedo & Mei Xue, 2017. "Operational Risk in Financial Services: A Review and New Research Opportunities," Production and Operations Management, Production and Operations Management Society, vol. 26(3), pages 426-445, March.
    17. Tenenhaus, Michel & Vinzi, Vincenzo Esposito & Chatelin, Yves-Marie & Lauro, Carlo, 2005. "PLS path modeling," Computational Statistics & Data Analysis, Elsevier, vol. 48(1), pages 159-205, January.
    18. Demyanyk, Yuliya & Hasan, Iftekhar, 2010. "Financial crises and bank failures: A review of prediction methods," Omega, Elsevier, vol. 38(5), pages 315-324, October.
    19. du Jardin, Philippe, 2015. "Bankruptcy prediction using terminal failure processes," European Journal of Operational Research, Elsevier, vol. 242(1), pages 286-303.
    20. Liang, Deron & Lu, Chia-Chi & Tsai, Chih-Fong & Shih, Guan-An, 2016. "Financial ratios and corporate governance indicators in bankruptcy prediction: A comprehensive study," European Journal of Operational Research, Elsevier, vol. 252(2), pages 561-572.
    21. Akkoç, Soner, 2012. "An empirical comparison of conventional techniques, neural networks and the three stage hybrid Adaptive Neuro Fuzzy Inference System (ANFIS) model for credit scoring analysis: The case of Turkish cred," European Journal of Operational Research, Elsevier, vol. 222(1), pages 168-178.
    22. Jansen, W. Jos & Jin, Xiaowen & de Winter, Jasper M., 2016. "Forecasting and nowcasting real GDP: Comparing statistical models and subjective forecasts," International Journal of Forecasting, Elsevier, vol. 32(2), pages 411-436.
    23. Lê Cao Kim-Anh & Rossouw Debra & Robert-Granié Christèle & Besse Philippe, 2008. "A Sparse PLS for Variable Selection when Integrating Omics Data," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 7(1), pages 1-32, November.
    24. Litterman, Robert B, 1986. "Forecasting with Bayesian Vector Autoregressions-Five Years of Experience," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 25-38, January.
    25. Geng, Ruibin & Bose, Indranil & Chen, Xi, 2015. "Prediction of financial distress: An empirical study of listed Chinese companies using data mining," European Journal of Operational Research, Elsevier, vol. 241(1), pages 236-247.
    26. Huang, Yan & Kou, Gang & Peng, Yi, 2017. "Nonlinear manifold learning for early warnings in financial markets," European Journal of Operational Research, Elsevier, vol. 258(2), pages 692-702.
    27. Hyonho Chun & Sündüz Keleş, 2010. "Sparse partial least squares regression for simultaneous dimension reduction and variable selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(1), pages 3-25, January.
    28. Kar Yan Tam & Melody Y. Kiang, 1992. "Managerial Applications of Neural Networks: The Case of Bank Failure Predictions," Management Science, INFORMS, vol. 38(7), pages 926-947, July.
    29. Lessmann, Stefan & Sung, Ming-Chien & Johnson, Johnnie E.V. & Ma, Tiejun, 2012. "A new methodology for generating and combining statistical forecasting models to enhance competitive event prediction," European Journal of Operational Research, Elsevier, vol. 218(1), pages 163-174.
    30. Goudie, AW & Meeks, G, 1982. "The effects of macroeconomic developments on individual companies' flows of funds," Omega, Elsevier, vol. 10(4), pages 361-371.
    31. Blanc, Sebastian M. & Setzer, Thomas, 2015. "Analytical debiasing of corporate cash flow forecasts," European Journal of Operational Research, Elsevier, vol. 243(3), pages 1004-1015.
    32. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    33. Sevim, Cuneyt & Oztekin, Asil & Bali, Ozkan & Gumus, Serkan & Guresen, Erkam, 2014. "Developing an early warning system to predict currency crises," European Journal of Operational Research, Elsevier, vol. 237(3), pages 1095-1104.
    34. Tay, Francis E. H. & Cao, Lijuan, 2001. "Application of support vector machines in financial time series forecasting," Omega, Elsevier, vol. 29(4), pages 309-317, August.
    35. Shaik, Saleem, 2015. "Impact of liquidity risk on variations in efficiency and productivity: A panel gamma simulated maximum likelihood estimation," European Journal of Operational Research, Elsevier, vol. 245(2), pages 463-469.
    36. Mortenson, Michael J. & Doherty, Neil F. & Robinson, Stewart, 2015. "Operational research from Taylorism to Terabytes: A research agenda for the analytics age," European Journal of Operational Research, Elsevier, vol. 241(3), pages 583-595.
    37. Kizilaslan, Recep & Freund, Steven & Iseri, Ali, 2016. "A data analytic approach to forecasting daily stock returns in an emerging marketAuthor-Name: Oztekin, Asil," European Journal of Operational Research, Elsevier, vol. 253(3), pages 697-710.
    38. Litterman, Robert, 1986. "Forecasting with Bayesian vector autoregressions -- Five years of experience : Robert B. Litterman, Journal of Business and Economic Statistics 4 (1986) 25-38," International Journal of Forecasting, Elsevier, vol. 2(4), pages 497-498.
    39. Fethi, Meryem Duygun & Pasiouras, Fotios, 2010. "Assessing bank efficiency and performance with operational research and artificial intelligence techniques: A survey," European Journal of Operational Research, Elsevier, vol. 204(2), pages 189-198, July.
    40. Matsypura, Dmytro & Thompson, Ryan & Vasnev, Andrey L., 2018. "Optimal selection of expert forecasts with integer programming," Omega, Elsevier, vol. 78(C), pages 165-175.
    41. Kung, Ling-Ming & Yu, Shang-Wu, 2008. "Prediction of index futures returns and the analysis of financial spillovers--A comparison between GARCH and the grey theorem," European Journal of Operational Research, Elsevier, vol. 186(3), pages 1184-1200, May.
    42. Calabrese, Raffaella & Degl’Innocenti, Marta & Osmetti, Silvia Angela, 2017. "The effectiveness of TARP-CPP on the US banking industry: A new copula-based approach," European Journal of Operational Research, Elsevier, vol. 256(3), pages 1029-1037.
    43. Tsai, Ming-Feng & Wang, Chuan-Ju, 2017. "On the risk prediction and analysis of soft information in finance reports," European Journal of Operational Research, Elsevier, vol. 257(1), pages 243-250.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Saber Talazadeh & Dragan Perakovic, 2024. "SARF: Enhancing Stock Market Prediction with Sentiment-Augmented Random Forest," Papers 2410.07143, arXiv.org.
    2. Wang, Jujie & Zhuang, Zhenzhen & Gao, Dongming, 2023. "An enhanced hybrid model based on multiple influencing factors and divide-conquer strategy for carbon price prediction," Omega, Elsevier, vol. 120(C).
    3. Petrova, Diana & Trunin, Pavel, 2020. "Revealing the mood of economic agents based on search queries," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 59, pages 71-87.
    4. Matteo Cinelli & Valerio Ficcadenti & Jessica Riccioni, 2021. "The interconnectedness of the economic content in the speeches of the US Presidents," Annals of Operations Research, Springer, vol. 299(1), pages 593-615, April.
    5. Černý, Igor & Vaněk, Michal & Maruszewska, Ewa Wanda & Beneš, Filip, 2021. "How economic indicators impact the EU internal demand for critical raw materials," Resources Policy, Elsevier, vol. 74(C).
    6. Wang, Delu & Gan, Jun & Mao, Jinqi & Chen, Fan & Yu, Lan, 2023. "Forecasting power demand in China with a CNN-LSTM model including multimodal information," Energy, Elsevier, vol. 263(PE).
    7. Doumpos, Michalis & Zopounidis, Constantin & Gounopoulos, Dimitrios & Platanakis, Emmanouil & Zhang, Wenke, 2023. "Operational research and artificial intelligence methods in banking," European Journal of Operational Research, Elsevier, vol. 306(1), pages 1-16.
    8. Tanujit Chakraborty & Ashis Kumar Chakraborty & Munmun Biswas & Sayak Banerjee & Shramana Bhattacharya, 2021. "Unemployment Rate Forecasting: A Hybrid Approach," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 183-201, January.
    9. Mikhaylov, Dmitry, 2023. "Macroeconomic Forecasting with the Use of News Data," Working Papers w20220250, Russian Presidential Academy of National Economy and Public Administration.
    10. Borchert, Philipp & Coussement, Kristof & De Weerdt, Jochen & De Caigny, Arno, 2024. "Industry-sensitive language modeling for business," European Journal of Operational Research, Elsevier, vol. 315(2), pages 691-702.
    11. Matteo Cinelli & Valerio Ficcadenti & Jessica Riccioni, 2020. "The interconnectedness of the economic content in the speeches of the US Presidents," Papers 2002.07880, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kizilaslan, Recep & Freund, Steven & Iseri, Ali, 2016. "A data analytic approach to forecasting daily stock returns in an emerging marketAuthor-Name: Oztekin, Asil," European Journal of Operational Research, Elsevier, vol. 253(3), pages 697-710.
    2. Mai, Feng & Tian, Shaonan & Lee, Chihoon & Ma, Ling, 2019. "Deep learning models for bankruptcy prediction using textual disclosures," European Journal of Operational Research, Elsevier, vol. 274(2), pages 743-758.
    3. Andrea Carriero & Francesco Corsello & Massimiliano Marcellino, 2022. "The global component of inflation volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(4), pages 700-721, June.
    4. Berg, Tim O. & Henzel, Steffen R., 2015. "Point and density forecasts for the euro area using Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1067-1095.
    5. Carriero, Andrea & Kapetanios, George & Marcellino, Massimiliano, 2012. "Forecasting government bond yields with large Bayesian vector autoregressions," Journal of Banking & Finance, Elsevier, vol. 36(7), pages 2026-2047.
    6. Kascha, Christian & Trenkler, Carsten, 2015. "Forecasting VARs, model selection, and shrinkage," Working Papers 15-07, University of Mannheim, Department of Economics.
    7. Демешев Борис Борисович & Малаховская Оксана Анатольевна, 2016. "Макроэкономическое Прогнозирование С Помощью Bvar Литтермана," Higher School of Economics Economic Journal Экономический журнал Высшей школы экономики, CyberLeninka;Федеральное государственное автономное образовательное учреждение высшего образования «Национальный исследовательский университет «Высшая школа экономики», vol. 20(4), pages 691-710.
    8. Karlsson, Sune, 2013. "Forecasting with Bayesian Vector Autoregression," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 791-897, Elsevier.
    9. Ben Jabeur, Sami & Serret, Vanessa, 2023. "Bankruptcy prediction using fuzzy convolutional neural networks," Research in International Business and Finance, Elsevier, vol. 64(C).
    10. José Willer Prado & Valderí Castro Alcântara & Francisval Melo Carvalho & Kelly Carvalho Vieira & Luiz Kennedy Cruz Machado & Dany Flávio Tonelli, 2016. "Multivariate analysis of credit risk and bankruptcy research data: a bibliometric study involving different knowledge fields (1968–2014)," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1007-1029, March.
    11. Mohammad Mahdi Mousavi & Jamal Ouenniche, 2018. "Multi-criteria ranking of corporate distress prediction models: empirical evaluation and methodological contributions," Annals of Operations Research, Springer, vol. 271(2), pages 853-886, December.
    12. Fildes, Robert, 2006. "The forecasting journals and their contribution to forecasting research: Citation analysis and expert opinion," International Journal of Forecasting, Elsevier, vol. 22(3), pages 415-432.
    13. Florian Huber & Gary Koop, 2023. "Subspace shrinkage in conjugate Bayesian vector autoregressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(4), pages 556-576, June.
    14. Andrejs Bessonovs, 2015. "Suite of Latvia's GDP forecasting models," Working Papers 2015/01, Latvijas Banka.
    15. Yi Cao & Xiaoquan Liu & Jia Zhai & Shan Hua, 2022. "A two‐stage Bayesian network model for corporate bankruptcy prediction," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 455-472, January.
    16. Sevim, Cuneyt & Oztekin, Asil & Bali, Ozkan & Gumus, Serkan & Guresen, Erkam, 2014. "Developing an early warning system to predict currency crises," European Journal of Operational Research, Elsevier, vol. 237(3), pages 1095-1104.
    17. Tomasz Woźniak, 2016. "Bayesian Vector Autoregressions," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 49(3), pages 365-380, September.
    18. Demeshev, Boris & Malakhovskaya, Oxana, 2016. "BVAR mapping," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 43, pages 118-141.
    19. repec:wrk:wrkemf:12 is not listed on IDEAS
    20. Rangan Gupta & Alain Kabundi & Stephen M. Miller, 2009. "Using Large Data Sets to Forecast Housing Prices: A Case Study of Twenty US States," Working Papers 200912, University of Pretoria, Department of Economics.
    21. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:272:y:2019:i:1:p:162-175. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.