IDEAS home Printed from https://ideas.repec.org/a/spr/empeco/v65y2023i4d10.1007_s00181-023-02389-8.html
   My bibliography  Save this article

An artificial intelligence approach to forecasting when there are structural breaks: a reinforcement learning-based framework for fast switching

Author

Listed:
  • Jeronymo Marcondes Pinto

    (Secretariat of Labour Inspection)

  • Emerson Fernandes Marçal

    (CEMAP-EESP-FGV)

Abstract

Economic forecasting during structural breaks is challenging due to the possible systematic failure of existent models. Robust forecast devices are able to provide unbiased forecasts just after structural change but at the cost of higher variance in normal times. Therefore, there is a trade-off between bias and variance when we intend to forecast a variable under the possibility of structural breaks. In order to choose the best model for each case scenario, we propose a novel algorithm based on the Reinforcement Learning method. Our method is able to gather history performance from all the tested models and choose the one with best performance depending on the “state” of data as soon as the effects of this change are perceived. Hence, our method is able to adapt to the changes of the structural break very fast and change back to a model with less variance as soon as those effects vanish. We provide evidence based on an extensive and rigorous empirical test with Monte Carlo and real data forecasting exercises that this algorithm can improve forecast performance in a scenario of structural change without losing significant performance under normal times.

Suggested Citation

  • Jeronymo Marcondes Pinto & Emerson Fernandes Marçal, 2023. "An artificial intelligence approach to forecasting when there are structural breaks: a reinforcement learning-based framework for fast switching," Empirical Economics, Springer, vol. 65(4), pages 1729-1759, October.
  • Handle: RePEc:spr:empeco:v:65:y:2023:i:4:d:10.1007_s00181-023-02389-8
    DOI: 10.1007/s00181-023-02389-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00181-023-02389-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00181-023-02389-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Inoue, Atsushi & Jin, Lu & Rossi, Barbara, 2017. "Rolling window selection for out-of-sample forecasting with time-varying parameters," Journal of Econometrics, Elsevier, vol. 196(1), pages 55-67.
    2. Castle, Jennifer L. & Clements, Michael P. & Hendry, David F., 2015. "Robust approaches to forecasting," International Journal of Forecasting, Elsevier, vol. 31(1), pages 99-112.
    3. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    4. Castle, Jennifer L. & Fawcett, Nicholas W.P. & Hendry, David F., 2010. "Forecasting with equilibrium-correction models during structural breaks," Journal of Econometrics, Elsevier, vol. 158(1), pages 25-36, September.
    5. Giorgio Canarella & Stephen M. Miller, 2016. "Inflation Persistence and Structural Breaks: The Experience of Inflation Targeting Countries and the US," Working papers 2016-21, University of Connecticut, Department of Economics.
    6. Jeronymo Marcondes Pinto & Jennifer L. Castle, 2022. "Machine Learning Dynamic Switching Approach to Forecasting in the Presence of Structural Breaks," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 18(2), pages 129-157, July.
    7. Hendry, David F., 2006. "Robustifying forecasts from equilibrium-correction systems," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 399-426.
    8. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521634809.
    9. Jennifer L. Castle & Michael P. Clements & David F. Hendry, 2016. "An Overview of Forecasting Facing Breaks," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 12(1), pages 3-23, September.
    10. Michael P. Clements & David F. Hendry, 2001. "Forecasting Non-Stationary Economic Time Series," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262531895, December.
    11. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    12. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    13. Erdenebat Bataa & Denise R. Osborn & Marianne Sensier & Dick van Dijk, 2013. "Structural Breaks in the International Dynamics of Inflation," The Review of Economics and Statistics, MIT Press, vol. 95(2), pages 646-659, May.
    14. Chen-Fu Chien & Yun-Siang Lin & Sheng-Kai Lin, 2020. "Deep reinforcement learning for selecting demand forecast models to empower Industry 3.5 and an empirical study for a semiconductor component distributor," International Journal of Production Research, Taylor & Francis Journals, vol. 58(9), pages 2784-2804, May.
    15. Shahid, Farah & Zameer, Aneela & Muneeb, Muhammad, 2021. "A novel genetic LSTM model for wind power forecast," Energy, Elsevier, vol. 223(C).
    16. Clements, Michael P & Hendry, David F, 1996. "Intercept Corrections and Structural Change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 475-494, Sept.-Oct.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Jeronymo Marcondes Pinto & Jennifer L. Castle, 2022. "Machine Learning Dynamic Switching Approach to Forecasting in the Presence of Structural Breaks," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 18(2), pages 129-157, July.
    3. Jennifer L. Castle & Michael P. Clements & David F. Hendry, 2016. "An Overview of Forecasting Facing Breaks," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 12(1), pages 3-23, September.
    4. David Hendry & Michael P. Clements, 2010. "Forecasting from Mis-specified Models in the Presence of Unanticipated Location Shifts," Economics Series Working Papers 484, University of Oxford, Department of Economics.
    5. Ericsson, Neil R., 2017. "How biased are U.S. government forecasts of the federal debt?," International Journal of Forecasting, Elsevier, vol. 33(2), pages 543-559.
    6. Ericsson, Neil R., 2017. "Economic forecasting in theory and practice: An interview with David F. Hendry," International Journal of Forecasting, Elsevier, vol. 33(2), pages 523-542.
    7. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    8. Hendry, David F. & Clements, Michael P., 2003. "Economic forecasting: some lessons from recent research," Economic Modelling, Elsevier, vol. 20(2), pages 301-329, March.
    9. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    10. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
    11. Issler, João Victor & Lima, Luiz Renato, 2009. "A panel data approach to economic forecasting: The bias-corrected average forecast," Journal of Econometrics, Elsevier, vol. 152(2), pages 153-164, October.
    12. Jennifer L. Castle & Jurgen A. Doornik & David F. Hendry, 2021. "Selecting a Model for Forecasting," Econometrics, MDPI, vol. 9(3), pages 1-35, June.
    13. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    14. Larson, William D. & Sinclair, Tara M., 2022. "Nowcasting unemployment insurance claims in the time of COVID-19," International Journal of Forecasting, Elsevier, vol. 38(2), pages 635-647.
    15. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    16. Hubrich, Kirstin, 2005. "Forecasting euro area inflation: Does aggregating forecasts by HICP component improve forecast accuracy?," International Journal of Forecasting, Elsevier, vol. 21(1), pages 119-136.
    17. David Hendry, 2000. "A General Forecast-error Taxonomy," Econometric Society World Congress 2000 Contributed Papers 0608, Econometric Society.
    18. David F. Hendry, 2002. "Forecast Failure, Expectations Formation and the Lucas Critique," Annals of Economics and Statistics, GENES, issue 67-68, pages 21-40.
    19. Pesaran, M. Hashem & Timmermann, Allan, 2005. "Small sample properties of forecasts from autoregressive models under structural breaks," Journal of Econometrics, Elsevier, vol. 129(1-2), pages 183-217.
    20. Daniel Borup & Jonas N. Eriksen & Mads M. Kjær & Martin Thyrsgaard, 2020. "Predicting bond return predictability," CREATES Research Papers 2020-09, Department of Economics and Business Economics, Aarhus University.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:empeco:v:65:y:2023:i:4:d:10.1007_s00181-023-02389-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.