IDEAS home Printed from https://ideas.repec.org/a/bpj/bejmac/v24y2024i1p399-437n2.html
   My bibliography  Save this article

Merging Structural and Reduced-Form Models for Forecasting

Author

Listed:
  • Martinez-Martin Jaime

    (Banco de España, Madrid, Spain)

  • Morris Richard

    (European Central Bank, Frankfurt am Main, Germany)

  • Onorante Luca

    (Joint Research Centre, European Commission, Ispra, Italy)

  • Piersanti Fabio Massimo

    (Banca d’Italia, Roma, Italy)

Abstract

Recent economic crises have posed important challenges for forecasting. Models estimated pre-crisis may perform badly when normal economic relationships have been disrupted. Meanwhile, forecasting, especially in central banks, is increasingly based on a suite of models, following two main approaches: structural (DSGE) and reduced form. The challenge remains to identify which model – or combination of models – is likely to make better forecasts in a changing environment. We explore this issue by assessing the forecasting performance of combinations of a medium-scale DSGE model with standard reduced-form methods applied to the Spanish economy and a reference period that includes both the great recession and the sovereign debt crisis. Our findings suggest that: (i) the mean reverting properties of the DSGE model cause it to underestimate the growth of real variables following the inclusion of crisis episodes in the estimation period; (ii) despite this, reduced-form VARs benefit from the imposition of an economic prior from the structural model; but (iii) pooling information in the form of variables extracted from the structural model with (B)VAR methods does not improve forecast accuracy. By analysing the quantiles of the predictive distributions, we also provide evidence that merging models can help improve the forecast in a context including crisis episodes.

Suggested Citation

  • Martinez-Martin Jaime & Morris Richard & Onorante Luca & Piersanti Fabio Massimo, 2024. "Merging Structural and Reduced-Form Models for Forecasting," The B.E. Journal of Macroeconomics, De Gruyter, vol. 24(1), pages 399-437, January.
  • Handle: RePEc:bpj:bejmac:v:24:y:2024:i:1:p:399-437:n:2
    DOI: 10.1515/bejm-2022-0170
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/bejm-2022-0170
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.

    File URL: https://libkey.io/10.1515/bejm-2022-0170?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    2. Barbara Rossi & Tatevik Sekhposyan, 2016. "Forecast Rationality Tests in the Presence of Instabilities, with Applications to Federal Reserve and Survey Forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 507-532, April.
    3. Litterman, Robert B, 1986. "A Statistical Approach to Economic Forecasting," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 1-4, January.
    4. Gonzalo Fernández-de-Córdoba & José Torres, 2011. "Forecasting the Spanish economy with an augmented VAR–DSGE model," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 2(3), pages 379-399, September.
    5. Andrés, Javier & Arce, Óscar & Thomas, Carlos, 2017. "Structural reforms in a debt overhang," Journal of Monetary Economics, Elsevier, vol. 88(C), pages 15-34.
    6. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2008. "The new area-wide model of the euro area: a micro-founded open-economy model for forecasting and policy analysis," Working Paper Series 944, European Central Bank.
    7. Del Negro, Marco & Schorfheide, Frank, 2008. "Forming priors for DSGE models (and how it affects the assessment of nominal rigidities)," Journal of Monetary Economics, Elsevier, vol. 55(7), pages 1191-1208, October.
    8. Christopher J. Erceg & Luca Guerrieri & Christopher Gust, 2006. "SIGMA: A New Open Economy Model for Policy Analysis," International Journal of Central Banking, International Journal of Central Banking, vol. 2(1), March.
    9. Pablo Burriel & Jesús Fernández-Villaverde & Juan Rubio-Ramírez, 2010. "MEDEA: a DSGE model for the Spanish economy," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 1(1), pages 175-243, March.
    10. J. Boscá & A. Díaz & R. Doménech & J. Ferri & E. Pérez & L. Puch, 2010. "A rational expectations model for simulation and policy evaluation of the Spanish economy," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 1(1), pages 135-169, March.
    11. Del Negro, Marco & Hasegawa, Raiden B. & Schorfheide, Frank, 2016. "Dynamic prediction pools: An investigation of financial frictions and forecasting performance," Journal of Econometrics, Elsevier, vol. 192(2), pages 391-405.
    12. Adolfson, Malin & Laseen, Stefan & Linde, Jesper & Villani, Mattias, 2007. "Bayesian estimation of an open economy DSGE model with incomplete pass-through," Journal of International Economics, Elsevier, vol. 72(2), pages 481-511, July.
    13. Gomez-Gonzalez, Patricia & Rees, Daniel M., 2018. "Same Spain, less pain?," European Economic Review, Elsevier, vol. 110(C), pages 78-107.
    14. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    15. Paul Fenton & Stephen Murchison, 2006. "ToTEM: The Bank of Canada's New Projection and Policy-Analysis Model," Bank of Canada Review, Bank of Canada, vol. 2006(Autumn), pages 5-18.
    16. Manzan, Sebastiano & Zerom, Dawit, 2013. "Are macroeconomic variables useful for forecasting the distribution of U.S. inflation?," International Journal of Forecasting, Elsevier, vol. 29(3), pages 469-478.
    17. Javier Andrés & Pablo Burriel & Ángel Estrada, 2006. "BEMOD: a DSGE model for the Spanish economy and the rest of the Euro area," Working Papers 0631, Banco de España.
    18. Hall, Stephen G. & Mitchell, James, 2007. "Combining density forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 1-13.
    19. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    20. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    21. Francis X. Diebold, 1998. "The Past, Present, and Future of Macroeconomic Forecasting," Journal of Economic Perspectives, American Economic Association, vol. 12(2), pages 175-192, Spring.
    22. Graham Elliott & Allan Timmermann, 2005. "Optimal Forecast Combination Under Regime Switching ," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 46(4), pages 1081-1102, November.
    23. Amisano, Gianni & Giacomini, Raffaella, 2007. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
    24. Del Negro, Marco & Schorfheide, Frank & Smets, Frank & Wouters, Rafael, 2007. "On the Fit of New Keynesian Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 123-143, April.
    25. West, Kenneth D & McCracken, Michael W, 1998. "Regression-Based Tests of Predictive Ability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 817-840, November.
    26. Rossi, Barbara & Gürkaynak, Refet & Kısacıkoğlu, Burçin, 2013. "Do DSGE Models Forecast More Accurately Out-of-Sample than VAR Models?," CEPR Discussion Papers 9576, C.E.P.R. Discussion Papers.
    27. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    28. Blanchard, Olivier Jean & Kahn, Charles M, 1980. "The Solution of Linear Difference Models under Rational Expectations," Econometrica, Econometric Society, vol. 48(5), pages 1305-1311, July.
    29. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    30. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2010. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 720-754.
    31. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2015. "Prior Selection for Vector Autoregressions," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 436-451, May.
    32. Marco Del Negro & Frank Schorfheide, 2004. "Priors from General Equilibrium Models for VARS," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 643-673, May.
    33. Rossi, Barbara & Sekhposyan, Tatevik, 2010. "Have economic models' forecasting performance for US output growth and inflation changed over time, and when?," International Journal of Forecasting, Elsevier, vol. 26(4), pages 808-835, October.
    34. Litterman, Robert B, 1986. "Forecasting with Bayesian Vector Autoregressions-Five Years of Experience," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 25-38, January.
    35. Goodwin, Paul, 2000. "Correct or combine? Mechanically integrating judgmental forecasts with statistical methods," International Journal of Forecasting, Elsevier, vol. 16(2), pages 261-275.
    36. Raffaella Giacomini & Barbara Rossi, 2010. "Forecast comparisons in unstable environments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 595-620.
    37. Javier Pérez, 2010. "Discussion of the paper “A rational expectations model for simulation and policy evaluation of the Spanish economy”," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 1(1), pages 171-173, March.
    38. Stephen Murchison & Andrew Rennison, 2006. "ToTEM: The Bank of Canada's New Quarterly Projection Model," Technical Reports 97, Bank of Canada.
    39. Kortelainen, Mika, 2002. "Edge: A model of the euro area with applications to monetary policy," Bank of Finland Scientific Monographs, Bank of Finland, volume 0, number sm2002_023, July.
    40. Javier Andrés & Samuel Hurtado & Eva Ortega & Carlos Thomas, 2010. "Spain in the Euro: a general equilibrium analysis," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 1(1), pages 67-95, March.
    41. Rochelle M. Edge & Refet S. Gurkaynak, 2010. "How Useful Are Estimated DSGE Model Forecasts for Central Bankers?," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 41(2 (Fall)), pages 209-259.
    42. repec:zbw:bofism:2002_023 is not listed on IDEAS
    43. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    44. Raffaella Giacomini, 2013. "The relationship between DSGE and VAR models," CeMMAP working papers CWP21/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Martínez-Martin, Jaime & Morris, Richard & Onorante, Luca & Piersanti, Fabio M., 2019. "Merging structural and reduced-form models for forecasting: opening the DSGE-VAR box," Working Paper Series 2335, European Central Bank.
    2. Gonzalo Fernández-de-Córdoba & José Torres, 2011. "Forecasting the Spanish economy with an augmented VAR–DSGE model," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 2(3), pages 379-399, September.
    3. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    6. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    7. Bekiros Stelios & Paccagnini Alessia, 2015. "Estimating point and density forecasts for the US economy with a factor-augmented vector autoregressive DSGE model," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 19(2), pages 107-136, April.
    8. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    9. Pablo Burriel & Jesús Fernández-Villaverde & Juan Rubio-Ramírez, 2010. "MEDEA: a DSGE model for the Spanish economy," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 1(1), pages 175-243, March.
    10. Maik H. Wolters, 2015. "Evaluating Point and Density Forecasts of DSGE Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(1), pages 74-96, January.
    11. Faust, Jon & Wright, Jonathan H., 2013. "Forecasting Inflation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 2-56, Elsevier.
    12. Stelios D. Bekiros & Alessia Paccagnini, 2016. "Policy‐Oriented Macroeconomic Forecasting with Hybrid DGSE and Time‐Varying Parameter VAR Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 35(7), pages 613-632, November.
    13. Raffaella Giacomini, 2015. "Economic theory and forecasting: lessons from the literature," Econometrics Journal, Royal Economic Society, vol. 18(2), pages 22-41, June.
    14. Kolasa, Marcin & Rubaszek, Michał, 2015. "Forecasting using DSGE models with financial frictions," International Journal of Forecasting, Elsevier, vol. 31(1), pages 1-19.
    15. Bekiros, Stelios D. & Paccagnini, Alessia, 2014. "Bayesian forecasting with small and medium scale factor-augmented vector autoregressive DSGE models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 298-323.
    16. Tovar, Camilo Ernesto, 2009. "DSGE Models and Central Banks," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 3, pages 1-31.
    17. Boneva, Lena & Fawcett, Nicholas & Masolo, Riccardo M. & Waldron, Matt, 2019. "Forecasting the UK economy: Alternative forecasting methodologies and the role of off-model information," International Journal of Forecasting, Elsevier, vol. 35(1), pages 100-120.
    18. Anders Warne & Günter Coenen & Kai Christoffel, 2017. "Marginalized Predictive Likelihood Comparisons of Linear Gaussian State‐Space Models with Applications to DSGE, DSGE‐VAR, and VAR Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(1), pages 103-119, January.
    19. Lindé, Jesper & Smets, Frank & Wouters, Rafael, 2016. "Challenges for Central Banks´ Macro Models," Working Paper Series 323, Sveriges Riksbank (Central Bank of Sweden).
    20. Raffaella Giacomini & Barbara Rossi, 2015. "Forecasting in Nonstationary Environments: What Works and What Doesn't in Reduced-Form and Structural Models," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 207-229, August.

    More about this item

    Keywords

    macroeconomic forecasting; multivariate time series; DSGE models; Bayesian VARs;
    All these keywords.

    JEL classification:

    • C54 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Quantitative Policy Modeling
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • F3 - International Economics - - International Finance
    • F41 - International Economics - - Macroeconomic Aspects of International Trade and Finance - - - Open Economy Macroeconomics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:bejmac:v:24:y:2024:i:1:p:399-437:n:2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.