IDEAS home Printed from https://ideas.repec.org/a/wly/jforec/v41y2022i6p1099-1130.html
   My bibliography  Save this article

Forecast evaluation of DSGE models: Linear and nonlinear likelihood

Author

Listed:
  • Kuo‐Hsuan Chin

Abstract

We apply a Bayesian approach to estimate a small‐scale New Keynesian Dynamic Stochastic General Equilibrium (DSGE) model, solved by linear and nonlinear solution techniques. In particular, the likelihood function for the linearized and nonlinearized models is approximated via the linear and two types of nonlinear filters, respectively. We evaluate the performance of the linearized/nonlinearized model in terms of the log marginal data density and out‐of‐sample forecasting exercise over the transition periods of “Great Inflation” to “Great Moderation” (GI‐GM) and “Great Moderation” to “Great Recession” (GM‐GR). Several results are found as follows. First, it is not clear whether the nonlinearized DSGE model has a better fit than a linearized one to the full sample, and the result is also applied over the transition period of GI‐GM when we compute the time‐varying marginal data density. Second, under the point forecast evaluation, we do not find any statistical evidence that the forecasting performance of DSGE models, either the linearized or nonlinearized one, is better than the VAR models on predicting GDP growth rate, inflation, and interest rates over two transition periods. Moreover, the forecast errors for three data series calculated from either the individual model or the case of “Aggregation across models” in “ Normal” period are significantly lower than those in “ Crisis” period. Third, under the density forecast evaluation across DSGE models, we do not find any significant difference on the sum of log predictive likelihood across models at all forecast horizons for three individual data series. In particular, the above results are also applied to two transition periods and real‐time data sets.

Suggested Citation

  • Kuo‐Hsuan Chin, 2022. "Forecast evaluation of DSGE models: Linear and nonlinear likelihood," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(6), pages 1099-1130, September.
  • Handle: RePEc:wly:jforec:v:41:y:2022:i:6:p:1099-1130
    DOI: 10.1002/for.2850
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/for.2850
    Download Restriction: no

    File URL: https://libkey.io/10.1002/for.2850?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2007. "Estimating Macroeconomic Models: A Likelihood Approach," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(4), pages 1059-1087.
    2. Richard Clarida & Jordi Galí & Mark Gertler, 2000. "Monetary Policy Rules and Macroeconomic Stability: Evidence and Some Theory," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(1), pages 147-180.
    3. Berg, Tim O. & Henzel, Steffen R., 2015. "Point and density forecasts for the euro area using Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1067-1095.
    4. Amélie Charles & Olivier Darné & Laurent Ferrara, 2018. "Does The Great Recession Imply The End Of The Great Moderation? International Evidence," Economic Inquiry, Western Economic Association International, vol. 56(2), pages 745-760, April.
    5. Maik H. Wolters, 2015. "Evaluating Point and Density Forecasts of DSGE Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(1), pages 74-96, January.
    6. Wolters, Maik H., 2011. "Forecasting under Model Uncertainty," VfS Annual Conference 2011 (Frankfurt, Main): The Order of the World Economy - Lessons from the Crisis 48723, Verein für Socialpolitik / German Economic Association.
    7. Barnett, Alina & Mumtaz, Haroon & Theodoridis, Konstantinos, 2014. "Forecasting UK GDP growth and inflation under structural change. A comparison of models with time-varying parameters," International Journal of Forecasting, Elsevier, vol. 30(1), pages 129-143.
    8. Timothy Cogley & Thomas J. Sargent, 2005. "Drift and Volatilities: Monetary Policies and Outcomes in the Post WWII U.S," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(2), pages 262-302, April.
    9. Antonello D'Agostino & Luca Gambetti & Domenico Giannone, 2013. "Macroeconomic forecasting and structural change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(1), pages 82-101, January.
    10. Gary M. Koop, 2013. "Forecasting with Medium and Large Bayesian VARS," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 177-203, March.
    11. Blanchard, Olivier Jean & Kahn, Charles M, 1980. "The Solution of Linear Difference Models under Rational Expectations," Econometrica, Econometric Society, vol. 48(5), pages 1305-1311, July.
    12. Amisano, Gianni & Giacomini, Raffaella, 2007. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
    13. Juan F. Rubio-Ramirez & Jesus Fernández-Villaverde, 2005. "Estimating dynamic equilibrium economies: linear versus nonlinear likelihood," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 891-910.
    14. Amélie Charles & Olivier Darné & Laurent Ferrara, 2018. "Does The Great Recession Imply The End Of The Great Moderation? International Evidence," Economic Inquiry, Western Economic Association International, vol. 56(2), pages 745-760, April.
    15. Berg, Tim O. & Henzel, Steffen R., 2015. "Point and density forecasts for the euro area using Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1067-1095.
    16. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    17. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
    18. Pichler Paul, 2008. "Forecasting with DSGE Models: The Role of Nonlinearities," The B.E. Journal of Macroeconomics, De Gruyter, vol. 8(1), pages 1-35, July.
    19. Sims, Christopher A, 2002. "Solving Linear Rational Expectations Models," Computational Economics, Springer;Society for Computational Economics, vol. 20(1-2), pages 1-20, October.
    20. Sergey Ivashchenko & Rangan Gupta, 2018. "Forecasting using a Nonlinear DSGE Model," Journal of Central Banking Theory and Practice, Central bank of Montenegro, vol. 7(2), pages 73-98.
    21. Peter N. Ireland, 2004. "Technology Shocks in the New Keynesian Model," The Review of Economics and Statistics, MIT Press, vol. 86(4), pages 923-936, November.
    22. Christopher A. Sims & Tao Zha, 2006. "Were There Regime Switches in U.S. Monetary Policy?," American Economic Review, American Economic Association, vol. 96(1), pages 54-81, March.
    23. Rotemberg, Julio J, 1982. "Sticky Prices in the United States," Journal of Political Economy, University of Chicago Press, vol. 90(6), pages 1187-1211, December.
    24. Drew Creal, 2012. "A Survey of Sequential Monte Carlo Methods for Economics and Finance," Econometric Reviews, Taylor & Francis Journals, vol. 31(3), pages 245-296.
    25. Amélie Charles & Olivier Darné & Laurent Ferrara, 2018. "Does The Great Recession Imply The End Of The Great Moderation? International Evidence," Economic Inquiry, Western Economic Association International, vol. 56(2), pages 745-760, April.
    26. King, Robert G. & Plosser, Charles I. & Rebelo, Sergio T., 1988. "Production, growth and business cycles : I. The basic neoclassical model," Journal of Monetary Economics, Elsevier, vol. 21(2-3), pages 195-232.
    27. Klein, Paul, 2000. "Using the generalized Schur form to solve a multivariate linear rational expectations model," Journal of Economic Dynamics and Control, Elsevier, vol. 24(10), pages 1405-1423, September.
    28. Chang-Jin Kim & Charles R. Nelson, 1999. "Has The U.S. Economy Become More Stable? A Bayesian Approach Based On A Markov-Switching Model Of The Business Cycle," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 608-616, November.
    29. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.
    2. Tim Oliver Berg, 2016. "Multivariate Forecasting with BVARs and DSGE Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 35(8), pages 718-740, December.
    3. Mehmet Balcilar & Rangan Gupta & Anandamayee Majumdar & Stephen M. Miller, 2015. "Was the recent downturn in US real GDP predictable?," Applied Economics, Taylor & Francis Journals, vol. 47(28), pages 2985-3007, June.
    4. Reif Magnus, 2021. "Macroeconomic uncertainty and forecasting macroeconomic aggregates," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 25(2), pages 1-20, April.
    5. Galvão, Ana Beatriz & Giraitis, Liudas & Kapetanios, George & Petrova, Katerina, 2016. "A time varying DSGE model with financial frictions," Journal of Empirical Finance, Elsevier, vol. 38(PB), pages 690-716.
    6. Dimitrios P. Louzis, 2017. "Macroeconomic and credit forecasts during the Greek crisis using Bayesian VARs," Empirical Economics, Springer, vol. 53(2), pages 569-598, September.
    7. Ana Beatriz Galvão & Liudas Giraitis & George Kapetanios & Katerina Petrova, 2015. "A Bayesian Local Likelihood Method for Modelling Parameter Time Variation in DSGE Models," Working Papers 770, Queen Mary University of London, School of Economics and Finance.
    8. Mehmet Balcilar & Rangan Gupta & Anandamayee Majumdar & Stephen M. Miller, 2012. "Was the Recent Downturn in US GDP Predictable?," Working Papers 1210, University of Nevada, Las Vegas , Department of Economics.
    9. Peter N. Ireland, 2004. "Technology Shocks in the New Keynesian Model," The Review of Economics and Statistics, MIT Press, vol. 86(4), pages 923-936, November.
    10. Galvão, Ana Beatriz & Giraitis, Liudas & Kapetanios, George & Petrova, Katerina, 2016. "A time varying DSGE model with financial frictions," Journal of Empirical Finance, Elsevier, vol. 38(PB), pages 690-716.
    11. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    12. Andrei Polbin & Sergey Drobyshevsky, 2014. "Developing a Dynamic Stochastic Model of General Equilibrium for the Russian Economy," Research Paper Series, Gaidar Institute for Economic Policy, issue 166P, pages 156-156.
    13. Baele, Lieven & Bekaert, Geert & Cho, Seonghoon & Inghelbrecht, Koen & Moreno, Antonio, 2015. "Macroeconomic regimes," Journal of Monetary Economics, Elsevier, vol. 70(C), pages 51-71.
    14. Berg, Tim O. & Henzel, Steffen R., 2015. "Point and density forecasts for the euro area using Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1067-1095.
    15. Raffaella Giacomini & Barbara Rossi, 2015. "Forecasting in Nonstationary Environments: What Works and What Doesn't in Reduced-Form and Structural Models," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 207-229, August.
    16. Bekiros Stelios & Paccagnini Alessia, 2015. "Estimating point and density forecasts for the US economy with a factor-augmented vector autoregressive DSGE model," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 19(2), pages 107-136, April.
    17. Liu, Zheng & Waggoner, Daniel F. & Zha, Tao, 2007. "Asymmetric Expectation Effects of Regime Shifts and the Great Moderation," Kiel Working Papers 1357, Kiel Institute for the World Economy (IfW Kiel).
    18. Knotek, Edward S. & Zaman, Saeed, 2019. "Financial nowcasts and their usefulness in macroeconomic forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1708-1724.
    19. Gorodnichenko, Yuriy & Ng, Serena, 2010. "Estimation of DSGE models when the data are persistent," Journal of Monetary Economics, Elsevier, vol. 57(3), pages 325-340, April.
    20. Peter N. Ireland, 2011. "A New Keynesian Perspective on the Great Recession," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 43(1), pages 31-54, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jforec:v:41:y:2022:i:6:p:1099-1130. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.