IDEAS home Printed from https://ideas.repec.org/p/zbw/cauewp/201303.html
   My bibliography  Save this paper

Evaluating point and density forecasts of DSGE models

Author

Listed:
  • Wolters, Maik H.

Abstract

This paper investigates the accuracy of forecasts from four DSGE models for inflation, output growth and the federal funds rate using a real-time dataset synchronized with the Fed's Greenbook projections. Conditioning the model forecasts on the Greenbook nowcasts leads to forecasts that are as accurate as the Greenbook projections for output growth and the federal funds rate. Only for inflation the model forecasts are dominated by the Greenbook projections. A comparison with forecasts from Bayesian VARs shows that the economic structure of the DSGE models which is useful for the interpretation of forecasts does not lower the accuracy of forecasts. Combining forecasts of several DSGE models increases precision in comparison to individual model forecasts. Comparing density forecasts with the actual distribution of observations shows that DSGE models overestimate uncertainty around point forecasts.

Suggested Citation

  • Wolters, Maik H., 2013. "Evaluating point and density forecasts of DSGE models," Economics Working Papers 2013-03, Christian-Albrechts-University of Kiel, Department of Economics.
  • Handle: RePEc:zbw:cauewp:201303
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/82623/1/767849566.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2003. "Do financial variables help forecasting inflation and real activity in the euro area?," Journal of Monetary Economics, Elsevier, vol. 50(6), pages 1243-1255, September.
    2. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    3. Michael K. Andersson & Sune Karlsson, 2008. "Bayesian forecast combination for VAR models," Advances in Econometrics, in: Bayesian Econometrics, pages 501-524, Emerald Group Publishing Limited.
    4. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models—Rejoinder," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 211-219.
    5. Mu-Chun Wang, 2009. "Comparing the DSGE model with the factor model: an out-of-sample forecasting experiment," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(2), pages 167-182.
    6. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    7. Berg, Tim O. & Henzel, Steffen R., 2015. "Point and density forecasts for the euro area using Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1067-1095.
    8. Jeff Fuhrer & George Moore, 1995. "Inflation Persistence," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(1), pages 127-159.
    9. Wieland, Volker & Wolters, Maik, 2013. "Forecasting and Policy Making," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 239-325, Elsevier.
    10. Marvin Goodfriend & Robert G. King, 1997. "The New Neoclassical Synthesis and the Role of Monetary Policy," NBER Chapters, in: NBER Macroeconomics Annual 1997, Volume 12, pages 231-296, National Bureau of Economic Research, Inc.
    11. Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
    12. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2008. "The new area-wide model of the euro area: a micro-founded open-economy model for forecasting and policy analysis," Working Paper Series 944, European Central Bank.
    13. Fuhrer, Jeffrey C & Moore, George R, 1995. "Monetary Policy Trade-offs and the Correlation between Nominal Interest Rates and Real Output," American Economic Review, American Economic Association, vol. 85(1), pages 219-239, March.
    14. Ray Fair, 2006. "Evaluating Inflation Targeting Using a Macroeconometric Model," Yale School of Management Working Papers amz2483, Yale School of Management, revised 01 Aug 2007.
    15. Ben S. Bernanke & Julio J. Rotemberg (ed.), 1997. "NBER Macroeconomics Annual 1997," MIT Press Books, The MIT Press, edition 1, volume 1, number 026252242x, April.
    16. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    17. Fuhrer, Jeffrey C., 2010. "Inflation Persistence," Handbook of Monetary Economics, in: Benjamin M. Friedman & Michael Woodford (ed.), Handbook of Monetary Economics, edition 1, volume 3, chapter 9, pages 423-486, Elsevier.
    18. Athanasios Orphanides, 2001. "Monetary Policy Rules Based on Real-Time Data," American Economic Review, American Economic Association, vol. 91(4), pages 964-985, September.
    19. Adolfson, Malin & Laseen, Stefan & Linde, Jesper & Villani, Mattias, 2007. "Bayesian estimation of an open economy DSGE model with incomplete pass-through," Journal of International Economics, Elsevier, vol. 72(2), pages 481-511, July.
    20. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    21. Woodford, Michael, 1995. "The Quantitative Analytics of the Basic Neomonetarist Model: Comment," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 27(4), pages 1278-1289, November.
    22. Malin Adolfson & Michael K. Andersson & Jesper Lindé & Mattias Villani & Anders Vredin, 2007. "Modern Forecasting Models in Action: Improving Macroeconomic Analyses at Central Banks," International Journal of Central Banking, International Journal of Central Banking, vol. 3(4), pages 111-144, December.
    23. Frank Schorfheide, 2000. "Loss function-based evaluation of DSGE models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 645-670.
    24. Thomas Doan & Robert B. Litterman & Christopher A. Sims, 1983. "Forecasting and Conditional Projection Using Realistic Prior Distributions," NBER Working Papers 1202, National Bureau of Economic Research, Inc.
    25. Fair, Ray C., 2007. "Evaluating Inflation Targeting Using a Macroeconometric Model," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 1, pages 1-52.
    26. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    27. Hugo Gerard & Kristoffer Nimark, 2008. "Combining Multivariate Density Forecasts Using Predictive Criteria," RBA Research Discussion Papers rdp2008-02, Reserve Bank of Australia.
    28. Jana Eklund & Sune Karlsson, 2007. "Forecast Combination and Model Averaging Using Predictive Measures," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 329-363.
    29. Bernanke, Ben S. & Boivin, Jean, 2003. "Monetary policy in a data-rich environment," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 525-546, April.
    30. Herbst, Edward & Schorfheide, Frank, 2012. "Evaluating DSGE model forecasts of comovements," Journal of Econometrics, Elsevier, vol. 171(2), pages 152-166.
    31. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    32. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    33. Volker Wieland & Maik Wolters, 2011. "The diversity of forecasts from macroeconomic models of the US economy," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 47(2), pages 247-292, June.
    34. Wolden Bache, Ida & Sofie Jore, Anne & Mitchell, James & Vahey, Shaun P., 2011. "Combining VAR and DSGE forecast densities," Journal of Economic Dynamics and Control, Elsevier, vol. 35(10), pages 1659-1670, October.
    35. Del Negro, Marco & Schorfheide, Frank & Smets, Frank & Wouters, Rafael, 2007. "On the Fit of New Keynesian Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 123-143, April.
    36. Frank Smets & Kai Christoffel & Günter Coenen & Roberto Motto & Massimo Rostagno, 2010. "DSGE models and their use at the ECB," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 1(1), pages 51-65, March.
    37. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2003. "Macroeconomic forecasting in the Euro area: Country specific versus area-wide information," European Economic Review, Elsevier, vol. 47(1), pages 1-18, February.
    38. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    39. John Geweke & Gianni Amisano, 2012. "Prediction with Misspecified Models," American Economic Review, American Economic Association, vol. 102(3), pages 482-486, May.
    40. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    41. Neville Francis & Valerie A. Ramey, 2009. "Measures of per Capita Hours and Their Implications for the Technology-Hours Debate," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(6), pages 1071-1097, September.
    42. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2010. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 720-754.
    43. Waggoner, Daniel F. & Zha, Tao, 2012. "Confronting model misspecification in macroeconomics," Journal of Econometrics, Elsevier, vol. 171(2), pages 167-184.
    44. Marco Del Negro & Frank Schorfheide, 2004. "Priors from General Equilibrium Models for VARS," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 643-673, May.
    45. repec:ulb:ulbeco:2013/13388 is not listed on IDEAS
    46. Ingram, Beth F. & Whiteman, Charles H., 1994. "Supplanting the 'Minnesota' prior: Forecasting macroeconomic time series using real business cycle model priors," Journal of Monetary Economics, Elsevier, vol. 34(3), pages 497-510, December.
    47. Wieland, Volker & Cwik, Tobias & Müller, Gernot J. & Schmidt, Sebastian & Wolters, Maik, 2012. "A new comparative approach to macroeconomic modeling and policy analysis," Journal of Economic Behavior & Organization, Elsevier, vol. 83(3), pages 523-541.
    48. Frank Smets & Raf Wouters, 2004. "Forecasting with a Bayesian DSGE Model: An Application to the Euro Area," Journal of Common Market Studies, Wiley Blackwell, vol. 42(4), pages 841-867, November.
    49. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    50. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    51. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    52. Kimball, Miles S, 1995. "The Quantitative Analytics of the Basic Neomonetarist Model," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 27(4), pages 1241-1277, November.
    53. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2007. "Documentation of the Research and Statistics Division’s estimated DSGE model of the U.S. economy: 2006 version," Finance and Economics Discussion Series 2007-53, Board of Governors of the Federal Reserve System (U.S.).
    54. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
    55. Julio J. Rotemberg & Michael Woodford, 1997. "An Optimization-Based Econometric Framework for the Evaluation of Monetary Policy," NBER Chapters, in: NBER Macroeconomics Annual 1997, Volume 12, pages 297-361, National Bureau of Economic Research, Inc.
    56. Stephen Murchison & Andrew Rennison, 2006. "ToTEM: The Bank of Canada's New Quarterly Projection Model," Technical Reports 97, Bank of Canada.
    57. Edge, Rochelle M. & Kiley, Michael T. & Laforte, Jean-Philippe, 2008. "Natural rate measures in an estimated DSGE model of the U.S. economy," Journal of Economic Dynamics and Control, Elsevier, vol. 32(8), pages 2512-2535, August.
    58. Fuhrer, Jeffrey C, 1997. "Inflation/Output Variance Trade-Offs and Optimal Monetary Policy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 29(2), pages 214-234, May.
    59. G. Elliott & C. Granger & A. Timmermann (ed.), 2013. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 2, number 2.
    60. Rochelle M. Edge & Refet S. Gurkaynak, 2010. "How Useful Are Estimated DSGE Model Forecasts for Central Bankers?," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 41(2 (Fall)), pages 209-259.
    61. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    62. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    63. Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1999. "Multivariate Density Forecast Evaluation And Calibration In Financial Risk Management: High-Frequency Returns On Foreign Exchange," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 661-673, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Volker Wieland & Maik Wolters, 2011. "The diversity of forecasts from macroeconomic models of the US economy," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 47(2), pages 247-292, June.
    2. Wieland, Volker & Wolters, Maik, 2013. "Forecasting and Policy Making," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 239-325, Elsevier.
    3. Bekiros Stelios & Paccagnini Alessia, 2015. "Estimating point and density forecasts for the US economy with a factor-augmented vector autoregressive DSGE model," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 19(2), pages 107-136, April.
    4. Bekiros, Stelios D. & Paccagnini, Alessia, 2014. "Bayesian forecasting with small and medium scale factor-augmented vector autoregressive DSGE models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 298-323.
    5. Negro, Marco Del & Schorfheide, Frank, 2013. "DSGE Model-Based Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 57-140, Elsevier.
    6. Chauvet, Marcelle & Potter, Simon, 2013. "Forecasting Output," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 141-194, Elsevier.
    7. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    8. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
    9. Henzel, Steffen R. & Mayr, Johannes, 2013. "The mechanics of VAR forecast pooling—A DSGE model based Monte Carlo study," The North American Journal of Economics and Finance, Elsevier, vol. 24(C), pages 1-24.
    10. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2010. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 720-754.
    11. Volker Wieland, 2012. "Model comparison and robustness: a proposal for policy analysis after the financial crisis," Chapters, in: Robert M. Solow & Jean-Philippe Touffut (ed.), What’s Right with Macroeconomics?, chapter 2, pages 33-67, Edward Elgar Publishing.
    12. Schmidt, Sebastian & Wieland, Volker, 2013. "The New Keynesian Approach to Dynamic General Equilibrium Modeling: Models, Methods and Macroeconomic Policy Evaluation," Handbook of Computable General Equilibrium Modeling, in: Peter B. Dixon & Dale Jorgenson (ed.), Handbook of Computable General Equilibrium Modeling, edition 1, volume 1, chapter 0, pages 1439-1512, Elsevier.
    13. Anders Warne & Günter Coenen & Kai Christoffel, 2017. "Marginalized Predictive Likelihood Comparisons of Linear Gaussian State‐Space Models with Applications to DSGE, DSGE‐VAR, and VAR Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(1), pages 103-119, January.
    14. Wieland, Volker & Binder, Michael & Lieberknecht, Philipp & Quintana, Jorge, 2017. "Model Uncertainty in Macroeconomics: On the Implications of Financial Frictions," CEPR Discussion Papers 12013, C.E.P.R. Discussion Papers.
    15. Paccagnini, Alessia, 2017. "Dealing with Misspecification in DSGE Models: A Survey," MPRA Paper 82914, University Library of Munich, Germany.
    16. Kolasa, Marcin & Rubaszek, Michał, 2015. "Forecasting using DSGE models with financial frictions," International Journal of Forecasting, Elsevier, vol. 31(1), pages 1-19.
    17. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    18. Wieland, Volker & Cwik, Tobias & Müller, Gernot J. & Schmidt, Sebastian & Wolters, Maik, 2012. "A new comparative approach to macroeconomic modeling and policy analysis," Journal of Economic Behavior & Organization, Elsevier, vol. 83(3), pages 523-541.
    19. Alessia Paccagnini, 2012. "Comparing Hybrid DSGE Models," Working Papers 228, University of Milano-Bicocca, Department of Economics, revised Dec 2012.
    20. Cai, Michael & Del Negro, Marco & Giannoni, Marc P. & Gupta, Abhi & Li, Pearl & Moszkowski, Erica, 2019. "DSGE forecasts of the lost recovery," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1770-1789.

    More about this item

    Keywords

    DSGE models; Bayesian VAR; forecasting; model uncertainty; forecast combination; density forecasts; real-time data; Greenbook;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E31 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Price Level; Inflation; Deflation
    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:cauewp:201303. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/vakiede.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.