IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/17906.html
   My bibliography  Save this paper

Posterior Predictive Analysis for Evaluating DSGE Models

Author

Listed:
  • Jon Faust
  • Abhishek Gupta

Abstract

While dynamic stochastic general equilibrium (DSGE) models for monetary policy analysis have come a long way, there is considerable difference of opinion over the role these models should play in the policy process. The paper develops three main points about assessing the value of these models. First, we document that DSGE models continue to have aspects of crude approximation and omission. This motivates the need for tools to reveal the strengths and weaknesses of the models--both to direct development efforts and to inform how best to use the current flawed models. Second, posterior predictive analysis provides a useful and economical tool for finding and communicating strengths and weaknesses. In particular, we adapt a form of discrepancy analysis as proposed by Gelman, et al. (1996). Third, we provide a nonstandard defense of posterior predictive analysis in the DSGE context against long-standing objections. We use the iconic Smets-Wouters model for illustrative purposes, showing a number of heretofore unrecognized properties that may be important from a policymaking perspective.

Suggested Citation

  • Jon Faust & Abhishek Gupta, 2012. "Posterior Predictive Analysis for Evaluating DSGE Models," NBER Working Papers 17906, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:17906
    Note: IFM ME
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w17906.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ricardo Reis & Vasco Curdia, 2009. "Correlated Disturbances and U.S. Business Cycles," 2009 Meeting Papers 129, Society for Economic Dynamics.
    2. Christopher D. Carroll & Jiri Slacalek & Martin Sommer, 2011. "International Evidence on Sticky Consumption Growth," The Review of Economics and Statistics, MIT Press, vol. 93(4), pages 1135-1145, November.
    3. Orazio P. Attanasio & Guglielmo Weber, 1993. "Consumption Growth, the Interest Rate and Aggregation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(3), pages 631-649.
    4. Harvey,Andrew C., 1991. "Forecasting, Structural Time Series Models and the Kalman Filter," Cambridge Books, Cambridge University Press, number 9780521405737, September.
    5. Del Negro, Marco & Schorfheide, Frank, 2008. "Forming priors for DSGE models (and how it affects the assessment of nominal rigidities)," Journal of Monetary Economics, Elsevier, vol. 55(7), pages 1191-1208, October.
    6. Del Negro, Marco & Schorfheide, Frank & Smets, Frank & Wouters, Rafael, 2007. "On the Fit of New Keynesian Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 123-143, April.
    7. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    8. Domenico Giannone & Lucrezia Reichlin & Luca Sala, 2005. "Monetary Policy in Real Time," NBER Chapters, in: NBER Macroeconomics Annual 2004, Volume 19, pages 161-224, National Bureau of Economic Research, Inc.
    9. Ben S. Bernanke & Jean Boivin & Piotr Eliasz, 2005. "Measuring the Effects of Monetary Policy: A Factor-Augmented Vector Autoregressive (FAVAR) Approach," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 120(1), pages 387-422.
    10. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    11. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    12. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    13. Karen E. Dynan, 2000. "Habit Formation in Consumer Preferences: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 90(3), pages 391-406, June.
    14. V. V. Chari & Patrick J. Kehoe & Ellen R. McGrattan, 2007. "Business Cycle Accounting," Econometrica, Econometric Society, vol. 75(3), pages 781-836, May.
    15. Faust, Jon & Gupta, Abhishek, 2010. "Posterior Predictive Analysis for Evaluating DSGE Models," MPRA Paper 26721, University Library of Munich, Germany.
    16. Ben S. Bernanke & Vincent R. Reinhart & Brian P. Sack, 2004. "Monetary Policy Alternatives at the Zero Bound: An Empirical Assessment," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 35(2), pages 1-100.
    17. Gilchrist, Simon & Yankov, Vladimir & Zakrajsek, Egon, 2009. "Credit market shocks and economic fluctuations: Evidence from corporate bond and stock markets," Journal of Monetary Economics, Elsevier, vol. 56(4), pages 471-493, May.
    18. John Geweke, 2010. "Complete and Incomplete Econometric Models," Economics Books, Princeton University Press, edition 1, number 9218.
    19. Wilcox, David W, 1992. "The Construction of U.S. Consumption Data: Some Facts and Their Implications for Empirical Work," American Economic Review, American Economic Association, vol. 82(4), pages 922-941, September.
    20. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    21. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    22. Gupta, Abhishek, 2010. "A Forecasting Metric for Evaluating DSGE Models for Policy Analysis," MPRA Paper 26718, University Library of Munich, Germany.
    23. Bernanke, Ben S. & Boivin, Jean, 2003. "Monetary policy in a data-rich environment," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 525-546, April.
    24. Mehra, Rajnish & Prescott, Edward C., 1985. "The equity premium: A puzzle," Journal of Monetary Economics, Elsevier, vol. 15(2), pages 145-161, March.
    25. Hansen, Bruce E., 2005. "Challenges For Econometric Model Selection," Econometric Theory, Cambridge University Press, vol. 21(1), pages 60-68, February.
    26. Kydland, Finn E & Prescott, Edward C, 1982. "Time to Build and Aggregate Fluctuations," Econometrica, Econometric Society, vol. 50(6), pages 1345-1370, November.
    27. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    28. John Geweke, 2007. "Bayesian Model Comparison and Validation," American Economic Review, American Economic Association, vol. 97(2), pages 60-64, May.
    29. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michal Andrle & Jan Bruha & Serhat Solmaz, 2016. "On the Sources of Business Cycles: Implications for DSGE Models," Working Papers 2016/03, Czech National Bank.
    2. Faust, Jon & Gupta, Abhishek, 2010. "Posterior Predictive Analysis for Evaluating DSGE Models," MPRA Paper 26721, University Library of Munich, Germany.
    3. Mumtaz, Haroon & Theodoridis, Konstantinos, 2020. "Fiscal policy shocks and stock prices in the United States," European Economic Review, Elsevier, vol. 129(C).
    4. Suh, Hyunduk & Walker, Todd B., 2016. "Taking financial frictions to the data," Journal of Economic Dynamics and Control, Elsevier, vol. 64(C), pages 39-65.
    5. Fabio Canova & Filippo Ferroni & Christian Matthes, 2014. "Choosing The Variables To Estimate Singular Dsge Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(7), pages 1099-1117, November.
    6. Raffaella Giacomini, 2015. "Economic theory and forecasting: lessons from the literature," Econometrics Journal, Royal Economic Society, vol. 18(2), pages 22-41, June.
    7. Brede, Maren, 2018. "Real exchange rate dynamics in New-Keynesian models – The Balassa-Samuelson effect revisited," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181539, Verein für Socialpolitik / German Economic Association.
    8. Abhishek Gupta, 2016. "A Forecasting Metric for Evaluating DSGE Models for Policy Analysis," International Journal of Central Banking, International Journal of Central Banking, vol. 12(1), pages 33-65, March.
    9. Alexander W. Richter & Nathaniel A. Throckmorton, 2016. "Are nonlinear methods necessary at the zero lower bound?," Working Papers 1606, Federal Reserve Bank of Dallas.
    10. Eric M. Leeper & Nora Traum & Todd B. Walker, 2017. "Clearing Up the Fiscal Multiplier Morass," American Economic Review, American Economic Association, vol. 107(8), pages 2409-2454, August.
    11. Gelain, Paolo & Manganelli, Simone, 2020. "Monetary policy with judgment," Working Paper Series 2404, European Central Bank.
    12. Raffaella Giacomini, 2014. "Economic theory and forecasting: lessons from the literature," CeMMAP working papers 41/14, Institute for Fiscal Studies.
    13. KANO, Takashi, 2023. "Posterior Inferences on Incomplete Structural Models : The Minimal Econometric Interpretation," Discussion paper series HIAS-E-128, Hitotsubashi Institute for Advanced Study, Hitotsubashi University.
    14. Sylvain Leduc & Zheng Liu, 2020. "The Weak Job Recovery in a Macro Model of Search and Recruiting Intensity," American Economic Journal: Macroeconomics, American Economic Association, vol. 12(1), pages 310-343, January.
    15. Negro, Marco Del & Schorfheide, Frank, 2013. "DSGE Model-Based Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 57-140, Elsevier.
    16. Gupta, Abhishek, 2010. "A Forecasting Metric for Evaluating DSGE Models for Policy Analysis," MPRA Paper 26718, University Library of Munich, Germany.
    17. Eric M. Leeper & Nora Traum & Todd B. Walker, 2015. "Clearing Up the Fiscal Multiplier Morass: Prior and Posterior Analysis," NBER Working Papers 21433, National Bureau of Economic Research, Inc.
    18. Jon Faust, 2012. "DSGE Models: I Smell a Rat (and It Smells Good)," International Journal of Central Banking, International Journal of Central Banking, vol. 8(1), pages 53-64, March.
    19. Michal Andrle & Mr. Jaromir Benes, 2013. "System Priors: Formulating Priors about DSGE Models' Properties," IMF Working Papers 2013/257, International Monetary Fund.
    20. Rieth, Malte, 2017. "Capital taxation and government debt policy with public discounting," Journal of Economic Dynamics and Control, Elsevier, vol. 85(C), pages 1-20.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stijn Claessens & M Ayhan Kose, 2018. "Frontiers of macrofinancial linkages," BIS Papers, Bank for International Settlements, number 95.
    2. Marc P. Giannoni & Jean Boivin, 2005. "DSGE Models in a Data-Rich Environment," Computing in Economics and Finance 2005 431, Society for Computational Economics.
    3. Pablo A. Guerrón-Quintana & James M. Nason, 2013. "Bayesian estimation of DSGE models," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 21, pages 486-512, Edward Elgar Publishing.
    4. Bekiros Stelios & Paccagnini Alessia, 2015. "Estimating point and density forecasts for the US economy with a factor-augmented vector autoregressive DSGE model," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 19(2), pages 107-136, April.
    5. Bekiros, Stelios D. & Paccagnini, Alessia, 2014. "Bayesian forecasting with small and medium scale factor-augmented vector autoregressive DSGE models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 298-323.
    6. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2014. "On the Rise of Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 14-085/III, Tinbergen Institute, revised 04 Sep 2014.
    7. Marco Del Negro & Frank Schorfheide, 2009. "Monetary Policy Analysis with Potentially Misspecified Models," American Economic Review, American Economic Association, vol. 99(4), pages 1415-1450, September.
    8. Inoue, Atsushi & Kuo, Chun-Hung & Rossi, Barbara, 2020. "Identifying the sources of model misspecification," Journal of Monetary Economics, Elsevier, vol. 110(C), pages 1-18.
    9. Ramey, V.A., 2016. "Macroeconomic Shocks and Their Propagation," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 71-162, Elsevier.
    10. Özer Karagedikli & Troy Matheson & Christie Smith & Shaun P. Vahey, 2010. "RBCs AND DSGEs: THE COMPUTATIONAL APPROACH TO BUSINESS CYCLE THEORY AND EVIDENCE," Journal of Economic Surveys, Wiley Blackwell, vol. 24(1), pages 113-136, February.
    11. Havranek, Tomas & Rusnak, Marek & Sokolova, Anna, 2017. "Habit formation in consumption: A meta-analysis," European Economic Review, Elsevier, vol. 95(C), pages 142-167.
    12. Andrea Ajello, 2016. "Financial Intermediation, Investment Dynamics, and Business Cycle Fluctuations," American Economic Review, American Economic Association, vol. 106(8), pages 2256-2303, August.
    13. Consolo, Agostino & Favero, Carlo A. & Paccagnini, Alessia, 2009. "On the statistical identification of DSGE models," Journal of Econometrics, Elsevier, vol. 150(1), pages 99-115, May.
    14. Negro, Marco Del & Schorfheide, Frank, 2013. "DSGE Model-Based Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 57-140, Elsevier.
    15. Yongsung Chang & Sun-Bin Kim & Frank Schorfheide, 2010. "Labor-Market Heterogeneity, Aggregation, and the Lucas Critique," RCER Working Papers 556, University of Rochester - Center for Economic Research (RCER).
    16. Matthieu Darracq Paries, 2018. "Financial frictions and monetary policy conduct," Erudite Ph.D Dissertations, Erudite, number ph18-01 edited by Ferhat Mihoubi.
    17. Herbst, Edward & Schorfheide, Frank, 2012. "Evaluating DSGE model forecasts of comovements," Journal of Econometrics, Elsevier, vol. 171(2), pages 152-166.
    18. Stelios D. Bekiros & Alessia Paccagnini, 2016. "Policy‐Oriented Macroeconomic Forecasting with Hybrid DGSE and Time‐Varying Parameter VAR Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 35(7), pages 613-632, November.
    19. Iiboshi, Hirokuni & Matsumae, Tatsuyoshi & Namba, Ryoichi & Nishiyama, Shin-Ichi, 2015. "Estimating a DSGE model for Japan in a data-rich environment," Journal of the Japanese and International Economies, Elsevier, vol. 36(C), pages 25-55.
    20. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.

    More about this item

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • E1 - Macroeconomics and Monetary Economics - - General Aggregative Models
    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:17906. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.