IDEAS home Printed from https://ideas.repec.org/p/sef/csefwp/402.html
   My bibliography  Save this paper

Indeterminacy, Misspecification and Forecastability: Good Luck in Bad Policy?

Author

Abstract

A recent debate in the forecasting literature revolves around the inability of macroecono-metric models to improve on simple univariate predictors, since the onset of the so-called Great Moderation. This paper explores the consequences of equilibrium indeterminacy for quantitative forecasting through standard reduced form forecast models. Exploiting U.S. data on both the Great Moderation and the preceding era, we first present evidence that (i) higher (absolute) forecastability obtains in the former rather than the latter period for all models considered, and that (ii) the decline in volatility and persistence captured by a .nite-order VAR system across the two samples is not associated with inferior (absolute or relative) predictive accuracy. Then, using a small-scale New Keynesian monetary DSGE model as laboratory, we generate arti.cial datasets under either equilibrium regime and investigate numerically whether (relative) forecastability is improved in the presence of indeterminacy. It is argued that forecasting under indeterminacy with e.g. unrestricted VAR models entails misspecification issues that are generally more severe than those one typically faces under determinacy. Irrespective of the occurrence of non-fundamental (sunspot) noise, for certain values of the arbitrary parameters governing solution multiplicity, the pseudo out-of-sample VAR-based forecasts of in.ation and output growth can outperform simple univariate predictors. For other values of these parameters, by contrast, the opposite occurs. In general, it is not possible to establish a one-to-one relationship between indeterminacy and superior forecastability, even when sunspot shocks play no role in generating the data. Overall, our analysis points towards a 'good luck in bad policy' explanation of the (relative) higher forecastability of macroeconometric models prior to the Great Moderation period.

Suggested Citation

  • Luca Fanelli & Marco M. Sorge, 2015. "Indeterminacy, Misspecification and Forecastability: Good Luck in Bad Policy?," CSEF Working Papers 402, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
  • Handle: RePEc:sef:csefwp:402
    as

    Download full text from publisher

    File URL: http://www.csef.it/WP/wp402.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Orphanides, Athanasios & van Norden, Simon, 2005. "The Reliability of Inflation Forecasts Based on Output Gap Estimates in Real Time," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 583-601, June.
    2. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez & Thomas J. Sargent & Mark W. Watson, 2007. "ABCs (and Ds) of Understanding VARs," American Economic Review, American Economic Association, vol. 97(3), pages 1021-1026, June.
    3. Richard Clarida & Jordi Galí & Mark Gertler, 2000. "Monetary Policy Rules and Macroeconomic Stability: Evidence and Some Theory," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(1), pages 147-180.
    4. Luca Benati & Paolo Surico, 2008. "Evolving U.S. Monetary Policy and The Decline of Inflation Predictability," Journal of the European Economic Association, MIT Press, vol. 6(2-3), pages 634-646, 04-05.
    5. Thomas A. Lubik & Frank Schorfheide, 2004. "Testing for Indeterminacy: An Application to U.S. Monetary Policy," American Economic Review, American Economic Association, vol. 94(1), pages 190-217, March.
    6. Ivana Komunjer & Serena Ng, 2011. "Dynamic Identification of Dynamic Stochastic General Equilibrium Models," Econometrica, Econometric Society, vol. 79(6), pages 1995-2032, November.
    7. Marcin Kolasa & MichaŁ Rubaszek & PaweŁ SkrzypczyŃski, 2012. "Putting the New Keynesian DSGE Model to the Real-Time Forecasting Test," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 44(7), pages 1301-1324, October.
    8. Lucia Alessi & Matteo Barigozzi & Marco Capasso, 2011. "Non‐Fundamentalness in Structural Econometric Models: A Review," International Statistical Review, International Statistical Institute, vol. 79(1), pages 16-47, April.
    9. Thomas A. Lubik & Paolo Surico, 2010. "The Lucas critique and the stability of empirical models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 177-194.
    10. Antonello D'Agostino & Domenico Giannone & Paolo Surico, 2005. "(Un)Predictability and Macroeconomic Stability," Macroeconomics 0510024, University Library of Munich, Germany.
    11. Lubik, Thomas A. & Schorfheide, Frank, 2003. "Computing sunspot equilibria in linear rational expectations models," Journal of Economic Dynamics and Control, Elsevier, vol. 28(2), pages 273-285, November.
    12. Efrem Castelnuovo & Luca Fanelli, 2015. "Monetary Policy Indeterminacy and Identification Failures in the U.S.: Results from A Robust Test," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(6), pages 924-947, September.
    13. Ravenna, Federico, 2007. "Vector autoregressions and reduced form representations of DSGE models," Journal of Monetary Economics, Elsevier, vol. 54(7), pages 2048-2064, October.
    14. Ippei Fujiwara & Yasuo Hirose, 2014. "Indeterminacy and Forecastability," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 46(1), pages 243-251, February.
    15. Timothy Cogley & Thomas J. Sargent, 2005. "Drift and Volatilities: Monetary Policies and Outcomes in the Post WWII U.S," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(2), pages 262-302, April.
    16. Luca Benati & Paolo Surico, 2009. "VAR Analysis and the Great Moderation," American Economic Review, American Economic Association, vol. 99(4), pages 1636-1652, September.
    17. Fanelli, Luca, 2012. "Determinacy, indeterminacy and dynamic misspecification in linear rational expectations models," Journal of Econometrics, Elsevier, vol. 170(1), pages 153-163.
    18. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    19. Raffaella Giacomini, 2015. "Economic theory and forecasting: lessons from the literature," Econometrics Journal, Royal Economic Society, vol. 18(2), pages 22-41, June.
    20. Koop, Gary & Pesaran, M. Hashem & Potter, Simon M., 1996. "Impulse response analysis in nonlinear multivariate models," Journal of Econometrics, Elsevier, vol. 74(1), pages 119-147, September.
    21. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
    22. Beyer, Andreas & Farmer, Roger E.A., 2008. "What We Don'T Know About The Monetary Transmission Mechanism And Why We Don'T Know It," Macroeconomic Dynamics, Cambridge University Press, vol. 12(S1), pages 60-74, April.
    23. James H. Stock & Mark W. Watson, 2003. "Has the Business Cycle Changed and Why?," NBER Chapters, in: NBER Macroeconomics Annual 2002, Volume 17, pages 159-230, National Bureau of Economic Research, Inc.
    24. Fabio Canova & Luca Gambetti, 2010. "Do Expectations Matter? The Great Moderation Revisited," American Economic Journal: Macroeconomics, American Economic Association, vol. 2(3), pages 183-205, July.
    25. Mavroeidis, Sophocles, 2005. "Identification Issues in Forward-Looking Models Estimated by GMM, with an Application to the Phillips Curve," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 421-448, June.
    26. Giorgio E. Primiceri, 2005. "Time Varying Structural Vector Autoregressions and Monetary Policy," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(3), pages 821-852.
    27. Luca Gambetti & Evi Pappa & Fabio Canova, 2008. "The Structural Dynamics of U.S. Output and Inflation: What Explains the Changes?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 40(2-3), pages 369-388, March.
    28. Andreas Beyer & Roger E. A. Farmer, 2007. "Testing for Indeterminacy: An Application to U.S. Monetary Policy: Comment," American Economic Review, American Economic Association, vol. 97(1), pages 524-529, March.
    29. Fanelli, Luca & Paruolo, Paolo, 2010. "Speed of adjustment in cointegrated systems," Journal of Econometrics, Elsevier, vol. 158(1), pages 130-141, September.
    30. Michael Wickens, 2014. "How Useful are DSGE Macroeconomic Models for Forecasting?," Open Economies Review, Springer, vol. 25(1), pages 171-193, February.
    31. Peter Tulip, 2009. "Has the Economy Become More Predictable? Changes in Greenbook Forecast Accuracy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(6), pages 1217-1231, September.
    32. Rossi, Barbara & Gürkaynak, Refet & Kısacıkoğlu, Burçin, 2013. "Do DSGE Models Forecast More Accurately Out-of-Sample than VAR Models?," CEPR Discussion Papers 9576, C.E.P.R. Discussion Papers.
    33. Sorge, Marco M., 2012. "News shocks or parametric indeterminacy? An observational equivalence result in linear rational expectations models," Economics Letters, Elsevier, vol. 114(2), pages 198-200.
    34. Jean Boivin & Marc P. Giannoni, 2006. "Has Monetary Policy Become More Effective?," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 445-462, August.
    35. Unknown, 2005. "Forward," 2005 Conference: Slovenia in the EU - Challenges for Agriculture, Food Science and Rural Affairs, November 10-11, 2005, Moravske Toplice, Slovenia 183804, Slovenian Association of Agricultural Economists (DAES).
    36. Binder,M. & Pesaran,H.M., 1995. "Multivariate Rational Expectations Models and Macroeconomic Modelling: A Review and Some New Results," Cambridge Working Papers in Economics 9415, Faculty of Economics, University of Cambridge.
    37. Sophocles Mavroeidis, 2010. "Monetary Policy Rules and Macroeconomic Stability: Some New Evidence," American Economic Review, American Economic Association, vol. 100(1), pages 491-503, March.
    38. Rochelle M. Edge & Refet S. Gurkaynak, 2010. "How Useful Are Estimated DSGE Model Forecasts for Central Bankers?," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 41(2 (Fall)), pages 209-259.
    39. Laurence Broze & Ariane Szafarz, 1991. "The Econometric Analysis of Non-Uniqueness in Rational Expectations Models," ULB Institutional Repository 2013/649, ULB -- Universite Libre de Bruxelles.
    40. Andrew Atkeson & Lee E. Ohanian, 2001. "Are Phillips curves useful for forecasting inflation?," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 25(Win), pages 2-11.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fanelli, Luca & Sorge, Marco M., 2017. "Indeterminate forecast accuracy under indeterminacy," Journal of Macroeconomics, Elsevier, vol. 53(C), pages 57-70.
    2. Fanelli, Luca, 2012. "Determinacy, indeterminacy and dynamic misspecification in linear rational expectations models," Journal of Econometrics, Elsevier, vol. 170(1), pages 153-163.
    3. Qazi Haque, 2022. "Monetary Policy, Inflation Target, and the Great Moderation: An Empirical Investigation," International Journal of Central Banking, International Journal of Central Banking, vol. 18(4), pages 1-52, October.
    4. Qazi Haque, 2017. "Monetary Policy, Target Inflation and the Great Moderation: An Empirical Investigation," School of Economics and Public Policy Working Papers 2017-10, University of Adelaide, School of Economics and Public Policy.
    5. Fabio Canova & Luca Gambetti, 2010. "Do Expectations Matter? The Great Moderation Revisited," American Economic Journal: Macroeconomics, American Economic Association, vol. 2(3), pages 183-205, July.
    6. Stelios Bekiros & Alessia Paccagnini, 2013. "On the predictability of time-varying VAR and DSGE models," Empirical Economics, Springer, vol. 45(1), pages 635-664, August.
    7. Angelini, Giovanni & Sorge, Marco M., 2021. "Under the same (Chole)sky: DNK models, timing restrictions and recursive identification of monetary policy shocks," Journal of Economic Dynamics and Control, Elsevier, vol. 133(C).
    8. Ippei Fujiwara & Yasuo Hirose, 2014. "Indeterminacy and Forecastability," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 46(1), pages 243-251, February.
    9. Guido Ascari & Paolo Bonomolo Hedibert F. Lopes, 2016. "Rational Sunspots," Economics Series Working Papers 787, University of Oxford, Department of Economics.
    10. Thomas A. Lubik & Paolo Surico, 2010. "The Lucas critique and the stability of empirical models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 177-194, January.
    11. Marco M. Sorge, 2013. "On the Fundamentalness of Nonfundamentalness in DSGE Models," CSEF Working Papers 340, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
    12. Giovanni Angelini & Luca Fanelli, 2016. "Misspecification and Expectations Correction in New Keynesian DSGE Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 78(5), pages 623-649, October.
    13. Canova, Fabio & Gambetti, Luca, 2009. "Structural changes in the US economy: Is there a role for monetary policy?," Journal of Economic Dynamics and Control, Elsevier, vol. 33(2), pages 477-490, February.
    14. repec:zbw:bofrdp:2008_020 is not listed on IDEAS
    15. Gunnar Bårdsen & Luca Fanelli, 2015. "Frequentist Evaluation of Small DSGE Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 307-322, July.
    16. Grydaki, Maria & Bezemer, Dirk, 2013. "The role of credit in the Great Moderation: A multivariate GARCH approach," Journal of Banking & Finance, Elsevier, vol. 37(11), pages 4615-4626.
    17. Castelnuovo, Efrem, 2013. "Monetary policy shocks and financial conditions: A Monte Carlo experiment," Journal of International Money and Finance, Elsevier, vol. 32(C), pages 282-303.
    18. Aymeric Ortmans, 2020. "Evolving Monetary Policy in the Aftermath of the Great Recession," Documents de recherche 20-01, Centre d'Études des Politiques Économiques (EPEE), Université d'Evry Val d'Essonne.
    19. Castelnuovo, Efrem & Greco, Luciano & Raggi, Davide, 2008. "Estimating regime-switching Taylor rules with trend inflation," Research Discussion Papers 20/2008, Bank of Finland.
    20. Ko, Jun-Hyung & Murase, Koichi, 2013. "Great Moderation in the Japanese economy," Japan and the World Economy, Elsevier, vol. 27(C), pages 10-24.
    21. Luca Benati & Paolo Surico, 2009. "VAR Analysis and the Great Moderation," American Economic Review, American Economic Association, vol. 99(4), pages 1636-1652, September.

    More about this item

    Keywords

    DSGE; Forecasting; Indeterminacy; Misspecification; VAR system;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C62 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Existence and Stability Conditions of Equilibrium
    • E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sef:csefwp:402. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dr. Maria Carannante (email available below). General contact details of provider: https://edirc.repec.org/data/cssalit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.