IDEAS home Printed from https://ideas.repec.org/p/ecb/ecbwps/20141635.html
   My bibliography  Save this paper

Does the federal reserve staff still beat private forecasters?

Author

Listed:
  • Jung, Alexander
  • El-Shagi, Makram
  • Giesen, Sebastian

Abstract

The aim of this paper is to assess whether the findings of Romer and Romer (2000) on the superiority of staff forecasts are still valid today. The paper uses both latest available econometric techniques as well as conventional tests. Several tests for forecast rationality show that a necessary condition for good forecast performance is satisfied both for Greenbook and private forecasts, as measured by the Survey of Professional Forecasters (SPF). Tests for forecast accuracy and the encompassing test confirm the superiority of Greenbook forecasts for inflation and output using an extended sample (1968 to 2006). The relative forecast performance is, however, not robust in the presence of large macroeconomic shocks such as the Great Moderation and oil price shocks. Other econometric tests show that a relative better forecast performance by staff is observed when there is increased uncertainty. Staff JEL Classification: C53, E37, E52, E58

Suggested Citation

  • Jung, Alexander & El-Shagi, Makram & Giesen, Sebastian, 2014. "Does the federal reserve staff still beat private forecasters?," Working Paper Series 1635, European Central Bank.
    • Handle: RePEc:ecb:ecbwps:20141635
    Note: 2106626
    as

    Download full text from publisher

    File URL: https://www.ecb.europa.eu//pub/pdf/scpwps/ecbwp1635.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Evans, Martin D D & Lewis, Karen K, 1995. "Do Expected Shifts in Inflation Affect Estimates of the Long-Run Fisher Relation?," Journal of Finance, American Finance Association, vol. 50(1), pages 225-253, March.
    2. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    3. Rossi, Barbara, 2005. "Optimal Tests For Nested Model Selection With Underlying Parameter Instability," Econometric Theory, Cambridge University Press, vol. 21(5), pages 962-990, October.
    4. Jeffrey A. Frankel & Jesse Schreger, 2012. "Over-optimistic Official Forecasts in the Eurozone and Fiscal Rules," NBER Working Papers 18283, National Bureau of Economic Research, Inc.
    5. A. Jung, 2013. "Policymakers’ Interest Rate Preferences: Recent Evidence for Three Monetary Policy Committees," International Journal of Central Banking, International Journal of Central Banking, vol. 9(3), pages 150-197, September.
    6. Peek, Joe & Rosengren, Eric S. & Tootell, Geoffrey M. B., 2003. "Does the federal reserve possess an exploitable informational advantage?," Journal of Monetary Economics, Elsevier, vol. 50(4), pages 817-839, May.
    7. Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
    8. Andrews, Donald W. K. & Lee, Inpyo & Ploberger, Werner, 1996. "Optimal changepoint tests for normal linear regression," Journal of Econometrics, Elsevier, vol. 70(1), pages 9-38, January.
    9. Antonello D'Agostino & Karl Whelan, 2008. "Federal Reserve Information During the Great Moderation," Journal of the European Economic Association, MIT Press, vol. 6(2-3), pages 609-620, 04-05.
    10. Glenn D. Rudebusch & John C. Williams, 2008. "Revealing the Secrets of the Temple: The Value of Publishing Central Bank Interest Rate Projections," NBER Chapters, in: Asset Prices and Monetary Policy, pages 247-289, National Bureau of Economic Research, Inc.
    11. Philippe Moutot & Alexander Jung & Francesco Paolo Mongelli, 2008. "The working of the eurosystem - monetary policy preparations and decision-making – selected issues," Occasional Paper Series 79, European Central Bank.
    12. Marvin Goodfriend, 1997. "Monetary policy comes of age: a 20th century odyssey," Economic Quarterly, Federal Reserve Bank of Richmond, issue Win, pages 1-22.
    13. Peter Tulip, 2009. "Has the Economy Become More Predictable? Changes in Greenbook Forecast Accuracy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(6), pages 1217-1231, September.
    14. Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-735, September.
    15. Alesina, Alberto & Summers, Lawrence H, 1993. "Central Bank Independence and Macroeconomic Performance: Some Comparative Evidence," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 25(2), pages 151-162, May.
    16. Tillmann, Peter, 2011. "Strategic forecasting on the FOMC," European Journal of Political Economy, Elsevier, vol. 27(3), pages 547-553, September.
    17. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    18. Holden, K & Peel, D A, 1990. "On Testing for Unbiasedness and Efficiency of Forecasts," The Manchester School of Economic & Social Studies, University of Manchester, vol. 58(2), pages 120-127, June.
    19. Kenny, Geoff & Morgan, Julian, 2011. "Some lessons from the financial crisis for the economic analysis," Occasional Paper Series 130, European Central Bank.
    20. Christina D. Romer & David H. Romer, 2008. "The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?," American Economic Review, American Economic Association, vol. 98(2), pages 230-235, May.
    21. Barbara Rossi & Tatevik Sekhposyan, 2011. "Forecast Optimality Tests in the Presence of Instabilities," Working Papers 11-18, Duke University, Department of Economics.
    22. Swanson, Eric T., 2006. "Have Increases in Federal Reserve Transparency Improved Private Sector Interest Rate Forecasts?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(3), pages 791-819, April.
    23. Raffaella Giacomini & Barbara Rossi, 2010. "Forecast comparisons in unstable environments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 595-620.
    24. El-Shagi, Makram, 2011. "Inflation expectations: Does the market beat econometric forecasts?," The North American Journal of Economics and Finance, Elsevier, vol. 22(3), pages 298-319.
    25. Gamber, Edward N. & Smith, Julie K., 2009. "Are the Fed's inflation forecasts still superior to the private sector's?," Journal of Macroeconomics, Elsevier, vol. 31(2), pages 240-251, June.
    26. Campbell, John Y. (ed.), 2008. "Asset Prices and Monetary Policy," National Bureau of Economic Research Books, University of Chicago Press, number 9780226092119.
    27. Ildeberta Abreu, 2011. "International organisations’ vs. private analysts’ forecasts: an evaluation," Working Papers w201120, Banco de Portugal, Economics and Research Department.
    28. Michael W. McCracken, 2010. "Disagreement at the FOMC: the dissenting votes are just part of the story," The Regional Economist, Federal Reserve Bank of St. Louis, issue Oct, pages 10-16.
    29. Kenny, Geoff & Morgan, Julian, 2011. "Some lessons from the financial crisis for the economic analysis," Occasional Paper Series 130, European Central Bank.
    30. David L. Reifschneider & Peter Tulip, 2007. "Gauging the uncertainty of the economic outlook from historical forecasting errors," Finance and Economics Discussion Series 2007-60, Board of Governors of the Federal Reserve System (U.S.).
    31. David R. Johnson, 1997. "Expected Inflation in Canada 1988-1995: An Evaluation of Bank of Canada Credibility and the Effect of Inflation Targets," Canadian Public Policy, University of Toronto Press, vol. 23(3), pages 233-258, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pao‐Lin Tien & Tara M. Sinclair & Edward N. Gamber, 2021. "Do Fed Forecast Errors Matter?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(3), pages 686-712, June.
    2. Richhild Moessner & David-Jan Jansen & Jakob de Haan, 2017. "Communication About Future Policy Rates In Theory And Practice: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 31(3), pages 678-711, July.
    3. Ana Cristina Pereira Das Neves, 2018. "The Mass Media Transmission Of Central Bank Communication Under Uncertainty," Anais do XLIV Encontro Nacional de Economia [Proceedings of the 44th Brazilian Economics Meeting] 54, ANPEC - Associação Nacional dos Centros de Pós-Graduação em Economia [Brazilian Association of Graduate Programs in Economics].
    4. Thomas L. Hogan, 2022. "The calculus of dissent: Bias and diversity in FOMC projections," Public Choice, Springer, vol. 191(1), pages 105-135, April.
    5. Sylvester Eijffinger & Ronald Mahieu & Louis Raes, 2017. "Can the Fed Talk the Hind Legs Off the Stock Market?," International Journal of Central Banking, International Journal of Central Banking, vol. 13(1), pages 53-94, February.
    6. Michelle L. Barnes & Giovanni P. Olivei, 2017. "Financial variables and macroeconomic forecast errors," Working Papers 17-17, Federal Reserve Bank of Boston.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. El-Shagi, Makram & Giesen, Sebastian & Jung, Alexander, 2012. "Does Central Bank Staff Beat Private Forecasters?," IWH Discussion Papers 5/2012, Halle Institute for Economic Research (IWH).
    2. El-Shagi, Makram & Giesen, Sebastian & Jung, Alexander, 2016. "Revisiting the relative forecast performances of Fed staff and private forecasters: A dynamic approach," International Journal of Forecasting, Elsevier, vol. 32(2), pages 313-323.
    3. Paul Hubert, 2015. "Revisiting the Greenbook’s relative forecasting performance," Revue de l'OFCE, Presses de Sciences-Po, vol. 0(1), pages 151-179.
    4. repec:hal:spmain:info:hdl:2441/35kgubh40v9gfpnuruelqjnptb is not listed on IDEAS
    5. repec:spo:wpmain:info:hdl:2441/35kgubh40v9gfpnuruelqjnptb is not listed on IDEAS
    6. repec:hal:spmain:info:hdl:2441/f4rshpf3v1umfa09lat09b1bg is not listed on IDEAS
    7. repec:spo:wpmain:info:hdl:2441/f4rshpf3v1umfa09lat09b1bg is not listed on IDEAS
    8. repec:spo:wpmain:info:hdl:2441/3pot7260lh88lrfhrhvs85lh2f is not listed on IDEAS
    9. repec:hal:spmain:info:hdl:2441/3pot7260lh88lrfhrhvs85lh2f is not listed on IDEAS
    10. repec:spo:wpecon:info:hdl:2441/f4rshpf3v1umfa09lat09b1bg is not listed on IDEAS
    11. repec:hal:wpspec:info:hdl:2441/f4rshpf3v1umfa09lat09b1bg is not listed on IDEAS
    12. Carola Conces Binder & Rodrigo Sekkel, 2024. "Central bank forecasting: A survey," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 342-364, April.
    13. Paul Hubert, 2010. "Monetary policy, imperfect information and the expectations channel [Politique monétaire,information imparfaite et canal des anticipations]," SciencePo Working papers Main tel-04095385, HAL.
    14. Paul Hubert, 2015. "Do Central Bank Forecasts Influence Private Agents? Forecasting Performance versus Signals," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 47(4), pages 771-789, June.
    15. Henning Fischer & Marta García-Bárzana & Peter Tillmann & Peter Winker, 2014. "Evaluating FOMC forecast ranges: an interval data approach," Empirical Economics, Springer, vol. 47(1), pages 365-388, August.
    16. Lillian R. Gaeto & Sandeep Mazumder, 2019. "Measuring the Accuracy of Federal Reserve Forecasts," Southern Economic Journal, John Wiley & Sons, vol. 85(3), pages 960-984, January.
    17. Matei Demetrescu & Christoph Hanck & Robinson Kruse‐Becher, 2022. "Robust inference under time‐varying volatility: A real‐time evaluation of professional forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 1010-1030, August.
    18. Pao‐Lin Tien & Tara M. Sinclair & Edward N. Gamber, 2021. "Do Fed Forecast Errors Matter?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(3), pages 686-712, June.
    19. Faust, Jon & Wright, Jonathan H., 2013. "Forecasting Inflation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 2-56, Elsevier.
    20. El-Shagi, Makram, 2011. "Inflation expectations: Does the market beat econometric forecasts?," The North American Journal of Economics and Finance, Elsevier, vol. 22(3), pages 298-319.
    21. Messina, Jeffrey D. & Sinclair, Tara M. & Stekler, Herman, 2015. "What can we learn from revisions to the Greenbook forecasts?," Journal of Macroeconomics, Elsevier, vol. 45(C), pages 54-62.
    22. Gamber, Edward N. & Liebner, Jeffrey P. & Smith, Julie K., 2015. "The distribution of inflation forecast errors," Journal of Policy Modeling, Elsevier, vol. 37(1), pages 47-64.
    23. Yoichi Tsuchiya, 2021. "The value added of the Bank of Japan's range forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(5), pages 817-833, August.
    24. repec:hal:spmain:info:hdl:2441/5221 is not listed on IDEAS
    25. Paul Hubert, 2015. "The Influence and Policy Signalling Role of FOMC Forecasts," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 77(5), pages 655-680, October.
    26. Fred Joutz & Michael P. Clements & Herman O. Stekler, 2007. "An evaluation of the forecasts of the federal reserve: a pooled approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(1), pages 121-136.
    27. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    28. Sinclair, Tara M. & Stekler, H.O. & Carnow, Warren, 2015. "Evaluating a vector of the Fed’s forecasts," International Journal of Forecasting, Elsevier, vol. 31(1), pages 157-164.
    29. Stekler, Herman & Symington, Hilary, 2016. "Evaluating qualitative forecasts: The FOMC minutes, 2006–2010," International Journal of Forecasting, Elsevier, vol. 32(2), pages 559-570.

    More about this item

    Keywords

    forecast performance; forecast rationality; forecast stability; greenbook forecasts; of professional forecasters; survey;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • E52 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Monetary Policy
    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecb:ecbwps:20141635. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Official Publications (email available below). General contact details of provider: https://edirc.repec.org/data/emieude.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.