IDEAS home Printed from https://ideas.repec.org/p/ecb/ecbwps/20192291.html
   My bibliography  Save this paper

An analysis of the Eurosystem/ECB projections

Author

Listed:
  • Kontogeorgos, Georgios
  • Lambrias, Kyriacos

Abstract

The Eurosystem/ECB staff macroeconomic projection exercises constitute an important input to the ECB's monetary policy. This work marks a thorough analysis of the Eurosystem/ECB projection errors by looking at criteria of optimality and rationality using techniques widely employed in the applied literature of forecast evaluation. In general, the results are encouraging and suggest that Eurosystem/ECB staff projections abide to the main characteristics that constitute them reliable as a policy input. Projections of GDP - up to one year - and inflation are optimal - in the case of inflation they are also rational. A main finding is that GDP forecasts can be substantially improved, especially at long horizons. JEL Classification: C53, E37, E58

Suggested Citation

  • Kontogeorgos, Georgios & Lambrias, Kyriacos, 2019. "An analysis of the Eurosystem/ECB projections," Working Paper Series 2291, European Central Bank.
    • Handle: RePEc:ecb:ecbwps:20192291
    Note: 3570748
    as

    Download full text from publisher

    File URL: https://www.ecb.europa.eu//pub/pdf/scpwps/ecb.wp2291~6b06275781.en.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bontemps, Christian & Meddahi, Nour, 2005. "Testing normality: a GMM approach," Journal of Econometrics, Elsevier, vol. 124(1), pages 149-186, January.
    2. Lobato, Ignacio N. & Velasco, Carlos, 2004. "A Simple Test Of Normality For Time Series," Econometric Theory, Cambridge University Press, vol. 20(4), pages 671-689, August.
    3. Michael K Andersson & Ted Aranki & André Reslow, 2017. "Adjusting for information content when comparing forecast performance," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(7), pages 784-794, November.
    4. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    5. Zsolt Darvas, 2018. "Forecast errors and monetary policy normalisation in the euro area," Policy Contributions 28816, Bruegel.
    6. Massimiliano Marcellino, 2000. "Forecast Bias and MSFE Encompassing," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 62(4), pages 533-542, September.
    7. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    8. Whitney K. Newey & Kenneth D. West, 1994. "Automatic Lag Selection in Covariance Matrix Estimation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 61(4), pages 631-653.
    9. Andrew Patton & Allan Timmermann, 2012. "Forecast Rationality Tests Based on Multi-Horizon Bounds," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 1-17.
    10. El-Shagi, Makram & Giesen, Sebastian & Jung, Alexander, 2016. "Revisiting the relative forecast performances of Fed staff and private forecasters: A dynamic approach," International Journal of Forecasting, Elsevier, vol. 32(2), pages 313-323.
    11. Pesaran, M Hashem & Timmermann, Allan, 1992. "A Simple Nonparametric Test of Predictive Performance," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(4), pages 561-565, October.
    12. Fred Joutz & Michael P. Clements & Herman O. Stekler, 2007. "An evaluation of the forecasts of the federal reserve: a pooled approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(1), pages 121-136.
    13. Gavin, William T. & Mandal, Rachel J., 2003. "Evaluating FOMC forecasts," International Journal of Forecasting, Elsevier, vol. 19(4), pages 655-667.
    14. Kapetanios, George & Labhard, Vincent & Price, Simon, 2008. "Forecast combination and the Bank of England's suite of statistical forecasting models," Economic Modelling, Elsevier, vol. 25(4), pages 772-792, July.
    15. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    16. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    17. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    18. Ager, P. & Kappler, M. & Osterloh, S., 2009. "The accuracy and efficiency of the Consensus Forecasts: A further application and extension of the pooled approach," International Journal of Forecasting, Elsevier, vol. 25(1), pages 167-181.
    19. Jushan Bai & Serena Ng, 2005. "Tests for Skewness, Kurtosis, and Normality for Time Series Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 49-60, January.
    20. Marcellino, Massimiliano, 2000. "Forecast Bias and MSFE Encompassing," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 62(4), pages 533-542, September.
    21. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    22. Ciccarelli, Matteo & Osbat, Chiara, 2017. "Low inflation in the euro area: Causes and consequences," Occasional Paper Series 181, European Central Bank.
    23. Groen, Jan J.J. & Kapetanios, George & Price, Simon, 2009. "A real time evaluation of Bank of England forecasts of inflation and growth," International Journal of Forecasting, Elsevier, vol. 25(1), pages 74-80.
    24. Lucia Alessi & Eric Ghysels & Luca Onorante & Richard Peach & Simon Potter, 2014. "Central Bank Macroeconomic Forecasting During the Global Financial Crisis: The European Central Bank and Federal Reserve Bank of New York Experiences," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(4), pages 483-500, October.
    25. Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
    26. Dimitris Politis & Halbert White, 2004. "Automatic Block-Length Selection for the Dependent Bootstrap," Econometric Reviews, Taylor & Francis Journals, vol. 23(1), pages 53-70.
    27. repec:zbw:bofrdp:2017_029 is not listed on IDEAS
    28. Peter Tulip & Stephanie Wallace, 2012. "Estimates of Uncertainty around the RBA's Forecasts," RBA Research Discussion Papers rdp2012-07, Reserve Bank of Australia.
    29. Pesaran, M. Hashem & Timmermann, Allan, 2009. "Testing Dependence Among Serially Correlated Multicategory Variables," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 325-337.
    30. Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-259, April.
    31. Raffaella Giacomini & Barbara Rossi, 2010. "Forecast comparisons in unstable environments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 595-620.
    32. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
    33. Blaskowitz, Oliver & Herwartz, Helmut, 2014. "Testing the value of directional forecasts in the presence of serial correlation," International Journal of Forecasting, Elsevier, vol. 30(1), pages 30-42.
    34. Todd E. Clark & Michael W. McCracken, 2017. "Tests of Predictive Ability for Vector Autoregressions Used for Conditional Forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(3), pages 533-553, April.
    35. Julien Champagne & Guillaume Poulin-Bellisle & Rodrigo Sekkel, 2018. "Evaluating the Bank of Canada Staff Economic Projections Using a New Database of Real-Time Data and Forecasts," Staff Working Papers 18-52, Bank of Canada.
    36. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    37. Harvey, David I. & Newbold, Paul, 2003. "The non-normality of some macroeconomic forecast errors," International Journal of Forecasting, Elsevier, vol. 19(4), pages 635-653.
    38. Lukas Vogel, 2007. "How do the OECD Growth Projections for the G7 Economies Perform?: A Post-Mortem," OECD Economics Department Working Papers 573, OECD Publishing.
    39. Faust, Jon & Wright, Jonathan H., 2008. "Efficient forecast tests for conditional policy forecasts," Journal of Econometrics, Elsevier, vol. 146(2), pages 293-303, October.
    40. McCracken, Michael W., 2007. "Asymptotics for out of sample tests of Granger causality," Journal of Econometrics, Elsevier, vol. 140(2), pages 719-752, October.
    41. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    42. David L. Reifschneider & Peter Tulip, 2007. "Gauging the uncertainty of the economic outlook from historical forecasting errors," Finance and Economics Discussion Series 2007-60, Board of Governors of the Federal Reserve System (U.S.).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Granziera, Eleonora & Jalasjoki, Pirkka & Paloviita, Maritta, 2021. "The bias and efficiency of the ECB inflation projections: a State dependent analysis," Research Discussion Papers 7/2021, Bank of Finland.
    2. Eleonora Granziera & Pirkka Jalasjoki & Maritta Paloviita, 2021. "The Bias and Efficiency of the ECB Inflation Projections: a State Dependent Analysis," Working Paper 2021/1, Norges Bank.
    3. Philipp Hartman & Frank Smets, 2018. "The European Central Bank’s Monetary Policy during Its First 20 Years," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 49(2 (Fall)), pages 1-146.
    4. Sinem Kandemir & Peter Tillmann, 2023. "Not all ECB meetings are created equal," MAGKS Papers on Economics 202312, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    5. Cour-Thimann, Philippine & Jung, Alexander, 2020. "Interest rate setting and communication at the ECB," Working Paper Series 2443, European Central Bank.
    6. Oinonen, Sami & Vilmi, Lauri, 2021. "Analysing euro area inflation outlook with the Phillips curve," BoF Economics Review 5/2021, Bank of Finland.
    7. Luigi Bonatti Roberto Tamborini & Roberto Tamborini, 2021. "Is High Inflation the New Challenge for Central Banks?," DEM Working Papers 2021/14, Department of Economics and Management.
    8. Granziera, Eleonora & Jalasjoki, Pirkka & Paloviita, Maritta, 2021. "The bias and efficiency of the ECB inflation projections: A state dependent analysis," Bank of Finland Research Discussion Papers 7/2021, Bank of Finland.
    9. Cour-Thimann, Philippine & Jung, Alexander, 2021. "Interest-rate setting and communication at the ECB in its first twenty years," European Journal of Political Economy, Elsevier, vol. 70(C).
    10. Darracq Pariès, Matthieu & Notarpietro, Alessandro & Kilponen, Juha & Papadopoulou, Niki & Zimic, Srečko & Aldama, Pierre & Langenus, Geert & Alvarez, Luis Julian & Lemoine, Matthieu & Angelini, Elena, 2021. "Review of macroeconomic modelling in the Eurosystem: current practices and scope for improvement," Occasional Paper Series 267, European Central Bank.
    11. repec:zbw:bofrdp:2021_007 is not listed on IDEAS

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. G. Kontogeorgos & K. Lambrias, 2022. "Evaluating the Eurosystem/ECB staff macroeconomic projections: The first 20 years," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(2), pages 213-229, March.
    2. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    3. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    4. Faust, Jon & Wright, Jonathan H., 2013. "Forecasting Inflation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 2-56, Elsevier.
    5. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    6. Ferrara, Laurent & Marcellino, Massimiliano & Mogliani, Matteo, 2015. "Macroeconomic forecasting during the Great Recession: The return of non-linearity?," International Journal of Forecasting, Elsevier, vol. 31(3), pages 664-679.
    7. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
    8. West, Kenneth D., 2006. "Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 3, pages 99-134, Elsevier.
    9. Firmin Doko Tchatoka & Qazi Haque, 2023. "On bootstrapping tests of equal forecast accuracy for nested models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1844-1864, November.
    10. Barbara Rossi & Atsushi Inoue, 2012. "Out-of-Sample Forecast Tests Robust to the Choice of Window Size," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 432-453, April.
    11. Todd E. Clark & Kenneth D. West, 2005. "Using Out-of-Sample Mean Squared Prediction Errors to Test the Martingale Difference," NBER Technical Working Papers 0305, National Bureau of Economic Research, Inc.
    12. Brooks, Chris & Burke, Simon P. & Stanescu, Silvia, 2016. "Finite sample weighting of recursive forecast errors," International Journal of Forecasting, Elsevier, vol. 32(2), pages 458-474.
    13. Pincheira, Pablo & Hardy, Nicolas, 2022. "Correlation Based Tests of Predictability," MPRA Paper 112014, University Library of Munich, Germany.
    14. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    15. Busetti, Fabio & Marcucci, Juri, 2013. "Comparing forecast accuracy: A Monte Carlo investigation," International Journal of Forecasting, Elsevier, vol. 29(1), pages 13-27.
    16. Daniel Borup & Jonas N. Eriksen & Mads M. Kjær & Martin Thyrsgaard, 2020. "Predicting bond return predictability," CREATES Research Papers 2020-09, Department of Economics and Business Economics, Aarhus University.
    17. Jörg Breitung & Malte Knüppel, 2021. "How far can we forecast? Statistical tests of the predictive content," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(4), pages 369-392, June.
    18. Pincheira, Pablo & Hardy, Nicolás & Muñoz, Felipe, 2021. ""Go wild for a while!": A new asymptotically Normal test for forecast evaluation in nested models," MPRA Paper 105368, University Library of Munich, Germany.
    19. Clark, Todd E. & West, Kenneth D., 2006. "Using out-of-sample mean squared prediction errors to test the martingale difference hypothesis," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 155-186.
    20. Daniel Borup & Martin Thyrsgaard, 2017. "Statistical tests for equal predictive ability across multiple forecasting methods," CREATES Research Papers 2017-19, Department of Economics and Business Economics, Aarhus University.

    More about this item

    Keywords

    Eurosystem/ECB forecasts; forecast errors; forecast evaluation;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecb:ecbwps:20192291. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Official Publications (email available below). General contact details of provider: https://edirc.repec.org/data/emieude.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.