IDEAS home Printed from https://ideas.repec.org/p/ecb/ecbwps/20101277.html
   My bibliography  Save this paper

Combining the forecasts in the ECB survey of professional forecasters: can anything beat the simple average?

Author

Listed:
  • Kenny, Geoff
  • Genre, Véronique
  • Meyler, Aidan
  • Timmermann, Allan

Abstract

In this paper, we explore the potential gains from alternative combinations of the surveyed forecasts in the ECB Survey of Professional Forecasters. Our analysis encompasses a variety of methods including statistical combinations based on principal components analysis and trimmed means, performance-based weighting, least squares estimates of optimal weights as well as Bayesian shrinkage. We provide a pseudo real-time out-of-sample performance evaluation of these alternative combinations and check the sensitivity of the results to possible data-snooping bias. The latter robustness check is also informed using a novel real time meta selection procedure which is not subject to the data-snooping critique. For GDP growth and the unemployment rate, only few of the forecast combination schemes are able to outperform the simple equal-weighted average forecast. Conversely, for the inflation rate there is stronger evidence that more refined combinations can lead to improvement over this benchmark. In particular, for this variable, the relative improvement appears significant even controlling for data snooping bias. JEL Classification: C22, C53

Suggested Citation

  • Kenny, Geoff & Genre, Véronique & Meyler, Aidan & Timmermann, Allan, 2010. "Combining the forecasts in the ECB survey of professional forecasters: can anything beat the simple average?," Working Paper Series 1277, European Central Bank.
    • Handle: RePEc:ecb:ecbwps:20101277
    Note: 339061
    as

    Download full text from publisher

    File URL: https://www.ecb.europa.eu//pub/pdf/scpwps/ecbwp1277.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Domenico Giannone & Jérôme Henry & Magdalena Lalik & Michele Modugno, 2012. "An Area-Wide Real-Time Database for the Euro Area," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1000-1013, November.
    2. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    3. Giannone, Domenico & Lenza, Michele & Momferatou, Daphne & Onorante, Luca, 2014. "Short-term inflation projections: A Bayesian vector autoregressive approach," International Journal of Forecasting, Elsevier, vol. 30(3), pages 635-644.
    4. Granger, C. W. J. & Newbold, Paul, 1986. "Forecasting Economic Time Series," Elsevier Monographs, Elsevier, edition 2, number 9780122951831 edited by Shell, Karl.
    5. Diebold, Francis X. & Pauly, Peter, 1990. "The use of prior information in forecast combination," International Journal of Forecasting, Elsevier, vol. 6(4), pages 503-508, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Oinonen, Sami & Paloviita, Maritta, 2014. "Analysis of aggregated inflation expectations based on the ECB SPF survey," Research Discussion Papers 29/2014, Bank of Finland.
    2. repec:zbw:bofrdp:2014_029 is not listed on IDEAS
    3. Conflitti, Cristina & De Mol, Christine & Giannone, Domenico, 2015. "Optimal combination of survey forecasts," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1096-1103.
    4. Driver, Ciaran & Trapani, Lorenzo & Urga, Giovanni, 2013. "On the use of cross-sectional measures of forecast uncertainty," International Journal of Forecasting, Elsevier, vol. 29(3), pages 367-377.
    5. Lahiri, Kajal & Peng, Huaming & Zhao, Yongchen, 2015. "Testing the value of probability forecasts for calibrated combining," International Journal of Forecasting, Elsevier, vol. 31(1), pages 113-129.
    6. Kirstin Hubrich & Frauke Skudelny, 2017. "Forecast Combination for Euro Area Inflation: A Cure in Times of Crisis?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(5), pages 515-540, August.
    7. El-Shagi, Makram & Giesen, Sebastian & Jung, Alexander, 2012. "Does Central Bank Staff Beat Private Forecasters?," IWH Discussion Papers 5/2012, Halle Institute for Economic Research (IWH).
    8. Öğünç, Fethi & Akdoğan, Kurmaş & Başer, Selen & Chadwick, Meltem Gülenay & Ertuğ, Dilara & Hülagü, Timur & Kösem, Sevim & Özmen, Mustafa Utku & Tekatlı, Necati, 2013. "Short-term inflation forecasting models for Turkey and a forecast combination analysis," Economic Modelling, Elsevier, vol. 33(C), pages 312-325.
    9. Gianni Amisano & Andreas Beyer & Michele Lenza, 2010. "Enhancing monetary analysis," Research Bulletin, European Central Bank, vol. 11, pages 2-6.
    10. Clements, Michael P, 2012. "Subjective and Ex Post Forecast Uncertainty : US Inflation and Output Growth," The Warwick Economics Research Paper Series (TWERPS) 995, University of Warwick, Department of Economics.
    11. Geoff Kenny & Thomas Kostka & Federico Masera, 2015. "Can Macroeconomists Forecast Risk? Event-Based Evidence from the Euro-Area SPF," International Journal of Central Banking, International Journal of Central Banking, vol. 11(4), pages 1-46, December.
    12. Gary Koop & Luca Onorante, 2011. "Estimating Phillips Curves in Turbulent Times using the ECBs Survey of Professional Forecasters," Working Papers 1109, University of Strathclyde Business School, Department of Economics.
    13. Martin Scheicher, 2010. "“Return-free risk”? Market pricing in credit risk markets," Research Bulletin, European Central Bank, vol. 11, pages 7-8.
    14. Luis E. Rojas, 2011. "Professional Forecasters: How to Understand and Exploit Them Through a DSGE Model," Borradores de Economia 8945, Banco de la Republica.
    15. Schnatz, Bernd & D'Agostino, Antonello, 2012. "Survey-based nowcasting of US growth: a real-time forecast comparison over more than 40 years," Working Paper Series 1455, European Central Bank.
    16. Xiaojie Xu, 2020. "Corn Cash Price Forecasting," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(4), pages 1297-1320, August.
    17. Genre, Véronique & Kenny, Geoff & Meyler, Aidan & Timmermann, Allan, 2013. "Combining expert forecasts: Can anything beat the simple average?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 108-121.
    18. Geoff Kenny, 2010. "Macroeconomic forecasting: can forecast combination help?," Research Bulletin, European Central Bank, vol. 11, pages 9-12.
    19. Oinonen, Sami & Paloviita, Maritta, 2014. "Analysis of aggregated inflation expectations based on the ECB SPF survey," Bank of Finland Research Discussion Papers 29/2014, Bank of Finland.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Genre, Véronique & Kenny, Geoff & Meyler, Aidan & Timmermann, Allan, 2013. "Combining expert forecasts: Can anything beat the simple average?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 108-121.
    2. Marek Jarociński & Michele Lenza, 2018. "An Inflation‐Predicting Measure of the Output Gap in the Euro Area," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 50(6), pages 1189-1224, September.
    3. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    4. Degiannakis, Stavros & Filis, George, 2023. "Oil price assumptions for macroeconomic policy," Energy Economics, Elsevier, vol. 117(C).
    5. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    6. Busetti, Fabio & Marcucci, Juri, 2013. "Comparing forecast accuracy: A Monte Carlo investigation," International Journal of Forecasting, Elsevier, vol. 29(1), pages 13-27.
    7. Gloria González-Rivera & Tae-Hwy Lee, 2007. "Nonlinear Time Series in Financial Forecasting," Working Papers 200803, University of California at Riverside, Department of Economics, revised Feb 2008.
    8. Håvard Hungnes, 2020. "Equal predictability test for multi-step-ahead system forecasts invariant to linear transformations," Discussion Papers 931, Statistics Norway, Research Department.
    9. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    10. Drechsel, Katja & Scheufele, Rolf, 2010. "Should We Trust in Leading Indicators? Evidence from the Recent Recession," IWH Discussion Papers 10/2010, Halle Institute for Economic Research (IWH).
    11. Colino, Evelyn V. & Irwin, Scott H. & Garcia, Philip, 2009. "Do Composite Procedures Really Improve the Accuracy of Outlook Forecasts?," 2009 Conference, April 20-21, 2009, St. Louis, Missouri 53052, NCCC-134 Conference on Applied Commodity Price Analysis, Forecasting, and Market Risk Management.
    12. Mingzhe Wei & Georgios Sermpinis & Charalampos Stasinakis, 2023. "Forecasting and trading Bitcoin with machine learning techniques and a hybrid volatility/sentiment leverage," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(4), pages 852-871, July.
    13. Yen, Yu-Min & Yen, Tso-Jung, 2021. "Testing forecast accuracy of expectiles and quantiles with the extremal consistent loss functions," International Journal of Forecasting, Elsevier, vol. 37(2), pages 733-758.
    14. Hamid Baghestani, 2014. "On the loss structure of federal reserve forecasts of output growth," Journal of Economics and Finance, Springer;Academy of Economics and Finance, vol. 38(3), pages 518-527, July.
    15. Drechsel, Katja & Scheufele, Rolf, 2012. "The performance of short-term forecasts of the German economy before and during the 2008/2009 recession," International Journal of Forecasting, Elsevier, vol. 28(2), pages 428-445.
    16. Wang, Yudong & Hao, Xianfeng, 2023. "Forecasting the real prices of crude oil: What is the role of parameter instability?," Energy Economics, Elsevier, vol. 117(C).
    17. Chalmovianský, Jakub & Porqueddu, Mario & Sokol, Andrej, 2020. "Weigh(t)ing the basket: aggregate and component-based inflation forecasts for the euro area," Working Paper Series 2501, European Central Bank.
    18. Chuan-Hao Hsu & Hung-Gay Fung & Yi-Ping Chang, 2016. "The performance of Taiwanese firms after a share repurchase announcement," Review of Quantitative Finance and Accounting, Springer, vol. 47(4), pages 1251-1269, November.
    19. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    20. Erie Febrian & Aldrin Herwany, 2009. "Volatility Forecasting Models and Market Co-Integration: A Study on South-East Asian Markets," Working Papers in Economics and Development Studies (WoPEDS) 200911, Department of Economics, Padjadjaran University, revised Sep 2009.

    More about this item

    Keywords

    data snooping; forecast combination; forecast evaluation; real-time data; Survey of Professional Forecasters;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecb:ecbwps:20101277. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Official Publications (email available below). General contact details of provider: https://edirc.repec.org/data/emieude.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.