IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v36y2020i3p963-973.html
   My bibliography  Save this article

Are GDP forecasts optimal? Evidence on European countries

Author

Listed:
  • Giovannelli, Alessandro
  • Pericoli, Filippo Maria

Abstract

We assess the accuracy of real GDP growth forecasts released by governments and international organizations for European countries in the years 1999–2017. We implement three testing procedures characterized by different assumptions on the forecasters’ loss functions. First, we test forecast rationality within the traditional approach based on a quadratic loss function (Mincer and Zarnowitz, 1969). Second, following Elliott, Timmermann and Komunjer (2005), we test rationality by allowing for a flexible loss function where the shape parameter driving the extent of asymmetry is unknown and estimated from the empirical distribution of forecast errors. Lastly, we implement the tests proposed by Patton and Timmermann (2007a) that hold regardless of the functional form of the loss function. We conclude that governmental forecasts are biased and not rational under a symmetric and quadratic loss function, but they are optimal under more general assumptions on the loss function. We also find that the preferences of forecasters change with the forecasting horizon: when moving from one- to two-year-ahead forecasts, the optimistic bias increases and the parameter of asymmetry in the loss function significantly increases.

Suggested Citation

  • Giovannelli, Alessandro & Pericoli, Filippo Maria, 2020. "Are GDP forecasts optimal? Evidence on European countries," International Journal of Forecasting, Elsevier, vol. 36(3), pages 963-973.
  • Handle: RePEc:eee:intfor:v:36:y:2020:i:3:p:963-973
    DOI: 10.1016/j.ijforecast.2019.12.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207019302584
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2019.12.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Merola, Rossana & Pérez, Javier J., 2013. "Fiscal forecast errors: Governments versus independent agencies?," European Journal of Political Economy, Elsevier, vol. 32(C), pages 285-299.
    2. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    3. Clements, Michael P., 2019. "Do forecasters target first or later releases of national accounts data?," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1240-1249.
    4. Jeffrey Frankel, 2011. "Over-optimism in forecasts by official budget agencies and its implications," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 27(4), pages 536-562.
    5. Filip Keereman, 1999. "The track record of the Commission forecasts," European Economy - Economic Papers 2008 - 2015 137, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    6. Ulrich Fritsche & Christian Pierdzioch & Jan-Christoph R�lke & Georg Stadtmann, 2014. "A Note on Forecasting the Euro: Do Forecasters Have an Asymmetric Loss Function?," International Economic Journal, Taylor & Francis Journals, vol. 28(2), pages 333-343, June.
    7. Lars Jonung & Martin Larch, 2006. "Improving fiscal policy in the EU: the case for independent forecasts [‘Fiscal forecasting: The track record of the IMF, OECD and EC’]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 21(47), pages 492-534.
    8. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    9. Clive W.J. Granger, 1999. "Outline of forecast theory using generalized cost functions," Spanish Economic Review, Springer;Spanish Economic Association, vol. 1(2), pages 161-173.
    10. Oller, Lars-Erik & Barot, Bharat, 2000. "The accuracy of European growth and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 16(3), pages 293-315.
    11. Michael Artis & Massimiliano Marcellino, 2001. "Fiscal forecasting: The track record of the IMF, OECD and EC," Econometrics Journal, Royal Economic Society, vol. 4(1), pages 20-36.
    12. Tsuchiya, Yoichi, 2016. "Assessing macroeconomic forecasts for Japan under an asymmetric loss function," International Journal of Forecasting, Elsevier, vol. 32(2), pages 233-242.
    13. Behrens, Christoph & Pierdzioch, Christian & Risse, Marian, 2018. "Testing the optimality of inflation forecasts under flexible loss with random forests," Economic Modelling, Elsevier, vol. 72(C), pages 270-277.
    14. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1.
    15. Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-735, September.
    16. Hansen, Bruce E., 2008. "Least-squares forecast averaging," Journal of Econometrics, Elsevier, vol. 146(2), pages 342-350, October.
    17. Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
    18. Christian Pierdzioch & Jan-Christoph Rülke & Georg Stadtmann, 2013. "Oil price forecasting under asymmetric loss," Applied Economics, Taylor & Francis Journals, vol. 45(17), pages 2371-2379, June.
    19. Paul Beaudry & Tim Willems, 2022. "On the Macroeconomic Consequences of Over-Optimism," American Economic Journal: Macroeconomics, American Economic Association, vol. 14(1), pages 38-59, January.
    20. Krüger, Jens & Hoss, Julian, 2012. "German Business Cycle Forecasts, Asymmetric Loss and Financial Variables," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 63652, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    21. Carlos Fonseca Marinheiro, 2011. "Fiscal sustainability and the accuracy of macroeconomic forecasts: Do supranational forecasts rather than government forecasts make a difference?," International Journal of Sustainable Economy, Inderscience Enterprises Ltd, vol. 3(2), pages 185-209.
    22. Krüger, Jens J. & Hoss, Julian, 2012. "German business cycle forecasts, asymmetric loss and financial variables," Economics Letters, Elsevier, vol. 114(3), pages 284-287.
    23. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    24. Wang, Yiyao & Lee, Tae-Hwy, 2014. "Asymmetric loss in the Greenbook and the Survey of Professional Forecasters," International Journal of Forecasting, Elsevier, vol. 30(2), pages 235-245.
    25. Kemal Guler & Pin T. Ng & Zhijie Xiao, 2017. "Mincer–Zarnowitz quantile and expectile regressions for forecast evaluations under aysmmetric loss functions," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(6), pages 651-679, September.
    26. Rülke, Jan-Christoph & Pierdzioch, Christian, 2014. "Government Forecasts of Budget Balances Under Asymmetric Loss: International Evidence," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100317, Verein für Socialpolitik / German Economic Association.
    27. Allan Timmermann, 2007. "An Evaluation of the World Economic Outlook Forecasts," IMF Staff Papers, Palgrave Macmillan, vol. 54(1), pages 1-33, May.
    28. Dean Croushore, 2011. "Frontiers of Real-Time Data Analysis," Journal of Economic Literature, American Economic Association, vol. 49(1), pages 72-100, March.
    29. Frank-Oliver Aldenhoff, 2007. "Are economic forecasts of the International Monetary Fund politically biased? A public choice analysis," The Review of International Organizations, Springer, vol. 2(3), pages 239-260, September.
    30. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
    31. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    32. G. A. Christodoulakis & E. C. Mamatzakis, 2009. "Assessing the prudence of economic forecasts in the EU," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(4), pages 583-606.
    33. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    34. Lukas Vogel, 2007. "How do the OECD Growth Projections for the G7 Economies Perform?: A Post-Mortem," OECD Economics Department Working Papers 573, OECD Publishing.
    35. George A. Christodoulakis & Emmanuel C. Mamatzakis, 2008. "An assessment of the EU growth forecasts under asymmetric preferences," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(6), pages 483-492.
    36. Granger, C. W. J. & Newbold, Paul, 1986. "Forecasting Economic Time Series," Elsevier Monographs, Elsevier, edition 2, number 9780122951831 edited by Shell, Karl.
    37. A. Melander & G. Sismanidis & D. Grenouilleau, 2007. "The track record of the Commission's forecasts - an update," European Economy - Economic Papers 2008 - 2015 291, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    38. Mr. Marcos Poplawski Ribeiro & Jan-Christoph Rülke, 2011. "Fiscal Expectations Under the Stability and Growth Pact: Evidence from Survey Data," IMF Working Papers 2011/048, International Monetary Fund.
    39. Jens J. Krüger & Julian LeCrone, 2019. "Forecast Evaluation Under Asymmetric Loss: A Monte Carlo Analysis of the EKT Method," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 81(2), pages 437-455, April.
    40. Krüger, Jens & LeCrone, Julian, 2019. "Forecast Evaluation Under Asymmetric Loss: A Monte Carlo Analysis of the EKT Method," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 118710, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tsuchiya, Yoichi, 2023. "Assessing the World Bank’s growth forecasts," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 64-84.
    2. Siddhartha S. Bora & Ani L. Katchova & Todd H. Kuethe, 2021. "The Rationality of USDA Forecasts under Multivariate Asymmetric Loss," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(3), pages 1006-1033, May.
    3. Yoichi Tsuchiya, 2021. "Thirty‐year assessment of Asian Development Bank's forecasts," Asian-Pacific Economic Literature, The Crawford School, The Australian National University, vol. 35(2), pages 18-40, November.
    4. Yoichi Tsuchiya, 2024. "Conservatism and information rigidity of the European Bank for Reconstruction and Development's growth forecast: Quarter‐century assessment," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(5), pages 1399-1421, August.
    5. Kexin Ding & Ani L. Katchova, 2024. "Testing the optimality of USDA's WASDE forecasts under unknown loss," Agribusiness, John Wiley & Sons, Ltd., vol. 40(4), pages 846-865, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tsuchiya, Yoichi, 2023. "Assessing the World Bank’s growth forecasts," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 64-84.
    2. Siddhartha S. Bora & Ani L. Katchova & Todd H. Kuethe, 2021. "The Rationality of USDA Forecasts under Multivariate Asymmetric Loss," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(3), pages 1006-1033, May.
    3. Patrick Schmidt & Matthias Katzfuss & Tilmann Gneiting, 2021. "Interpretation of point forecasts with unknown directive," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 728-743, September.
    4. Yoichi Tsuchiya, 2024. "Conservatism and information rigidity of the European Bank for Reconstruction and Development's growth forecast: Quarter‐century assessment," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(5), pages 1399-1421, August.
    5. Yoichi Tsuchiya, 2022. "Evaluating plant managers’ production plans over business cycles: asymmetric loss and rationality," SN Business & Economics, Springer, vol. 2(8), pages 1-29, August.
    6. Demetrescu, Matei & Hacıoğlu Hoke, Sinem, 2019. "Predictive regressions under asymmetric loss: Factor augmentation and model selection," International Journal of Forecasting, Elsevier, vol. 35(1), pages 80-99.
    7. Behrens, Christoph & Pierdzioch, Christian & Risse, Marian, 2018. "Testing the optimality of inflation forecasts under flexible loss with random forests," Economic Modelling, Elsevier, vol. 72(C), pages 270-277.
    8. Tsuchiya, Yoichi, 2016. "Assessing macroeconomic forecasts for Japan under an asymmetric loss function," International Journal of Forecasting, Elsevier, vol. 32(2), pages 233-242.
    9. Wang, Yiyao & Lee, Tae-Hwy, 2014. "Asymmetric loss in the Greenbook and the Survey of Professional Forecasters," International Journal of Forecasting, Elsevier, vol. 30(2), pages 235-245.
    10. Rülke, Jan-Christoph & Pierdzioch, Christian, 2014. "Government Forecasts of Budget Balances Under Asymmetric Loss: International Evidence," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100317, Verein für Socialpolitik / German Economic Association.
    11. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    12. Tsuchiya, Yoichi, 2016. "Asymmetric loss and rationality of Chinese renminbi forecasts: An implication for the trade between China and the US," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 44(C), pages 116-127.
    13. Merola, Rossana & Pérez, Javier J., 2013. "Fiscal forecast errors: Governments versus independent agencies?," European Journal of Political Economy, Elsevier, vol. 32(C), pages 285-299.
    14. Capistrán, Carlos, 2008. "Bias in Federal Reserve inflation forecasts: Is the Federal Reserve irrational or just cautious?," Journal of Monetary Economics, Elsevier, vol. 55(8), pages 1415-1427, November.
    15. Jörg Döpke & Ulrich Fritsche & Boriss Siliverstovs, 2010. "Evaluating German business cycle forecasts under an asymmetric loss function," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2010(1), pages 1-18.
    16. Timmermann, Allan & Elliott, Graham & Komunjer, Ivana, 2003. "Estimating Loss Function Parameters," CEPR Discussion Papers 3821, C.E.P.R. Discussion Papers.
    17. Vasconcelos de Deus, Joseph David Barroso & de Mendonça, Helder Ferreira, 2017. "Fiscal forecasting performance in an emerging economy: An empirical assessment of Brazil," Economic Systems, Elsevier, vol. 41(3), pages 408-419.
    18. Matteo Iacopini & Francesco Ravazzolo & Luca Rossini, 2020. "Proper scoring rules for evaluating asymmetry in density forecasting," Papers 2006.11265, arXiv.org, revised Sep 2020.
    19. Christoph Behrens, 2019. "A Nonparametric Evaluation of the Optimality of German Export and Import Growth Forecasts under Flexible Loss," Economies, MDPI, vol. 7(3), pages 1-23, September.
    20. Dovern, Jonas & Jannsen, Nils, 2017. "Systematic errors in growth expectations over the business cycle," International Journal of Forecasting, Elsevier, vol. 33(4), pages 760-769.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:36:y:2020:i:3:p:963-973. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.