IDEAS home Printed from https://ideas.repec.org/p/bca/bocsan/17-21.html
   My bibliography  Save this paper

Evaluating Real GDP Growth Forecasts in the Bank of Canada Monetary Policy Report

Author

Listed:
  • André Binette
  • Dmitri Tchebotarev

Abstract

This paper examines the quality of projections of real GDP growth taken from the Bank of Canada Monetary Policy Report (MPR) since they were first published in 1997. Over the last decade, it has become common practice among the central banking community to discuss forecast performance publicly. The assessment we undertake is on annual forecasts as well as the average prediction over the policy horizon. We find that the MPR is more accurate than a naïve forecast model and marginally superior to a consensus of professional forecasters. The accuracy of the MPR annual predictions, measured by the root-mean-square prediction error (RMSPE), improves from 1.6 to 0.6 percentage points as more data become available. On a two-year average basis, the RMSPEs are about 1.0 percentage point for forecasts made in April and October. Our results also suggest that the bias present in MPR forecasts is often not statistically significant for both annual and two-year projections. Nonetheless, we found a tendency to overpredict growth at the beginning of the forecast cycle. Finally, at the beginning of the forecast cycle, the MPR correctly predicts the sign of the change in annual real GDP growth roughly 50 per cent of the time, improving to about 75 per cent at the end of the cycle. The sign of change is correctly predicted roughly 60 per cent of the time for the two-year average prediction.

Suggested Citation

  • André Binette & Dmitri Tchebotarev, 2017. "Evaluating Real GDP Growth Forecasts in the Bank of Canada Monetary Policy Report," Staff Analytical Notes 17-21, Bank of Canada.
  • Handle: RePEc:bca:bocsan:17-21
    as

    Download full text from publisher

    File URL: https://www.bankofcanada.ca/wp-content/uploads/2017/11/san2017-21.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    2. Tiff Macklem, 2002. "Information and Analysis for Monetary Policy: Coming to a Decision," Bank of Canada Review, Bank of Canada, vol. 2002(Summer), pages 11-18.
    3. John Murray, 2013. "Monetary Policy Decision Making at the Bank of Canada," Bank of Canada Review, Bank of Canada, vol. 2013(Autumn), pages 1-9.
    4. Olivier Gervais & Marc-André Gosselin, 2014. "Analyzing and Forecasting the Canadian Economy through the LENS Model," Technical Reports 102, Bank of Canada.
    5. Kirdan Lees, 2016. "Assessing forecast performance," Reserve Bank of New Zealand Bulletin, Reserve Bank of New Zealand, vol. 79, pages 1-19., June.
    6. Kenneth F. Wallis, 1999. "Asymmetric density forecasts of inflation and the Bank of England's fan chart," National Institute Economic Review, National Institute of Economic and Social Research, vol. 167(1), pages 106-112, January.
    7. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    8. José Dorich & Michael K. Johnston & Rhys R. Mendes & Stephen Murchison & Yang Zhang, 2013. "ToTEM II: An Updated Version of the Bank of Canada’s Quarterly Projection Model," Technical Reports 100, Bank of Canada.
    9. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Carola Conces Binder & Rodrigo Sekkel, 2024. "Central bank forecasting: A survey," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 342-364, April.
    2. Michael Atingi-Ego & Sayed Timuno & Tiviniton Makuve, 2021. "Public Debt Accumulation in SSA: A Looming Debt Crisis [‘Government Ponzi Games and the Sustainability of Public Deficits Under Uncertainty’]," Journal of African Economies, Centre for the Study of African Economies, vol. 30(Supplemen), pages 103-139.
    3. Julien Champagne & Guillaume Poulin-Bellisle & Rodrigo Sekkel, 2018. "Evaluating the Bank of Canada Staff Economic Projections Using a New Database of Real-Time Data and Forecasts," Staff Working Papers 18-52, Bank of Canada.
    4. Thibaut Duprey & Alexander Ueberfeldt, 2018. "How to Manage Macroeconomic and Financial Stability Risks: A New Framework," Staff Analytical Notes 2018-11, Bank of Canada.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Julien Champagne & Guillaume Poulin‐Bellisle & Rodrigo Sekkel, 2020. "Introducing the Bank of Canada staff economic projections database," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(1), pages 114-129, January.
    2. Julien Champagne & Guillaume Poulin-Bellisle & Rodrigo Sekkel, 2018. "Evaluating the Bank of Canada Staff Economic Projections Using a New Database of Real-Time Data and Forecasts," Staff Working Papers 18-52, Bank of Canada.
    3. Chris D'Souza & Jane Voll, 2021. "Qualitative Field Research in Monetary Policy Making," Discussion Papers 2021-1, Bank of Canada.
    4. Justin-Damien Guénette & Nicholas Labelle & Martin Leduc & Lori Rennison, 2016. "The Case of Serial Disappointment," Staff Analytical Notes 16-10, Bank of Canada.
    5. Carola Conces Binder & Rodrigo Sekkel, 2024. "Central bank forecasting: A survey," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 342-364, April.
    6. Malte Knüppel & Guido Schultefrankenfeld, 2012. "How Informative Are Central Bank Assessments of Macroeconomic Risks?," International Journal of Central Banking, International Journal of Central Banking, vol. 8(3), pages 87-139, September.
    7. Baris Soybilgen & Ege Yazgan, 2017. "An evaluation of inflation expectations in Turkey," Central Bank Review, Research and Monetary Policy Department, Central Bank of the Republic of Turkey, vol. 17(1), pages 1-31–38.
    8. Knüppel, Malte & Schultefrankenfeld, Guido, 2019. "Assessing the uncertainty in central banks’ inflation outlooks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1748-1769.
    9. Magnus Kvåle Helliesen & Håvard Hungnes & Terje Skjerpen, 2022. "Revisions in the Norwegian National Accounts: accuracy, unbiasedness and efficiency in preliminary figures," Empirical Economics, Springer, vol. 62(3), pages 1079-1121, March.
    10. Tolga Cenesizoglu & Denada Ibrushi, 2020. "Predicting Systematic Risk With Macroeconomic And Financial Variables," Journal of Financial Research, Southern Finance Association;Southwestern Finance Association, vol. 43(3), pages 649-673, August.
    11. Bespalova, Olga, 2018. "Forecast Evaluation in Macroeconomics and International Finance. Ph.D. thesis, George Washington University, Washington, DC, USA," MPRA Paper 117706, University Library of Munich, Germany.
    12. Patrick Schmidt & Matthias Katzfuss & Tilmann Gneiting, 2021. "Interpretation of point forecasts with unknown directive," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 728-743, September.
    13. Hollstein, Fabian & Prokopczuk, Marcel & Wese Simen, Chardin, 2017. "How to Estimate Beta?," Hannover Economic Papers (HEP) dp-617, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    14. Barbara Rossi & Tatevik Sekhposyan, 2016. "Forecast Rationality Tests in the Presence of Instabilities, with Applications to Federal Reserve and Survey Forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 507-532, April.
    15. Rossi, Barbara & Sekhposyan, Tatevik, 2011. "Understanding models' forecasting performance," Journal of Econometrics, Elsevier, vol. 164(1), pages 158-172, September.
    16. Benchimol, Jonathan & El-Shagi, Makram, 2020. "Forecast performance in times of terrorism," Economic Modelling, Elsevier, vol. 91(C), pages 386-402.
    17. Santos, Douglas G. & Candido, Osvaldo & Tófoli, Paula V., 2022. "Forecasting risk measures using intraday and overnight information," The North American Journal of Economics and Finance, Elsevier, vol. 60(C).
    18. Fabian Hollstein & Marcel Prokopczuk & Chardin Wese Simen, 2020. "The Conditional Capital Asset Pricing Model Revisited: Evidence from High-Frequency Betas," Management Science, INFORMS, vol. 66(6), pages 2474-2494, June.
    19. Hiroyuki Kawakatsu, 2021. "Information in daily data volatility measurements," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 26(2), pages 1642-1656, April.
    20. Oikonomou, Ioannis & Stancu, Andrei & Symeonidis, Lazaros & Wese Simen, Chardin, 2019. "The information content of short-term options," Journal of Financial Markets, Elsevier, vol. 46(C).

    More about this item

    Keywords

    Business fluctuations and cycles; Econometric and statistical methods; Monetary Policy;
    All these keywords.

    JEL classification:

    • C - Mathematical and Quantitative Methods
    • C5 - Mathematical and Quantitative Methods - - Econometric Modeling
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • E - Macroeconomics and Monetary Economics
    • E3 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles
    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • E5 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit
    • E52 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Monetary Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bca:bocsan:17-21. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/bocgvca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.