IDEAS home Printed from https://ideas.repec.org/p/bca/bocadp/17-5.html
   My bibliography  Save this paper

Assessing the Business Outlook Survey Indicator Using Real-Time Data

Author

Listed:
  • Lise Pichette
  • Marie-Noëlle Robitaille

Abstract

Every quarter, the Bank of Canada conducts quarterly consultations with businesses across Canada, referred to as the Business Outlook Survey (BOS). A principal-component analysis conducted by Pichette and Rennison (2011) led to the development of the BOS indicator, which summarizes survey results and is used by the Bank as a gauge of overall business sentiment. In this paper, we examine whether data vintages matter when assessing the predictive content of the BOS indicator and individual BOS questions and whether the BOS is a better indicator of revised or unrevised macroeconomic data. As an indicator of business sentiment in the context of monetary policy, the reliability of the BOS is essential, and it is crucial to understand whether the signals it sends are best interpreted for early-released or revised data. For this purpose, we use different methods of forecasting that take into account the real-time perspective of the data. Results from the different methods show that the BOS content is informative regardless of data revisions. However, in real time, the BOS indicator and individual BOS questions are found to produce better nowcasts of first-released data or partially revised data than of latest-available data. This is particularly important in the case of growth in real business investment. In fact, because revisions to real business investment are more volatile than revisions to real gross domestic product (GDP), the choice of data vintages when assessing the ability of the BOS to forecast growth appears to be more important for real business investment than for real GDP.

Suggested Citation

  • Lise Pichette & Marie-Noëlle Robitaille, 2017. "Assessing the Business Outlook Survey Indicator Using Real-Time Data," Discussion Papers 17-5, Bank of Canada.
    • Handle: RePEc:bca:bocadp:17-5
    as

    Download full text from publisher

    File URL: https://www.bankofcanada.ca/wp-content/uploads/2017/04/sdp2017-5.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    2. Athanasios Orphanides & Simon van Norden, 2002. "The Unreliability of Output-Gap Estimates in Real Time," The Review of Economics and Statistics, MIT Press, vol. 84(4), pages 569-583, November.
    3. Francesco Ravazzolo & Philip Rothman, 2013. "Oil and U.S. GDP: A Real-Time Out-of-Sample Examination," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 45(2-3), pages 449-463, March.
    4. N. Gregory Mankiw & Matthew D. Shapiro, 1986. "News or Noise? An Analysis of GNP Revisions," NBER Working Papers 1939, National Bureau of Economic Research, Inc.
    5. Stark, Tom & Croushore, Dean, 2002. "Forecasting with a real-time data set for macroeconomists," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 507-531, December.
    6. Dean Croushore, 2011. "Frontiers of Real-Time Data Analysis," Journal of Economic Literature, American Economic Association, vol. 49(1), pages 72-100, March.
    7. Dean Croushore & Tom Stark, 2003. "A Real-Time Data Set for Macroeconomists: Does the Data Vintage Matter?," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 605-617, August.
    8. Paul Jenkins & David Longworth, 2002. "Monetary Policy and Uncertainty," Bank of Canada Review, Bank of Canada, vol. 2002(Summer), pages 3-10.
    9. Jan Jacobs & Jan-Egbert Sturm, 2005. "Do Ifo Indicators Help Explain Revisions in German Industrial Production?," Contributions to Economics, in: Jan-Egbert Sturm & Timo Wollmershäuser (ed.), Ifo Survey Data in Business Cycle and Monetary Policy Analysis, pages 93-114, Springer.
    10. Heij, Christiaan & van Dijk, Dick & Groenen, Patrick J.F., 2011. "Real-time macroeconomic forecasting with leading indicators: An empirical comparison," International Journal of Forecasting, Elsevier, vol. 27(2), pages 466-481, April.
    11. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    12. repec:mcb:jmoncb:v:45:y:2013:i::p:449-463 is not listed on IDEAS
    13. Clark, Todd E. & McCracken, Michael W., 2009. "Tests of Equal Predictive Ability With Real-Time Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 441-454.
    14. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    15. Lise Pichette & Lori Rennison, 2011. "Extracting Information from the Business Outlook Survey: A Principal-Component Approach," Bank of Canada Review, Bank of Canada, vol. 2011(Autumn), pages 21-28.
    16. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1.
    17. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    18. Monica Martin & Cristiano Papile, 2004. "The Bank of Canada's Business Outlook Survey: An Assessment," Staff Working Papers 04-15, Bank of Canada.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Calista Cheung & Luke Frymire & Lise Pichette, 2020. "Can the Business Outlook Survey Help Improve Estimates of the Canadian Output Gap?," Discussion Papers 2020-14, Bank of Canada.
    2. David Amirault & Naveen Rai & Laurent Martin, 2020. "A Reference Guide for the Business Outlook Survey," Discussion Papers 2020-15, Bank of Canada.
    3. Kevin Moran & Simplice Aime Nono, 2016. "Using Confidence Data to Forecast the Canadian Business Cycle," Cahiers de recherche 1606, Centre de recherche sur les risques, les enjeux économiques, et les politiques publiques.
    4. Kevin Moran & Simplice Aimé Nono & Imad Rherrad, 2018. "Forecasting with Many Predictors: How Useful are National and International Confidence Data?," Cahiers de recherche 1814, Centre de recherche sur les risques, les enjeux économiques, et les politiques publiques.
    5. Matthieu Verstraete & Lena Suchanek, 2017. "Understanding Monetary Policy and its Effects: Evidence from Canadian Firms Using the Business Outlook Survey," Staff Working Papers 17-24, Bank of Canada.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    2. Carlo Altavilla & Matteo Ciccarelli, 2011. "Monetary Policy Analysis in Real-Time. Vintage Combination from a Real-Time Dataset," CESifo Working Paper Series 3372, CESifo.
    3. Marek RUSNAK, 2013. "Revisions to the Czech National Accounts: Properties and Predictability," Czech Journal of Economics and Finance (Finance a uver), Charles University Prague, Faculty of Social Sciences, vol. 63(3), pages 244-261, July.
    4. Heinisch Katja & Scheufele Rolf, 2019. "Should Forecasters Use Real-Time Data to Evaluate Leading Indicator Models for GDP Prediction? German Evidence," German Economic Review, De Gruyter, vol. 20(4), pages 170-200, December.
    5. Jacobs, Jan P.A.M. & van Norden, Simon, 2011. "Modeling data revisions: Measurement error and dynamics of "true" values," Journal of Econometrics, Elsevier, vol. 161(2), pages 101-109, April.
    6. Heinisch, Katja, 2016. "A real-time analysis on the importance of hard and soft data for nowcasting German GDP," VfS Annual Conference 2016 (Augsburg): Demographic Change 145864, Verein für Socialpolitik / German Economic Association.
    7. Barbara Rossi, 2013. "Exchange Rate Predictability," Journal of Economic Literature, American Economic Association, vol. 51(4), pages 1063-1119, December.
    8. Aastveit, Knut Are & Trovik, Tørres, 2014. "Estimating the output gap in real time: A factor model approach," The Quarterly Review of Economics and Finance, Elsevier, vol. 54(2), pages 180-193.
    9. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    10. Michael P. Clements, 2014. "Anticipating Early Data Revisions to US GDP and the Effects of Releases on Equity Markets," ICMA Centre Discussion Papers in Finance icma-dp2014-06, Henley Business School, University of Reading.
    11. Calista Cheung & Luke Frymire & Lise Pichette, 2020. "Can the Business Outlook Survey Help Improve Estimates of the Canadian Output Gap?," Discussion Papers 2020-14, Bank of Canada.
    12. Pierdzioch, Christian & Döpke, Jörg & Hartmann, Daniel, 2008. "Forecasting stock market volatility with macroeconomic variables in real time," Journal of Economics and Business, Elsevier, vol. 60(3), pages 256-276.
    13. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    14. Pablo Pincheira Brown & Nicolás Hardy, 2024. "The mean squared prediction error paradox," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(6), pages 2298-2321, September.
    15. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    16. Emilia Tomczyk, 2013. "End of sample vs. real time data: perspectives for analysis of expectations," Working Papers 68, Department of Applied Econometrics, Warsaw School of Economics.
    17. Clark, Todd E. & McCracken, Michael W., 2009. "Tests of Equal Predictive Ability With Real-Time Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 441-454.
    18. Gerit Vogt, 2009. "Konjunkturprognose in Deutschland. Ein Beitrag zur Prognose der gesamtwirtschaftlichen Entwicklung auf Bundes- und Länderebene," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 36.
    19. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    20. Aslanidis, Nektarios & Cipollini, Andrea, 2010. "Leading indicator properties of US high-yield credit spreads," Journal of Macroeconomics, Elsevier, vol. 32(1), pages 145-156, March.

    More about this item

    Keywords

    Business fluctuations and cycles; Regional economic developments;

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C82 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Macroeconomic Data; Data Access
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bca:bocadp:17-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/bocgvca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.