IDEAS home Printed from https://ideas.repec.org/a/kap/decono/v162y2014i3p215-221.html
   My bibliography  Save this article

Evaluating CPB’s Forecasts

Author

Listed:
  • Philip Franses

Abstract

This paper analyzes forecasts, for ten key annually observed economic variables for the Netherlands, created by the Netherlands Bureau for Economic Policy Analysis (CPB) for 1971–2007. These CPB forecasts are all manually modified model forecasts, where the model is a (very) large multi-equation macro model. The CPB forecasts are held against real-time forecasts obtained from simple autoregressive time series models, and for seven of the ten cases, CPB’s forecasts are significantly more accurate. Combining CPB’s forecasts with the real time autoregressive forecasts shows that four of the ten combined forecasts are significantly better than CPB’s forecasts, and seven of the ten are better than the time series forecasts. This suggests that CPB’s manual adjustment efforts could perhaps be directed to modifying simple model forecasts and not the forecasts from the own large macro model. Copyright Springer Science+Business Media New York 2014

Suggested Citation

  • Philip Franses, 2014. "Evaluating CPB’s Forecasts," De Economist, Springer, vol. 162(3), pages 215-221, September.
    • Handle: RePEc:kap:decono:v:162:y:2014:i:3:p:215-221
    DOI: 10.1007/s10645-014-9230-z
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10645-014-9230-z
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s10645-014-9230-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Guillaume Chevillon, 2007. "Direct Multi‐Step Estimation And Forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 21(4), pages 746-785, September.
    2. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    3. Adam Elbourne & Henk Kranendonk & Rob Luginbuhl & Bert Smid & Martin Vromans, 2008. "Evaluating CPB's published GDP growth forecasts; a comparison with individual and pooled VAR based forecasts," CPB Document 172, CPB Netherlands Bureau for Economic Policy Analysis.
    4. Franses,Philip Hans, 2014. "Expert Adjustments of Model Forecasts," Cambridge Books, Cambridge University Press, number 9781107081598, October.
    5. Franses, Philip Hans & Kranendonk, Henk C. & Lanser, Debby, 2011. "One model and various experts: Evaluating Dutch macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 482-495.
    6. Ericsson, Neil R., 1992. "Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration," Journal of Policy Modeling, Elsevier, vol. 14(4), pages 465-495, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. McCracken,M.W. & West,K.D., 2001. "Inference about predictive ability," Working papers 14, Wisconsin Madison - Social Systems.
    2. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
    3. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    4. Gelper, Sarah & Croux, Christophe, 2007. "Multivariate out-of-sample tests for Granger causality," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3319-3329, April.
    5. Philip Hans Franses & Bert Bruijn, 2017. "Benchmarking Judgmentally Adjusted Forecasts," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 22(1), pages 3-11, January.
    6. Philip Hans Franses, 2011. "Model selection for forecast combination," Applied Economics, Taylor & Francis Journals, vol. 43(14), pages 1721-1727.
    7. Philip Hans Franses & Max Welz, 2020. "Does More Expert Adjustment Associate with Less Accurate Professional Forecasts?," JRFM, MDPI, vol. 13(3), pages 1-8, March.
    8. Philip Hans Franses & Michael McAleer & Rianne Legerstee, 2014. "Evaluating Macroeconomic Forecasts: A Concise Review Of Some Recent Developments," Journal of Economic Surveys, Wiley Blackwell, vol. 28(2), pages 195-208, April.
    9. Ferrara, Laurent & Marcellino, Massimiliano & Mogliani, Matteo, 2015. "Macroeconomic forecasting during the Great Recession: The return of non-linearity?," International Journal of Forecasting, Elsevier, vol. 31(3), pages 664-679.
    10. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    11. Robert Sollis, 2005. "Predicting returns and volatility with macroeconomic variables: evidence from tests of encompassing," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 24(3), pages 221-231.
    12. Busetti, Fabio & Marcucci, Juri, 2013. "Comparing forecast accuracy: A Monte Carlo investigation," International Journal of Forecasting, Elsevier, vol. 29(1), pages 13-27.
    13. Philip Hans Franses, 2021. "Modeling Judgment in Macroeconomic Forecasts," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 19(1), pages 401-417, December.
    14. Christian Schumacher, 2007. "Forecasting German GDP using alternative factor models based on large datasets," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(4), pages 271-302.
    15. Todd E. Clark, 2004. "Can out-of-sample forecast comparisons help prevent overfitting?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(2), pages 115-139.
    16. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    17. Gebka, Bartosz & Wohar, Mark E., 2019. "Stock return distribution and predictability: Evidence from over a century of daily data on the DJIA index," International Review of Economics & Finance, Elsevier, vol. 60(C), pages 1-25.
    18. Andrew B. Martinez, 2020. "Extracting Information from Different Expectations," Working Papers 2020-008, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    19. Ryan Ratcliff, 2010. "Predicting nominal exchange rate movements using skewness information from options prices," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 15(1), pages 75-92.
    20. Jing-Zhi Huang & Zhan Shi, 2023. "Machine-Learning-Based Return Predictors and the Spanning Controversy in Macro-Finance," Management Science, INFORMS, vol. 69(3), pages 1780-1804, March.

    More about this item

    Keywords

    Macro-economic forecasting; Forecast accuracy; Forecast evaluation; E27;
    All these keywords.

    JEL classification:

    • E27 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:decono:v:162:y:2014:i:3:p:215-221. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.