IDEAS home Printed from https://ideas.repec.org/a/gam/jjrfmx/v13y2020i3p44-d327516.html
   My bibliography  Save this article

Does More Expert Adjustment Associate with Less Accurate Professional Forecasts?

Author

Listed:
  • Philip Hans Franses

    (Econometric Institute, Erasmus School of Economics, POB 1738, NL-3000 DR Rotterdam, The Netherlands)

  • Max Welz

    (Econometric Institute, Erasmus School of Economics, POB 1738, NL-3000 DR Rotterdam, The Netherlands)

Abstract

Professional forecasters can rely on an econometric model to create their forecasts. It is usually unknown to what extent they adjust an econometric model-based forecast. In this paper we show, while making just two simple assumptions, that it is possible to estimate the persistence and variance of the deviation of their forecasts from forecasts from an econometric model. A key feature of the data that facilitates our estimates is that we have forecast updates for the same forecast target. An illustration to consensus forecasters who give forecasts for GDP growth, inflation and unemployment for a range of countries and years suggests that the more a forecaster deviates from a prediction from an econometric model, the less accurate are the forecasts.

Suggested Citation

  • Philip Hans Franses & Max Welz, 2020. "Does More Expert Adjustment Associate with Less Accurate Professional Forecasts?," JRFM, MDPI, vol. 13(3), pages 1-8, March.
    • Handle: RePEc:gam:jjrfmx:v:13:y:2020:i:3:p:44-:d:327516
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1911-8074/13/3/44/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1911-8074/13/3/44/
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Dovern, Jonas & Weisser, Johannes, 2011. "Accuracy, unbiasedness and efficiency of professional macroeconomic forecasts: An empirical comparison for the G7," International Journal of Forecasting, Elsevier, vol. 27(2), pages 452-465.
    2. Carlos Capistr¡N & Allan Timmermann, 2009. "Disagreement and Biases in Inflation Expectations," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(2-3), pages 365-396, March.
    3. Batchelor, Roy, 2007. "Bias in macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 23(2), pages 189-203.
    4. Loungani, Prakash, 2001. "How accurate are private sector forecasts? Cross-country evidence from consensus forecasts of output growth," International Journal of Forecasting, Elsevier, vol. 17(3), pages 419-432.
    5. Roy Batchelor, 2007. "Forecaster Behaviour and Bias in Macroeconomic Forecasts," ifo Working Paper Series 39, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    6. Genre, Véronique & Kenny, Geoff & Meyler, Aidan & Timmermann, Allan, 2013. "Combining expert forecasts: Can anything beat the simple average?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 108-121.
    7. Fildes, Robert & Goodwin, Paul & Lawrence, Michael & Nikolopoulos, Konstantinos, 2009. "Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning," International Journal of Forecasting, Elsevier, vol. 25(1), pages 3-23.
    8. Roy Batchelor, 2001. "How useful are the forecasts of intergovernmental agencies? The IMF and OECD versus the consensus," Applied Economics, Taylor & Francis Journals, vol. 33(2), pages 225-235.
    9. Franses,Philip Hans, 2014. "Expert Adjustments of Model Forecasts," Cambridge Books, Cambridge University Press, number 9781107081598, September.
    10. Kajal Lahiri & Xuguang Sheng, 2010. "Measuring forecast uncertainty by disagreement: The missing link," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 514-538.
    11. Franses, Philip Hans & Kranendonk, Henk C. & Lanser, Debby, 2011. "One model and various experts: Evaluating Dutch macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 482-495, April.
    12. Gultekin Isiklar & Kajal Lahiri & Prakash Loungani, 2006. "How quickly do forecasters incorporate news? Evidence from cross‐country surveys," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(6), pages 703-725, September.
    13. Frenkel, Michael & Rülke, Jan-Christoph & Zimmermann, Lilli, 2013. "Do private sector forecasters chase after IMF or OECD forecasts?," Journal of Macroeconomics, Elsevier, vol. 37(C), pages 217-229.
    14. David Laster & Paul Bennett & In Sun Geoum, 1999. "Rational Bias in Macroeconomic Forecasts," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 293-318.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Franses, Ph.H.B.F. & Maassen, N.R., 2015. "Consensus forecasters: How good are they individually and why?," Econometric Institute Research Papers EI2015-21, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    2. Dovern, Jonas & Weisser, Johannes, 2011. "Accuracy, unbiasedness and efficiency of professional macroeconomic forecasts: An empirical comparison for the G7," International Journal of Forecasting, Elsevier, vol. 27(2), pages 452-465.
    3. Frenkel, Michael & Rülke, Jan-Christoph & Zimmermann, Lilli, 2013. "Do private sector forecasters chase after IMF or OECD forecasts?," Journal of Macroeconomics, Elsevier, vol. 37(C), pages 217-229.
    4. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    5. Chang, Chia-Lin & de Bruijn, Bert & Franses, Philip Hans & McAleer, Michael, 2013. "Analyzing fixed-event forecast revisions," International Journal of Forecasting, Elsevier, vol. 29(4), pages 622-627.
    6. Philip Hans Franses, 2021. "Modeling Judgment in Macroeconomic Forecasts," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 19(1), pages 401-417, December.
    7. Papastamos, Dimitrios & Matysiak, George & Stevenson, Simon, 2015. "Assessing the accuracy and dispersion of real estate investment forecasts," International Review of Financial Analysis, Elsevier, vol. 42(C), pages 141-152.
    8. Philip Hans Franses & Max Welz, 2022. "Evaluating heterogeneous forecasts for vintages of macroeconomic variables," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(4), pages 829-839, July.
    9. Dimitrios Papastamos & Fotis Mouzakis & Simon Stevenson, 2014. "Rationality and Momentum in Real Estate Investment Forecasts," Real Estate & Planning Working Papers rep-wp2014-07, Henley Business School, University of Reading.
    10. Benchimol, Jonathan & El-Shagi, Makram & Saadon, Yossi, 2022. "Do expert experience and characteristics affect inflation forecasts?," Journal of Economic Behavior & Organization, Elsevier, vol. 201(C), pages 205-226.
    11. Dovern, Jonas & Jannsen, Nils, 2017. "Systematic errors in growth expectations over the business cycle," International Journal of Forecasting, Elsevier, vol. 33(4), pages 760-769.
    12. Dovern, Jonas & Fritsche, Ulrich & Loungani, Prakash & Tamirisa, Natalia, 2015. "Information rigidities: Comparing average and individual forecasts for a large international panel," International Journal of Forecasting, Elsevier, vol. 31(1), pages 144-154.
    13. Ager, P. & Kappler, M. & Osterloh, S., 2009. "The accuracy and efficiency of the Consensus Forecasts: A further application and extension of the pooled approach," International Journal of Forecasting, Elsevier, vol. 25(1), pages 167-181.
    14. Stekler, H.O., 2007. "The future of macroeconomic forecasting: Understanding the forecasting process," International Journal of Forecasting, Elsevier, vol. 23(2), pages 237-248.
    15. Tsuchiya, Yoichi, 2016. "Assessing macroeconomic forecasts for Japan under an asymmetric loss function," International Journal of Forecasting, Elsevier, vol. 32(2), pages 233-242.
    16. Lahiri, Kajal & Sheng, Xuguang, 2008. "Evolution of forecast disagreement in a Bayesian learning model," Journal of Econometrics, Elsevier, vol. 144(2), pages 325-340, June.
    17. Bruno Deschamps & Christos Ioannidis, 2014. "The Efficiency of Multivariate Macroeconomic Forecasts," Manchester School, University of Manchester, vol. 82(5), pages 509-523, September.
    18. Dimitrios Papastamos & George Matysiak & Simon Stevenson, 2014. "A Comparative Analysis of the Accuracy and Uncertainty in Real Estate and Macroeconomic Forecasts," Real Estate & Planning Working Papers rep-wp2014-06, Henley Business School, University of Reading.
    19. Philip Hans Franses, 2020. "Correcting the January optimism effect," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(6), pages 927-933, September.
    20. Conrad, Christian & Lahiri, Kajal, 2024. "Heterogeneous Expectations among Professional Forecasters," Working Papers 0754, University of Heidelberg, Department of Economics.

    More about this item

    Keywords

    professional forecasters; econometric model; expert adjustment; forecast accuracy;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jjrfmx:v:13:y:2020:i:3:p:44-:d:327516. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.