IDEAS home Printed from https://ideas.repec.org/p/ems/eureir/7676.html
   My bibliography  Save this paper

Formalizing judgemental adjustment of model-based forecasts

Author

Listed:
  • Franses, Ph.H.B.F.

Abstract

In business and in macroeconomics it is common practice to use econo- metric models to generate forecasts. These models can take any degree of sophistication. Sometimes it is felt by an expert that the model-based fore- cast needs adjustment. This paper makes a plea for a formal approach to such an adjustment, more precise, for the creation of detailed logbooks which con- tain information on why and how model-based forecasts have been adjusted. The reasons for doing so are that such logbooks allow for (i) the preservation of expert knowledge, (ii) for the possible future modi¯cation of econometric models in case adjustment is almost always needed, and (iii) for the evaluation of adjusted forecasts. In this paper I put forward an explicit mathematical expression for a judgementally adjusted model-based forecast. The key pa- rameters in the expression should enter the logbook. In a limited simulation experiment I illustrate an additional use of this expression, that is, looking with hindsight if adjustment would have led to better results. The results of the simulation suggest that always adjusting forecasts leads to very poor results. Also, it is documented that small adjustments are better that large adjustments, even in case large adjustments are felt necessary.

Suggested Citation

  • Franses, Ph.H.B.F., 2006. "Formalizing judgemental adjustment of model-based forecasts," Econometric Institute Research Papers EI 2006-19, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  • Handle: RePEc:ems:eureir:7676
    as

    Download full text from publisher

    File URL: https://repub.eur.nl/pub/7676/ei2006-19.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. James S. Dyer, 1990. "Remarks on the Analytic Hierarchy Process," Management Science, INFORMS, vol. 36(3), pages 249-258, March.
    2. Webby, Richard & O'Connor, Marcus, 1996. "Judgemental and statistical time series forecasting: a review of the literature," International Journal of Forecasting, Elsevier, vol. 12(1), pages 91-118, March.
    3. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521632423, November.
    4. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    5. Flores, Benito E. & Olson, David L. & Wolfe, Christopher, 1992. "Judgmental adjustment of forecasts: A comparison of methods," International Journal of Forecasting, Elsevier, vol. 7(4), pages 421-433, March.
    6. Belton, Valerie & Goodwin, Paul, 1996. "Remarks on the application of the analytic hierarchy process to judgmental forecasting," International Journal of Forecasting, Elsevier, vol. 12(1), pages 155-161, March.
    7. Philip Hans Franses, 2004. "Do We Think We Make Better Forecasts Than in the Past? A Survey of Academics," Interfaces, INFORMS, vol. 34(6), pages 466-468, December.
    8. James S. Dyer, 1990. "A Clarification of "Remarks on the Analytic Hierarchy Process"," Management Science, INFORMS, vol. 36(3), pages 274-275, March.
    9. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    10. Robert C. Blattberg & Stephen J. Hoch, 1990. "Database Models and Managerial Intuition: 50% Model + 50% Manager," Management Science, INFORMS, vol. 36(8), pages 887-899, August.
    11. Goodwin, Paul, 2002. "Integrating management judgment and statistical methods to improve short-term forecasts," Omega, Elsevier, vol. 30(2), pages 127-135, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philip Hans Franses, 2011. "Averaging Model Forecasts and Expert Forecasts: Why Does It Work?," Interfaces, INFORMS, vol. 41(2), pages 177-181, April.
    2. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    3. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    6. Baecke, Philippe & De Baets, Shari & Vanderheyden, Karlien, 2017. "Investigating the added value of integrating human judgement into statistical demand forecasting systems," International Journal of Production Economics, Elsevier, vol. 191(C), pages 85-96.
    7. Antoine Mandel & Amir Sani, 2017. "A Machine Learning Approach to the Forecast Combination Puzzle," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01317974, HAL.
    8. Mauro Costantini & Ulrich Gunter & Robert M. Kunst, 2017. "Forecast Combinations in a DSGE‐VAR Lab," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(3), pages 305-324, April.
    9. Leitner, Johannes & Leopold-Wildburger, Ulrike, 2011. "Experiments on forecasting behavior with several sources of information - A review of the literature," European Journal of Operational Research, Elsevier, vol. 213(3), pages 459-469, September.
    10. Mehmet Pinar & Thanasis Stengos & M. Ege Yazgan, 2012. "Is there an Optimal Forecast Combination? A Stochastic Dominance Approach to Forecast Combination Puzzle," Working Paper series 17_12, Rimini Centre for Economic Analysis.
    11. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    12. Guidolin, Massimo & Timmermann, Allan, 2009. "Forecasts of US short-term interest rates: A flexible forecast combination approach," Journal of Econometrics, Elsevier, vol. 150(2), pages 297-311, June.
    13. Konstantinos Nikolopoulos, 2010. "Forecasting with quantitative methods: the impact of special events in time series," Applied Economics, Taylor & Francis Journals, vol. 42(8), pages 947-955.
    14. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    15. Patton, Andrew J. & Sheppard, Kevin, 2009. "Optimal combinations of realised volatility estimators," International Journal of Forecasting, Elsevier, vol. 25(2), pages 218-238.
    16. Alvarado-Valencia, Jorge & Barrero, Lope H. & Önkal, Dilek & Dennerlein, Jack T., 2017. "Expertise, credibility of system forecasts and integration methods in judgmental demand forecasting," International Journal of Forecasting, Elsevier, vol. 33(1), pages 298-313.
    17. Eksoz, Can & Mansouri, S. Afshin & Bourlakis, Michael, 2014. "Collaborative forecasting in the food supply chain: A conceptual framework," International Journal of Production Economics, Elsevier, vol. 158(C), pages 120-135.
    18. JS Armstrong & Fred Collopy, 2004. "Integration of Statistical Methods and Judgment for Time Series," General Economics and Teaching 0412024, University Library of Munich, Germany.
    19. Franses, Philip Hans, 2013. "Improving judgmental adjustment of model-based forecasts," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 93(C), pages 1-8.
    20. Prasad S Bhattacharya & Dimitrios D Thomakos, 2011. "Improving forecasting performance by window and model averaging," CAMA Working Papers 2011-05, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.

    More about this item

    Keywords

    forecasting; judgemental adjustment;

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ems:eureir:7676. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RePub (email available below). General contact details of provider: https://edirc.repec.org/data/feeurnl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.