IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v29y2013i1p80-87.html
   My bibliography  Save this article

Do statistical forecasting models for SKU-level data benefit from including past expert knowledge?

Author

Listed:
  • Franses, Philip Hans
  • Legerstee, Rianne

Abstract

We determine whether statistical model forecasts of SKU level sales data can be improved by formally including past expert knowledge in the model as additional variables. Upon analyzing various forecasts in a large database, using various models, forecast samples and accuracy measures, we demonstrate that experts’ knowledge, on average, apparently is not associated with variables which are systematically omitted from the statistical models. We also find that the formal inclusion of past judgment can be helpful in cases when the model performs poorly. This can lead to an improved interaction between models and experts, and we discuss the design features of a forecasting support system.

Suggested Citation

  • Franses, Philip Hans & Legerstee, Rianne, 2013. "Do statistical forecasting models for SKU-level data benefit from including past expert knowledge?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 80-87.
    • Handle: RePEc:eee:intfor:v:29:y:2013:i:1:p:80-87
    DOI: 10.1016/j.ijforecast.2012.05.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207012000842
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijforecast.2012.05.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Eroglu, Cuneyt & Croxton, Keely L., 2010. "Biases in judgmental adjustments of statistical forecasts: The role of individual differences," International Journal of Forecasting, Elsevier, vol. 26(1), pages 116-133, January.
    2. Paul Goodwin, 2010. "Why Hindsight Can Damage Foresight," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 17, pages 5-7, Spring.
    3. Philip Hans Franses & Rianne Legerstee, 2010. "Do experts' adjustments on model-based SKU-level forecasts improve forecast quality?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(3), pages 331-340.
    4. Bruno Biais & Martin Weber, 2009. "Hindsight Bias, Risk Perception, and Investment Performance," Management Science, INFORMS, vol. 55(6), pages 1018-1029, June.
    5. Stephen J. Hoch & David A. Schkade, 1996. "A Psychological Approach to Decision Support Systems," Management Science, INFORMS, vol. 42(1), pages 51-64, January.
    6. Clements, Michael P. & Hendry, David F. (ed.), 2011. "The Oxford Handbook of Economic Forecasting," OUP Catalogue, Oxford University Press, number 9780195398649.
    7. Fildes, Robert & Goodwin, Paul & Lawrence, Michael & Nikolopoulos, Konstantinos, 2009. "Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning," International Journal of Forecasting, Elsevier, vol. 25(1), pages 3-23.
    8. Robert Fildes & Paul Goodwin, 2007. "Against Your Better Judgment? How Organizations Can Improve Their Use of Management Judgment in Forecasting," Interfaces, INFORMS, vol. 37(6), pages 570-576, December.
    9. Syntetos, Aris A. & Nikolopoulos, Konstantinos & Boylan, John E. & Fildes, Robert & Goodwin, Paul, 2009. "The effects of integrating management judgement into intermittent demand forecasts," International Journal of Production Economics, Elsevier, vol. 118(1), pages 72-81, March.
    10. Lawrence, Michael & Goodwin, Paul & Fildes, Robert, 2002. "Influence of user participation on DSS use and decision accuracy," Omega, Elsevier, vol. 30(5), pages 381-392, October.
    11. Robert Fildes & Paul Goodwin, 2007. "Good and Bad Judgment in Forecasting: Lessons from Four Companies," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 8, pages 5-10, Fall.
    12. Ujwal Kayande & Arnaud De Bruyn & Gary L. Lilien & Arvind Rangaswamy & Gerrit H. van Bruggen, 2009. "How Incorporating Feedback Mechanisms in a DSS Affects DSS Evaluations," Information Systems Research, INFORMS, vol. 20(4), pages 527-546, December.
    13. Franses, Philip Hans & Legerstee, Rianne, 2009. "Properties of expert adjustments on model-based SKU-level forecasts," International Journal of Forecasting, Elsevier, vol. 25(1), pages 35-47.
    14. Robert C. Blattberg & Stephen J. Hoch, 1990. "Database Models and Managerial Intuition: 50% Model + 50% Manager," Management Science, INFORMS, vol. 36(8), pages 887-899, August.
    15. Juan R. Trapero & Robert Fildes & Andrey Davydenko, 2011. "Nonlinear identification of judgmental forecasts effects at SKU level," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 30(5), pages 490-508, August.
    16. Goodwin, Paul, 2002. "Integrating management judgment and statistical methods to improve short-term forecasts," Omega, Elsevier, vol. 30(2), pages 127-135, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Baecke, Philippe & De Baets, Shari & Vanderheyden, Karlien, 2017. "Investigating the added value of integrating human judgement into statistical demand forecasting systems," International Journal of Production Economics, Elsevier, vol. 191(C), pages 85-96.
    2. Babai, Zied & Boylan, John E. & Kolassa, Stephan & Nikolopoulos, Konstantinos, 2016. "Supply chain forecasting: Theory, practice, their gap and the futureAuthor-Name: Syntetos, Aris A," European Journal of Operational Research, Elsevier, vol. 252(1), pages 1-26.
    3. Fildes, Robert & Goodwin, Paul & Onkal, Dilek, 2015. "Information use in supply chain forecasting," MPRA Paper 66034, University Library of Munich, Germany.
    4. Syntetos, Aris A. & Kholidasari, Inna & Naim, Mohamed M., 2016. "The effects of integrating management judgement into OUT levels: In or out of context?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 853-863.
    5. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    6. Abolghasemi, Mahdi & Hurley, Jason & Eshragh, Ali & Fahimnia, Behnam, 2020. "Demand forecasting in the presence of systematic events: Cases in capturing sales promotions," International Journal of Production Economics, Elsevier, vol. 230(C).
    7. Fildes, Robert & Goodwin, Paul & Önkal, Dilek, 2019. "Use and misuse of information in supply chain forecasting of promotion effects," International Journal of Forecasting, Elsevier, vol. 35(1), pages 144-156.
    8. Alvarado-Valencia, Jorge & Barrero, Lope H. & Önkal, Dilek & Dennerlein, Jack T., 2017. "Expertise, credibility of system forecasts and integration methods in judgmental demand forecasting," International Journal of Forecasting, Elsevier, vol. 33(1), pages 298-313.
    9. Van den Broeke, Maud & De Baets, Shari & Vereecke, Ann & Baecke, Philippe & Vanderheyden, Karlien, 2019. "Judgmental forecast adjustments over different time horizons," Omega, Elsevier, vol. 87(C), pages 34-45.
    10. Fildes, Robert & Goodwin, Paul, 2021. "Stability in the inefficient use of forecasting systems: A case study in a supply chain company," International Journal of Forecasting, Elsevier, vol. 37(2), pages 1031-1046.
    11. Petropoulos, Fotios & Fildes, Robert & Goodwin, Paul, 2016. "Do ‘big losses’ in judgmental adjustments to statistical forecasts affect experts’ behaviour?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 842-852.
    12. Bert de Bruijn & Philip Hans Franses, 2012. "Managing Sales Forecasters," Tinbergen Institute Discussion Papers 12-131/III, Tinbergen Institute.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    2. Baecke, Philippe & De Baets, Shari & Vanderheyden, Karlien, 2017. "Investigating the added value of integrating human judgement into statistical demand forecasting systems," International Journal of Production Economics, Elsevier, vol. 191(C), pages 85-96.
    3. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Franses, Philip Hans, 2013. "Improving judgmental adjustment of model-based forecasts," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 93(C), pages 1-8.
    6. Petropoulos, Fotios & Fildes, Robert & Goodwin, Paul, 2016. "Do ‘big losses’ in judgmental adjustments to statistical forecasts affect experts’ behaviour?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 842-852.
    7. Sroginis, Anna & Fildes, Robert & Kourentzes, Nikolaos, 2023. "Use of contextual and model-based information in adjusting promotional forecasts," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1177-1191.
    8. Bert de Bruijn & Philip Hans Franses, 2012. "Managing Sales Forecasters," Tinbergen Institute Discussion Papers 12-131/III, Tinbergen Institute.
    9. Fildes, Robert & Goodwin, Paul, 2021. "Stability in the inefficient use of forecasting systems: A case study in a supply chain company," International Journal of Forecasting, Elsevier, vol. 37(2), pages 1031-1046.
    10. Van den Broeke, Maud & De Baets, Shari & Vereecke, Ann & Baecke, Philippe & Vanderheyden, Karlien, 2019. "Judgmental forecast adjustments over different time horizons," Omega, Elsevier, vol. 87(C), pages 34-45.
    11. Trapero, Juan R. & Pedregal, Diego J. & Fildes, R. & Kourentzes, N., 2013. "Analysis of judgmental adjustments in the presence of promotions," International Journal of Forecasting, Elsevier, vol. 29(2), pages 234-243.
    12. Syntetos, Aris A. & Kholidasari, Inna & Naim, Mohamed M., 2016. "The effects of integrating management judgement into OUT levels: In or out of context?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 853-863.
    13. A A Syntetos & N C Georgantzas & J E Boylan & B C Dangerfield, 2011. "Judgement and supply chain dynamics," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(6), pages 1138-1158, June.
    14. Rianne Legerstee & Philip Hans Franses & Richard Paap, 2011. "Do Experts incorporate Statistical Model Forecasts and should they?," Tinbergen Institute Discussion Papers 11-141/4, Tinbergen Institute.
    15. De Baets, Shari & Harvey, Nigel, 2018. "Forecasting from time series subject to sporadic perturbations: Effectiveness of different types of forecasting support," International Journal of Forecasting, Elsevier, vol. 34(2), pages 163-180.
    16. Franses, Ph.H.B.F., 2009. "Forecasting Sales," Econometric Institute Research Papers EI 2009-29, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    17. Rianne Legerstee & Philip Hans Franses, 2014. "Do Experts’ SKU Forecasts Improve after Feedback?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 69-79, January.
    18. Franses, Philip Hans & Kranendonk, Henk C. & Lanser, Debby, 2011. "One model and various experts: Evaluating Dutch macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 482-495.
    19. Babai, Zied & Boylan, John E. & Kolassa, Stephan & Nikolopoulos, Konstantinos, 2016. "Supply chain forecasting: Theory, practice, their gap and the futureAuthor-Name: Syntetos, Aris A," European Journal of Operational Research, Elsevier, vol. 252(1), pages 1-26.
    20. Khosrowabadi, Naghmeh & Hoberg, Kai & Imdahl, Christina, 2022. "Evaluating human behaviour in response to AI recommendations for judgemental forecasting," European Journal of Operational Research, Elsevier, vol. 303(3), pages 1151-1167.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:29:y:2013:i:1:p:80-87. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.