IDEAS home Printed from https://ideas.repec.org/a/eee/proeco/v128y2010i2p625-636.html
   My bibliography  Save this article

Evaluation of forecasting error measurements and techniques for intermittent demand

Author

Listed:
  • Wallström, Peter
  • Segerstedt, Anders

Abstract

This paper is a part and contribution to develop flexible and robust supply chain forecasting systems under changing market demands. It suggests new tools and models to evaluate forecasting error measurements. The paper especially studies slow moving or intermittent demand, when for items the forecasting time periods often have zero demand. For the difficult to forecast intermittent demand the Croston forecasting technique is mostly regarded as a better choice than single exponential smoothing. These two methods, Croston and single exponential smoothing, together with two modifications of the Croston method, are discussed and evaluated with real intermittent data. The apprehended performance of a forecasting technique is dependent of the chosen measurement of forecast errors. The main purpose is to examine and evaluate different forecasting error measurements. Traditional measurements of forecast errors are studied, mean absolute deviation (MAD), mean square error (MSE), etc. together with new suggested error and bias measurements: "periods in stock" (PIS) and "number of shortages" (NOS). PIS considers the time aspect of the forecast error, NOS considers the development of cumulated forecast error (CFE). A complementary measure for descriptive statistics of time series is also suggested, mean average change. The conclusion, through principal components analysis (PCA), is that a single measure of forecast errors does not present the total different dimensions of the errors; complementary error measures must be used.

Suggested Citation

  • Wallström, Peter & Segerstedt, Anders, 2010. "Evaluation of forecasting error measurements and techniques for intermittent demand," International Journal of Production Economics, Elsevier, vol. 128(2), pages 625-636, December.
  • Handle: RePEc:eee:proeco:v:128:y:2010:i:2:p:625-636
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0925-5273(10)00253-7
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. A A Syntetos & J E Boylan & J D Croston, 2005. "On the categorization of demand patterns," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(5), pages 495-503, May.
    2. Shah, Chandra, 1997. "Model selection in univariate time series forecasting using discriminant analysis," International Journal of Forecasting, Elsevier, vol. 13(4), pages 489-500, December.
    3. Rasmussen, Rasmus, 2004. "On time series data and optimal parameters," Omega, Elsevier, vol. 32(2), pages 111-120, April.
    4. Syntetos, Aris A. & Boylan, John E., 2005. "The accuracy of intermittent demand estimates," International Journal of Forecasting, Elsevier, vol. 21(2), pages 303-314.
    5. Willemain, Thomas R. & Smart, Charles N. & Shockor, Joseph H. & DeSautels, Philip A., 1994. "Forecasting intermittent demand in manufacturing: a comparative evaluation of Croston's method," International Journal of Forecasting, Elsevier, vol. 10(4), pages 529-538, December.
    6. Boylan, J.E. & Syntetos, A.A., 2007. "The accuracy of a Modified Croston procedure," International Journal of Production Economics, Elsevier, vol. 107(2), pages 511-517, June.
    7. Syntetos, A. A. & Boylan, J. E., 2001. "On the bias of intermittent demand estimates," International Journal of Production Economics, Elsevier, vol. 71(1-3), pages 457-466, May.
    8. Teunter, Ruud & Sani, Babangida, 2009. "On the bias of Croston's forecasting method," European Journal of Operational Research, Elsevier, vol. 194(1), pages 177-183, April.
    9. Leven, Erik & Segerstedt, Anders, 2004. "Inventory control with a modified Croston procedure and Erlang distribution," International Journal of Production Economics, Elsevier, vol. 90(3), pages 361-367, August.
    10. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    11. Syntetos, Aris A. & Boylan, John E., 2006. "On the stock control performance of intermittent demand estimators," International Journal of Production Economics, Elsevier, vol. 103(1), pages 36-47, September.
    12. R H Teunter & L Duncan, 2009. "Forecasting intermittent demand: a comparative study," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(3), pages 321-329, March.
    13. A H C Eaves & B G Kingsman, 2004. "Forecasting for the ordering and stock-holding of spare parts," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(4), pages 431-437, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Teunter, Ruud H. & Syntetos, Aris A. & Zied Babai, M., 2011. "Intermittent demand: Linking forecasting to inventory obsolescence," European Journal of Operational Research, Elsevier, vol. 214(3), pages 606-615, November.
    2. Nikolaos Kourentzes & Dong Li & Arne K. Strauss, 2019. "Unconstraining methods for revenue management systems under small demand," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 18(1), pages 27-41, February.
    3. Borga Deniz, 2012. "Inventory Control with Advance Demand Information When Demand is Intermittent," Business and Management Research, Business and Management Research, Sciedu Press, vol. 1(4), pages 35-45, December.
    4. Mariusz Doszyn, 2020. "Accuracy of Intermittent Demand Forecasting Systems in the Enterprise," European Research Studies Journal, European Research Studies Journal, vol. 0(4), pages 912-930.
    5. Kourentzes, Nikolaos, 2013. "Intermittent demand forecasts with neural networks," International Journal of Production Economics, Elsevier, vol. 143(1), pages 198-206.
    6. Corey Ducharme & Bruno Agard & Martin Trépanier, 2024. "Improving demand forecasting for customers with missing downstream data in intermittent demand supply chains with supervised multivariate clustering," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(5), pages 1661-1681, August.
    7. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    8. Aiping Jiang & Qiuguo Chi & Junjun Gao & Maoguo Wu, 2019. "An Integrated Approach to Forecasting Intermittent Demand for Electric Power Materials," Computational Economics, Springer;Society for Computational Economics, vol. 53(4), pages 1309-1335, April.
    9. Philippe St-Aubin & Bruno Agard, 2022. "Precision and Reliability of Forecasts Performance Metrics," Forecasting, MDPI, vol. 4(4), pages 1-22, October.
    10. Ferbar Tratar, Liljana & Mojškerc, Blaž & Toman, Aleš, 2016. "Demand forecasting with four-parameter exponential smoothing," International Journal of Production Economics, Elsevier, vol. 181(PA), pages 162-173.
    11. Roubos, Alex & Jouini, Oualid, 2013. "Call centers with hyperexponential patience modeling," International Journal of Production Economics, Elsevier, vol. 141(1), pages 307-315.
    12. Pinçe, Çerağ & Turrini, Laura & Meissner, Joern, 2021. "Intermittent demand forecasting for spare parts: A Critical review," Omega, Elsevier, vol. 105(C).
    13. Kourentzes, Nikolaos, 2014. "On intermittent demand model optimisation and selection," International Journal of Production Economics, Elsevier, vol. 156(C), pages 180-190.
    14. Jože Martin Rožanec & Blaž Fortuna & Dunja Mladenić, 2022. "Reframing Demand Forecasting: A Two-Fold Approach for Lumpy and Intermittent Demand," Sustainability, MDPI, vol. 14(15), pages 1-21, July.
    15. Dominik Martin & Philipp Spitzer & Niklas Kuhl, 2020. "A New Metric for Lumpy and Intermittent Demand Forecasts: Stock-keeping-oriented Prediction Error Costs," Papers 2004.10537, arXiv.org.
    16. Marisol Valencia Cárdenas & Juan Gabriel Vanegas López & Juan Carlos Correa Morales & Jorge Aníbal Restrepo Morales, 2017. "Comparing forecasts for tourism dynamics in Medellín, Colombia," Lecturas de Economía, Universidad de Antioquia, Departamento de Economía, issue 86, pages 199-230, Enero - J.
    17. Bacci, Livio Agnew & Mello, Luiz Gustavo & Incerti, Taynara & Paulo de Paiva, Anderson & Balestrassi, Pedro Paulo, 2019. "Optimization of combined time series methods to forecast the demand for coffee in Brazil: A new approach using Normal Boundary Intersection coupled with mixture designs of experiments and rotated fact," International Journal of Production Economics, Elsevier, vol. 212(C), pages 186-211.
    18. Lolli, F. & Gamberini, R. & Regattieri, A. & Balugani, E. & Gatos, T. & Gucci, S., 2017. "Single-hidden layer neural networks for forecasting intermittent demand," International Journal of Production Economics, Elsevier, vol. 183(PA), pages 116-128.
    19. Aiping Jiang & Kwok Leung Tam & Xiaoyun Guo & Yufeng Zhang, 2020. "A new approach to forecasting intermittent demand based on the mixed zero‐truncated Poisson model," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(1), pages 69-83, January.
    20. Mariusz Doszyn, 2020. "Biasedness of Forecasts Errors for Intermittent Demand Data," European Research Studies Journal, European Research Studies Journal, vol. 0(Special 1), pages 1113-1127.
    21. Prestwich, S.D. & Tarim, S.A. & Rossi, R., 2021. "Intermittency and obsolescence: A Croston method with linear decay," International Journal of Forecasting, Elsevier, vol. 37(2), pages 708-715.
    22. Valencia Cárdenas, Marisol & Vanegas López, Juan Gabriel & Correa Morales, Juan Carlos & Restrepo Morales, Jorge Aníbal, 2016. "Comparación de pronósticos para la dinámica del turismo en Medellín, Colombia," Revista Lecturas de Economía, Universidad de Antioquia, CIE, issue 86, pages 199-230, December.
    23. Kück, Mirko & Freitag, Michael, 2021. "Forecasting of customer demands for production planning by local k-nearest neighbor models," International Journal of Production Economics, Elsevier, vol. 231(C).
    24. Ducharme, Corey & Agard, Bruno & Trépanier, Martin, 2021. "Forecasting a customer's Next Time Under Safety Stock," International Journal of Production Economics, Elsevier, vol. 234(C).
    25. Kolassa, Stephan, 2016. "Evaluating predictive count data distributions in retail sales forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 788-803.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bacchetti, Andrea & Saccani, Nicola, 2012. "Spare parts classification and demand forecasting for stock control: Investigating the gap between research and practice," Omega, Elsevier, vol. 40(6), pages 722-737.
    2. Pennings, Clint L.P. & van Dalen, Jan & van der Laan, Erwin A., 2017. "Exploiting elapsed time for managing intermittent demand for spare parts," European Journal of Operational Research, Elsevier, vol. 258(3), pages 958-969.
    3. Pinçe, Çerağ & Turrini, Laura & Meissner, Joern, 2021. "Intermittent demand forecasting for spare parts: A Critical review," Omega, Elsevier, vol. 105(C).
    4. Babai, M. Zied & Ali, Mohammad M. & Nikolopoulos, Konstantinos, 2012. "Impact of temporal aggregation on stock control performance of intermittent demand estimators: Empirical analysis," Omega, Elsevier, vol. 40(6), pages 713-721.
    5. Teunter, Ruud H. & Syntetos, Aris A. & Zied Babai, M., 2011. "Intermittent demand: Linking forecasting to inventory obsolescence," European Journal of Operational Research, Elsevier, vol. 214(3), pages 606-615, November.
    6. Kourentzes, Nikolaos, 2013. "Intermittent demand forecasts with neural networks," International Journal of Production Economics, Elsevier, vol. 143(1), pages 198-206.
    7. Gardner, Everette Jr., 2006. "Exponential smoothing: The state of the art--Part II," International Journal of Forecasting, Elsevier, vol. 22(4), pages 637-666.
    8. Jože Martin Rožanec & Blaž Fortuna & Dunja Mladenić, 2022. "Reframing Demand Forecasting: A Two-Fold Approach for Lumpy and Intermittent Demand," Sustainability, MDPI, vol. 14(15), pages 1-21, July.
    9. Li, Chongshou & Lim, Andrew, 2018. "A greedy aggregation–decomposition method for intermittent demand forecasting in fashion retailing," European Journal of Operational Research, Elsevier, vol. 269(3), pages 860-869.
    10. Hu, Qiwei & Boylan, John E. & Chen, Huijing & Labib, Ashraf, 2018. "OR in spare parts management: A review," European Journal of Operational Research, Elsevier, vol. 266(2), pages 395-414.
    11. R Fildes & K Nikolopoulos & S F Crone & A A Syntetos, 2008. "Forecasting and operational research: a review," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(9), pages 1150-1172, September.
    12. Lolli, F. & Gamberini, R. & Regattieri, A. & Balugani, E. & Gatos, T. & Gucci, S., 2017. "Single-hidden layer neural networks for forecasting intermittent demand," International Journal of Production Economics, Elsevier, vol. 183(PA), pages 116-128.
    13. Zhu, Sha & Dekker, Rommert & van Jaarsveld, Willem & Renjie, Rex Wang & Koning, Alex J., 2017. "An improved method for forecasting spare parts demand using extreme value theory," European Journal of Operational Research, Elsevier, vol. 261(1), pages 169-181.
    14. Boylan, J.E. & Syntetos, A.A., 2007. "The accuracy of a Modified Croston procedure," International Journal of Production Economics, Elsevier, vol. 107(2), pages 511-517, June.
    15. Altay, Nezih & Rudisill, Frank & Litteral, Lewis A., 2008. "Adapting Wright's modification of Holt's method to forecasting intermittent demand," International Journal of Production Economics, Elsevier, vol. 111(2), pages 389-408, February.
    16. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    17. Kourentzes, Nikolaos, 2014. "On intermittent demand model optimisation and selection," International Journal of Production Economics, Elsevier, vol. 156(C), pages 180-190.
    18. Babai, M.Z. & Dallery, Y. & Boubaker, S. & Kalai, R., 2019. "A new method to forecast intermittent demand in the presence of inventory obsolescence," International Journal of Production Economics, Elsevier, vol. 209(C), pages 30-41.
    19. Teunter, Ruud & Sani, Babangida, 2009. "On the bias of Croston's forecasting method," European Journal of Operational Research, Elsevier, vol. 194(1), pages 177-183, April.
    20. Snyder, Ralph D. & Ord, J. Keith & Beaumont, Adrian, 2012. "Forecasting the intermittent demand for slow-moving inventories: A modelling approach," International Journal of Forecasting, Elsevier, vol. 28(2), pages 485-496.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:proeco:v:128:y:2010:i:2:p:625-636. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijpe .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.