IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v36y2020i4p1420-1438.html
   My bibliography  Save this article

Daily retail demand forecasting using machine learning with emphasis on calendric special days

Author

Listed:
  • Huber, Jakob
  • Stuckenschmidt, Heiner

Abstract

Demand forecasting is an important task for retailers as it is required for various operational decisions. One key challenge is to forecast demand on special days that are subject to vastly different demand patterns than on regular days. We present the case of a bakery chain with an emphasis on special calendar days, for which we address the problem of forecasting the daily demand for different product categories at the store level. Such forecasts are an input for production and ordering decisions. We treat the forecasting problem as a supervised machine learning task and provide an evaluation of different methods, including artificial neural networks and gradient-boosted decision trees. In particular, we outline and discuss the possibility of formulating a classification instead of a regression problem. An empirical comparison with established approaches reveals the superiority of machine learning methods, while classification-based approaches outperform regression-based approaches. We also found that machine learning methods not only provide more accurate forecasts but are also more suitable for applications in a large-scale demand forecasting scenario that often occurs in the retail industry.

Suggested Citation

  • Huber, Jakob & Stuckenschmidt, Heiner, 2020. "Daily retail demand forecasting using machine learning with emphasis on calendric special days," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1420-1438.
  • Handle: RePEc:eee:intfor:v:36:y:2020:i:4:p:1420-1438
    DOI: 10.1016/j.ijforecast.2020.02.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207020300224
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2020.02.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Crone, Sven F. & Hibon, Michèle & Nikolopoulos, Konstantinos, 2011. "Advances in forecasting with neural networks? Empirical evidence from the NN3 competition on time series prediction," International Journal of Forecasting, Elsevier, vol. 27(3), pages 635-660.
    2. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
    3. Bergmeir, Christoph & Hyndman, Rob J. & Koo, Bonsoo, 2018. "A note on the validity of cross-validation for evaluating autoregressive time series prediction," Computational Statistics & Data Analysis, Elsevier, vol. 120(C), pages 70-83.
    4. Karel H. van Donselaar & Vishal Gaur & Tom van Woensel & Rob A. C. M. Broekmeulen & Jan C. Fransoo, 2010. "Ordering Behavior in Retail Stores and Implications for Automated Replenishment," Management Science, INFORMS, vol. 56(5), pages 766-784, May.
    5. Harald J. van Heerde & Peter S. H. Leeflang & Dick R. Wittink, 2002. "How Promotions Work: Scan Pro-Based Evolutionary Model Building," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 54(3), pages 198-220, July.
    6. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    7. Ramanathan, Usha & Muyldermans, Luc, 2010. "Identifying demand factors for promotional planning and forecasting: A case of a soft drink company in the UK," International Journal of Production Economics, Elsevier, vol. 128(2), pages 538-545, December.
    8. Hyndman, Rob J. & Koehler, Anne B. & Snyder, Ralph D. & Grose, Simone, 2002. "A state space framework for automatic forecasting using exponential smoothing methods," International Journal of Forecasting, Elsevier, vol. 18(3), pages 439-454.
    9. Kang, Yanfei & Hyndman, Rob J. & Smith-Miles, Kate, 2017. "Visualising forecasting algorithm performance using time series instance spaces," International Journal of Forecasting, Elsevier, vol. 33(2), pages 345-358.
    10. Carbonneau, Real & Laframboise, Kevin & Vahidov, Rustam, 2008. "Application of machine learning techniques for supply chain demand forecasting," European Journal of Operational Research, Elsevier, vol. 184(3), pages 1140-1154, February.
    11. Kim, Myung Suk, 2013. "Modeling special-day effects for forecasting intraday electricity demand," European Journal of Operational Research, Elsevier, vol. 230(1), pages 170-180.
    12. Nesreen Ahmed & Amir Atiya & Neamat El Gayar & Hisham El-Shishiny, 2010. "An Empirical Comparison of Machine Learning Models for Time Series Forecasting," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 594-621.
    13. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    14. Barrow, Devon K. & Crone, Sven F., 2016. "Cross-validation aggregation for combining autoregressive neural network forecasts," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1120-1137.
    15. van Donselaar, K.H. & Peters, J. & de Jong, A. & Broekmeulen, R.A.C.M., 2016. "Analysis and forecasting of demand during promotions for perishable items," International Journal of Production Economics, Elsevier, vol. 172(C), pages 65-75.
    16. Barrow, Devon & Kourentzes, Nikolaos, 2018. "The impact of special days in call arrivals forecasting: A neural network approach to modelling special days," European Journal of Operational Research, Elsevier, vol. 264(3), pages 967-977.
    17. Kourentzes, Nikolaos & Petropoulos, Fotios, 2016. "Forecasting with multivariate temporal aggregation: The case of promotional modelling," International Journal of Production Economics, Elsevier, vol. 181(PA), pages 145-153.
    18. Chu, Ching-Wu & Zhang, Guoqiang Peter, 2003. "A comparative study of linear and nonlinear models for aggregate retail sales forecasting," International Journal of Production Economics, Elsevier, vol. 86(3), pages 217-231, December.
    19. Trapero, Juan R. & Pedregal, Diego J. & Fildes, R. & Kourentzes, N., 2013. "Analysis of judgmental adjustments in the presence of promotions," International Journal of Forecasting, Elsevier, vol. 29(2), pages 234-243.
    20. Huang, Tao & Fildes, Robert & Soopramanien, Didier, 2014. "The value of competitive information in forecasting FMCG retail product sales and the variable selection problem," European Journal of Operational Research, Elsevier, vol. 237(2), pages 738-748.
    21. Ma, Shaohui & Fildes, Robert, 2017. "A retail store SKU promotions optimization model for category multi-period profit maximization," European Journal of Operational Research, Elsevier, vol. 260(2), pages 680-692.
    22. Fildes, Robert & Ma, Shaohui & Kolassa, Stephan, 2019. "Retail forecasting: research and practice," MPRA Paper 89356, University Library of Munich, Germany.
    23. Taylor, James W., 2007. "Forecasting daily supermarket sales using exponentially weighted quantile regression," European Journal of Operational Research, Elsevier, vol. 178(1), pages 154-167, April.
    24. van Donselaar, K. & van Woensel, T. & Broekmeulen, R. & Fransoo, J., 2006. "Inventory control of perishables in supermarkets," International Journal of Production Economics, Elsevier, vol. 104(2), pages 462-472, December.
    25. Cancelo, José Ramón & Espasa, Antoni & Grafe, Rosmarie, 2008. "Forecasting the electricity load from one day to one week ahead for the Spanish system operator," International Journal of Forecasting, Elsevier, vol. 24(4), pages 588-602.
    26. Ma, Shaohui & Fildes, Robert & Huang, Tao, 2016. "Demand forecasting with high dimensional data: The case of SKU retail sales forecasting with intra- and inter-category promotional information," European Journal of Operational Research, Elsevier, vol. 249(1), pages 245-257.
    27. Anthony Tay & Kenneth F. Wallis, 2000. "Density Forecasting: A Survey," Econometric Society World Congress 2000 Contributed Papers 0370, Econometric Society.
    28. Arunraj, Nari Sivanandam & Ahrens, Diane, 2015. "A hybrid seasonal autoregressive integrated moving average and quantile regression for daily food sales forecasting," International Journal of Production Economics, Elsevier, vol. 170(PA), pages 321-335.
    29. Lee G. Cooper & Penny Baron & Wayne Levy & Michael Swisher & Paris Gogos, 1999. "PromoCast™: A New Forecasting Method for Promotion Planning," Marketing Science, INFORMS, vol. 18(3), pages 301-316.
    30. Spyros Makridakis & Evangelos Spiliotis & Vassilios Assimakopoulos, 2018. "Statistical and Machine Learning forecasting methods: Concerns and ways forward," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-26, March.
    31. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2018. "The M4 Competition: Results, findings, conclusion and way forward," International Journal of Forecasting, Elsevier, vol. 34(4), pages 802-808.
    32. Zhang, Guoqiang & Eddy Patuwo, B. & Y. Hu, Michael, 1998. "Forecasting with artificial neural networks:: The state of the art," International Journal of Forecasting, Elsevier, vol. 14(1), pages 35-62, March.
    33. Juan R Trapero & Nikolaos Kourentzes & Robert Fildes, 2015. "On the identification of sales forecasting models in the presence of promotions," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(2), pages 299-307, February.
    34. Kolassa, Stephan, 2016. "Evaluating predictive count data distributions in retail sales forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 788-803.
    35. Soares, Lacir J. & Medeiros, Marcelo C., 2008. "Modeling and forecasting short-term electricity load: A comparison of methods with an application to Brazilian data," International Journal of Forecasting, Elsevier, vol. 24(4), pages 630-644.
    36. Suresh Divakar & Brian T. Ratchford & Venkatesh Shankar, 2005. "Practice Prize Article—: A Multichannel, Multiregion Sales Forecasting Model and Decision Support System for Consumer Packaged Goods," Marketing Science, INFORMS, vol. 24(3), pages 334-350, July.
    37. G. Di Pillo & V. Latorre & S. Lucidi & E. Procacci, 2016. "An application of support vector machines to sales forecasting under promotions," 4OR, Springer, vol. 14(3), pages 309-325, September.
    38. Peter S.H. Leeflang & Harald J. van Heerde & Dick Wittink, 2002. "How Promotions Work: SCAN*PRO-Based Evolutionary Model Building," Yale School of Management Working Papers ysm292, Yale School of Management.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ulrich, Matthias & Jahnke, Hermann & Langrock, Roland & Pesch, Robert & Senge, Robin, 2022. "Classification-based model selection in retail demand forecasting," International Journal of Forecasting, Elsevier, vol. 38(1), pages 209-223.
    2. Fildes, Robert & Kolassa, Stephan & Ma, Shaohui, 2022. "Post-script—Retail forecasting: Research and practice," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1319-1324.
    3. Sule Birim & Ipek Kazancoglu & Sachin Kumar Mangla & Aysun Kahraman & Yigit Kazancoglu, 2024. "The derived demand for advertising expenses and implications on sustainability: a comparative study using deep learning and traditional machine learning methods," Annals of Operations Research, Springer, vol. 339(1), pages 131-161, August.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Islam, Samiul & Amin, Saman Hassanzadeh & Wardley, Leslie J., 2021. "Machine learning and optimization models for supplier selection and order allocation planning," International Journal of Production Economics, Elsevier, vol. 242(C).
    6. Spreitzenbarth, Jan & Stuckenschmidt, Heiner & Bode, Christoph, 2021. "The state of artificial intelligence: Procurement versus sales and marketing," Chapters from the Proceedings of the Hamburg International Conference of Logistics (HICL), in: Kersten, Wolfgang & Ringle, Christian M. & Blecker, Thorsten (ed.), Adapting to the Future: How Digitalization Shapes Sustainable Logistics and Resilient Supply Chain Management. Proceedings of the Hamburg Internationa, volume 31, pages 223-243, Hamburg University of Technology (TUHH), Institute of Business Logistics and General Management.
    7. Mayukh Dass & Masoud Moradi & Fereshteh Zihagh, 2023. "Forecasting purchase rates of new products introduced in existing categories," Journal of Marketing Analytics, Palgrave Macmillan, vol. 11(3), pages 385-408, September.
    8. Wellens, Arnoud P. & Boute, Robert N. & Udenio, Maximiliano, 2024. "Simplifying tree-based methods for retail sales forecasting with explanatory variables," European Journal of Operational Research, Elsevier, vol. 314(2), pages 523-539.
    9. Naragain Phumchusri & Nichakan Phupaichitkun, 2024. "Sales prediction hybrid models for retails using promotional pricing strategy as a key demand driver," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 23(5), pages 461-480, October.
    10. Abdulmajeed Alqhatani & Muhammad Shoaib Ashraf & Javed Ferzund & Ahmad Shaf & Hamad Ali Abosaq & Saifur Rahman & Muhammad Irfan & Samar M. Alqhtani, 2022. "360° Retail Business Analytics by Adopting Hybrid Machine Learning and a Business Intelligence Approach," Sustainability, MDPI, vol. 14(19), pages 1-20, September.
    11. Huber, Jakob & Stuckenschmidt, Heiner, 2021. "Intraday shelf replenishment decision support for perishable goods," International Journal of Production Economics, Elsevier, vol. 231(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Fildes, Robert & Ma, Shaohui & Kolassa, Stephan, 2022. "Retail forecasting: Research and practice," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1283-1318.
    3. Huber, Jakob & Stuckenschmidt, Heiner, 2021. "Intraday shelf replenishment decision support for perishable goods," International Journal of Production Economics, Elsevier, vol. 231(C).
    4. Fildes, Robert & Ma, Shaohui & Kolassa, Stephan, 2019. "Retail forecasting: research and practice," MPRA Paper 89356, University Library of Munich, Germany.
    5. Gür Ali, Özden & Gürlek, Ragıp, 2020. "Automatic Interpretable Retail forecasting with promotional scenarios," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1389-1406.
    6. Van Belle, Jente & Guns, Tias & Verbeke, Wouter, 2021. "Using shared sell-through data to forecast wholesaler demand in multi-echelon supply chains," European Journal of Operational Research, Elsevier, vol. 288(2), pages 466-479.
    7. Hewage, Harsha Chamara & Perera, H. Niles & De Baets, Shari, 2022. "Forecast adjustments during post-promotional periods," European Journal of Operational Research, Elsevier, vol. 300(2), pages 461-472.
    8. Abolghasemi, Mahdi & Hurley, Jason & Eshragh, Ali & Fahimnia, Behnam, 2020. "Demand forecasting in the presence of systematic events: Cases in capturing sales promotions," International Journal of Production Economics, Elsevier, vol. 230(C).
    9. Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
    10. Semenoglou, Artemios-Anargyros & Spiliotis, Evangelos & Makridakis, Spyros & Assimakopoulos, Vassilios, 2021. "Investigating the accuracy of cross-learning time series forecasting methods," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1072-1084.
    11. Sule Birim & Ipek Kazancoglu & Sachin Kumar Mangla & Aysun Kahraman & Yigit Kazancoglu, 2024. "The derived demand for advertising expenses and implications on sustainability: a comparative study using deep learning and traditional machine learning methods," Annals of Operations Research, Springer, vol. 339(1), pages 131-161, August.
    12. Ma, Shaohui & Fildes, Robert, 2020. "Forecasting third-party mobile payments with implications for customer flow prediction," International Journal of Forecasting, Elsevier, vol. 36(3), pages 739-760.
    13. Huber, Jakob & Müller, Sebastian & Fleischmann, Moritz & Stuckenschmidt, Heiner, 2019. "A data-driven newsvendor problem: From data to decision," European Journal of Operational Research, Elsevier, vol. 278(3), pages 904-915.
    14. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    15. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    16. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    17. Huang, Tao & Fildes, Robert & Soopramanien, Didier, 2019. "Forecasting retailer product sales in the presence of structural change," European Journal of Operational Research, Elsevier, vol. 279(2), pages 459-470.
    18. Sagaert, Yves R. & Aghezzaf, El-Houssaine & Kourentzes, Nikolaos & Desmet, Bram, 2018. "Tactical sales forecasting using a very large set of macroeconomic indicators," European Journal of Operational Research, Elsevier, vol. 264(2), pages 558-569.
    19. Hoeltgebaum, Henrique & Borenstein, Denis & Fernandes, Cristiano & Veiga, Álvaro, 2021. "A score-driven model of short-term demand forecasting for retail distribution centers," Journal of Retailing, Elsevier, vol. 97(4), pages 715-725.
    20. R Fildes & K Nikolopoulos & S F Crone & A A Syntetos, 2008. "Forecasting and operational research: a review," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(9), pages 1150-1172, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:36:y:2020:i:4:p:1420-1438. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.