IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2303.01887.html
   My bibliography  Save this paper

Fast Forecasting of Unstable Data Streams for On-Demand Service Platforms

Author

Listed:
  • Yu Jeffrey Hu
  • Jeroen Rombouts
  • Ines Wilms

Abstract

On-demand service platforms face a challenging problem of forecasting a large collection of high-frequency regional demand data streams that exhibit instabilities. This paper develops a novel forecast framework that is fast and scalable, and automatically assesses changing environments without human intervention. We empirically test our framework on a large-scale demand data set from a leading on-demand delivery platform in Europe, and find strong performance gains from using our framework against several industry benchmarks, across all geographical regions, loss functions, and both pre- and post-Covid periods. We translate forecast gains to economic impacts for this on-demand service platform by computing financial gains and reductions in computing costs.

Suggested Citation

  • Yu Jeffrey Hu & Jeroen Rombouts & Ines Wilms, 2023. "Fast Forecasting of Unstable Data Streams for On-Demand Service Platforms," Papers 2303.01887, arXiv.org, revised May 2024.
    • Handle: RePEc:arx:papers:2303.01887
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2303.01887
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. M. Keith Chen & Judith A. Chevalier & Peter E. Rossi & Emily Oehlsen, 2019. "The Value of Flexible Work: Evidence from Uber Drivers," Journal of Political Economy, University of Chicago Press, vol. 127(6), pages 2735-2794.
    2. Harish Guda & Upender Subramanian, 2019. "Your Uber Is Arriving: Managing On-Demand Workers Through Surge Pricing, Forecast Communication, and Worker Incentives," Management Science, INFORMS, vol. 67(5), pages 1995-2014, May.
    3. Barbara Rossi, 2021. "Forecasting in the Presence of Instabilities: How We Know Whether Models Predict Well and How to Improve Them," Journal of Economic Literature, American Economic Association, vol. 59(4), pages 1135-1190, December.
    4. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    5. Yudong Chen & Tengyao Wang & Richard J. Samworth, 2022. "High‐dimensional, multiscale online changepoint detection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(1), pages 234-266, February.
    6. Graham Elliott & Allan Timmermann, 2016. "Economic Forecasting," Economics Books, Princeton University Press, edition 1, number 10740.
    7. Sean J. Taylor & Benjamin Letham, 2018. "Forecasting at Scale," The American Statistician, Taylor & Francis Journals, vol. 72(1), pages 37-45, January.
    8. Luc Bauwens & Gary Koop & Dimitris Korobilis & Jeroen V.K. Rombouts, 2015. "The Contribution of Structural Break Models to Forecasting Macroeconomic Series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(4), pages 596-620, June.
    9. Luc Bauwens & Gary Koop & Dimitris Korobilis & Jeroen V.K. Rombouts, 2015. "The Contribution of Structural Break Models to Forecasting Macroeconomic Series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(4), pages 596-620, June.
    10. Lan Luo & Peter X.‐K. Song, 2020. "Renewable estimation and incremental inference in generalized linear models with streaming data sets," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(1), pages 69-97, February.
    11. Nikhil Garg & Hamid Nazerzadeh, 2022. "Driver Surge Pricing," Management Science, INFORMS, vol. 68(5), pages 3219-3235, May.
    12. Dufays, Arnaud & Rombouts, Jeroen V.K., 2020. "Relevant parameter changes in structural break models," Journal of Econometrics, Elsevier, vol. 217(1), pages 46-78.
    13. Jean-Charles Rochet & Jean Tirole, 2003. "Platform Competition in Two-Sided Markets," Journal of the European Economic Association, MIT Press, vol. 1(4), pages 990-1029, June.
    14. Raffaella Giacomini & Barbara Rossi, 2009. "Detecting and Predicting Forecast Breakdowns," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(2), pages 669-705.
    15. Graham Elliott & Allan Timmermann, 2016. "Forecasting in Economics and Finance," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 81-110, October.
    16. Vibhanshu Abhishek & Mustafa Dogan & Alexandre Jacquillat, 2021. "Strategic Timing and Dynamic Pricing for Online Resource Allocation," Management Science, INFORMS, vol. 67(8), pages 4880-4907, August.
    17. Sheng Liu & Long He & Zuo-Jun Max Shen, 2021. "On-Time Last-Mile Delivery: Order Assignment with Travel-Time Predictors," Management Science, INFORMS, vol. 67(7), pages 4095-4119, July.
    18. Boot, Tom & Pick, Andreas, 2020. "Does modeling a structural break improve forecast accuracy?," Journal of Econometrics, Elsevier, vol. 215(1), pages 35-59.
    19. Chib, Siddhartha, 1998. "Estimation and comparison of multiple change-point models," Journal of Econometrics, Elsevier, vol. 86(2), pages 221-241, June.
    20. Pesaran, M. Hashem & Timmermann, Allan, 2007. "Selection of estimation window in the presence of breaks," Journal of Econometrics, Elsevier, vol. 137(1), pages 134-161, March.
    21. Chen, Yudong & Wang, Tengyao & Samworth, Richard J., 2022. "High-dimensional, multiscale online changepoint detection," LSE Research Online Documents on Economics 113665, London School of Economics and Political Science, LSE Library.
    22. Mirko Kremer & Brent Moritz & Enno Siemsen, 2011. "Demand Forecasting Behavior: System Neglect and Change Detection," Management Science, INFORMS, vol. 57(10), pages 1827-1843, October.
    23. Barbara Rossi, 2019. "Forecasting in the Presence of Instabilities: How Do We Know Whether Models Predict Well and How to Improve Them," Working Papers 1162, Barcelona School of Economics.
    24. Killick, Rebecca & Eckley, Idris A., 2014. "changepoint: An R Package for Changepoint Analysis," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 58(i03).
    25. Pesaran, M. Hashem & Pick, Andreas & Pranovich, Mikhail, 2013. "Optimal forecasts in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 177(2), pages 134-152.
    26. Geoffrey G. Parker & Marshall W. Van Alstyne, 2005. "Two-Sided Network Effects: A Theory of Information Product Design," Management Science, INFORMS, vol. 51(10), pages 1494-1504, October.
    27. Barrios, John M. & Hochberg, Yael V. & Yi, Hanyi, 2022. "Launching with a parachute: The gig economy and new business formation," Journal of Financial Economics, Elsevier, vol. 144(1), pages 22-43.
    28. Xiaomo Liu & G. Alan Wang & Weiguo Fan & Zhongju Zhang, 2020. "Finding Useful Solutions in Online Knowledge Communities: A Theory-Driven Design and Multilevel Analysis," Information Systems Research, INFORMS, vol. 31(3), pages 731-752, September.
    29. Fryzlewicz, Piotr, 2014. "Wild binary segmentation for multiple change-point detection," LSE Research Online Documents on Economics 57146, London School of Economics and Political Science, LSE Library.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    2. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    3. Chevillon, Guillaume, 2016. "Multistep forecasting in the presence of location shifts," International Journal of Forecasting, Elsevier, vol. 32(1), pages 121-137.
    4. Anwen Yin, 2024. "Predictive model averaging with parameter instability and heteroskedasticity," Bulletin of Economic Research, Wiley Blackwell, vol. 76(2), pages 418-442, April.
    5. Pablo Guerróon‐Quintana & Molin Zhong, 2023. "Macroeconomic forecasting in times of crises," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(3), pages 295-320, April.
    6. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    7. Bennett, Donyetta & Mekelburg, Erik & Strauss, Jack & Williams, T.H., 2024. "Unlocking the black box of sentiment and cryptocurrency: What, which, why, when and how?," Global Finance Journal, Elsevier, vol. 60(C).
    8. Davide Pettenuzzo & Allan Timmermann, 2017. "Forecasting Macroeconomic Variables Under Model Instability," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(2), pages 183-201, April.
    9. Yongwook Paik & Christos A. Makridis, 2023. "The social value of a ridesharing platform: a hedonic pricing approach," Empirical Economics, Springer, vol. 64(5), pages 2125-2150, May.
    10. David Ardia & Arnaud Dufays & Carlos Ordás Criado, 2024. "Linking Frequentist and Bayesian Change-Point Methods," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(4), pages 1155-1168, October.
    11. Arnaud Dufays & Zhuo Li & Jeroen V.K. Rombouts & Yong Song, 2021. "Sparse change‐point VAR models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 703-727, September.
    12. Moramarco, Graziano, 2024. "Financial-cycle ratios and medium-term predictions of GDP: Evidence from the United States," International Journal of Forecasting, Elsevier, vol. 40(2), pages 777-795.
    13. William J. Procasky & Anwen Yin, 2022. "Forecasting high‐yield equity and CDS index returns: Does observed cross‐market informational flow have predictive power?," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 42(8), pages 1466-1490, August.
    14. Salisu, Afees A. & Adekunle, Wasiu & Alimi, Wasiu A. & Emmanuel, Zachariah, 2019. "Predicting exchange rate with commodity prices: New evidence from Westerlund and Narayan (2015) estimator with structural breaks and asymmetries," Resources Policy, Elsevier, vol. 62(C), pages 33-56.
    15. Kelly Trinh & Bo Zhang & Chenghan Hou, 2025. "Macroeconomic real‐time forecasts of univariate models with flexible error structures," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 44(1), pages 59-78, January.
    16. Luc Bauwens & Gary Koop & Dimitris Korobilis & Jeroen V.K. Rombouts, 2015. "The Contribution of Structural Break Models to Forecasting Macroeconomic Series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(4), pages 596-620, June.
    17. Raffaella Giacomini & Barbara Rossi, 2015. "Forecasting in Nonstationary Environments: What Works and What Doesn't in Reduced-Form and Structural Models," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 207-229, August.
    18. Eraslan, Sercan & Schröder, Maximilian, 2019. "Nowcasting GDP with a large factor model space," Discussion Papers 41/2019, Deutsche Bundesbank.
    19. Jiang, Feiyu & Zhao, Zifeng & Shao, Xiaofeng, 2023. "Time series analysis of COVID-19 infection curve: A change-point perspective," Journal of Econometrics, Elsevier, vol. 232(1), pages 1-17.
    20. Luis Uzeda, 2022. "State Correlation and Forecasting: A Bayesian Approach Using Unobserved Components Models," Advances in Econometrics, in: Essays in Honour of Fabio Canova, volume 44, pages 25-53, Emerald Group Publishing Limited.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2303.01887. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.