IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v40y2024i3p859-868.html
   My bibliography  Save this article

Deep Probabilistic Koopman: Long-term time-series forecasting under periodic uncertainties

Author

Listed:
  • Mallen, Alex T.
  • Lange, Henning
  • Kutz, J. Nathan

Abstract

This paper introduces general mathematical techniques for stable long-term forecasts with calibrated uncertainty measures. For most time series models, the difficulty of obtaining accurate probabilistic future time step predictions increases with the prediction horizon. We propose a surprisingly simple class of models that characterizes time-varying distributions and enables reasonably accurate predictions thousands of time steps into the future. This technique, called Deep Probabilistic Koopman (DPK), is based on recent advances in linear Koopman operator theory and does not require time stepping for future time predictions. We demonstrate the long-term forecasting performance of these models on a diversity of domains, including electricity demand forecasting, atmospheric chemistry, and neuroscience. Our domain-agnostic technique outperforms all 177 domain-specific competitors in the most recent Global Energy Forecasting Competition for electricity demand modelling.

Suggested Citation

  • Mallen, Alex T. & Lange, Henning & Kutz, J. Nathan, 2024. "Deep Probabilistic Koopman: Long-term time-series forecasting under periodic uncertainties," International Journal of Forecasting, Elsevier, vol. 40(3), pages 859-868.
  • Handle: RePEc:eee:intfor:v:40:y:2024:i:3:p:859-868
    DOI: 10.1016/j.ijforecast.2023.07.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207023000717
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2023.07.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. J. Nathan Kutz & J. L. Proctor & S. L. Brunton, 2018. "Applied Koopman Theory for Partial Differential Equations and Data-Driven Modeling of Spatio-Temporal Systems," Complexity, Hindawi, vol. 2018, pages 1-16, December.
    2. Hong, Tao & Xie, Jingrui & Black, Jonathan, 2019. "Global energy forecasting competition 2017: Hierarchical probabilistic load forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1389-1399.
    3. Ziel, Florian, 2019. "Quantile regression for the qualifying match of GEFCom2017 probabilistic load forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1400-1408.
    4. Roger Koenker & Kevin F. Hallock, 2001. "Quantile Regression," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 143-156, Fall.
    5. David M. Blei & Alp Kucukelbir & Jon D. McAuliffe, 2017. "Variational Inference: A Review for Statisticians," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(518), pages 859-877, April.
    6. Smyl, Slawek & Hua, N. Grace, 2019. "Machine learning methods for GEFCom2017 probabilistic load forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1424-1431.
    7. Bethany Lusch & J. Nathan Kutz & Steven L. Brunton, 2018. "Deep learning for universal linear embeddings of nonlinear dynamics," Nature Communications, Nature, vol. 9(1), pages 1-10, December.
    8. Steven L Brunton & Bingni W Brunton & Joshua L Proctor & J Nathan Kutz, 2016. "Koopman Invariant Subspaces and Finite Linear Representations of Nonlinear Dynamical Systems for Control," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-19, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Monika Zimmermann & Florian Ziel, 2024. "Efficient mid-term forecasting of hourly electricity load using generalized additive models," Papers 2405.17070, arXiv.org.
    2. Xu, Xiuqin & Chen, Ying & Goude, Yannig & Yao, Qiwei, 2021. "Day-ahead probabilistic forecasting for French half-hourly electricity loads and quantiles for curve-to-curve regression," LSE Research Online Documents on Economics 120774, London School of Economics and Political Science, LSE Library.
    3. Chen, Zhong & Chen, Xiaofang & Liu, Jinping & Cen, Lihui & Gui, Weihua, 2024. "Learning model predictive control of nonlinear systems with time-varying parameters using Koopman operator," Applied Mathematics and Computation, Elsevier, vol. 470(C).
    4. Xu, Xiuqin & Chen, Ying & Goude, Yannig & Yao, Qiwei, 2021. "Day-ahead probabilistic forecasting for French half-hourly electricity loads and quantiles for curve-to-curve regression," Applied Energy, Elsevier, vol. 301(C).
    5. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    6. Richard Bean, 2023. "Forecasting the Monash Microgrid for the IEEE-CIS Technical Challenge," Energies, MDPI, vol. 16(3), pages 1-23, January.
    7. Akosah, Nana Kwame & Alagidede, Imhotep Paul & Schaling, Eric, 2020. "Testing for asymmetry in monetary policy rule for small-open developing economies: Multiscale Bayesian quantile evidence from Ghana," The Journal of Economic Asymmetries, Elsevier, vol. 22(C).
    8. Paul Hewson & Keming Yu, 2008. "Quantile regression for binary performance indicators," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 24(5), pages 401-418, September.
    9. Héctor Manuel Zárate S., 2005. "Cambios en la estructura salarial: una historia desde la regresión cuanfílica," Monetaria, CEMLA, vol. 0(4), pages 339-364, octubre-d.
    10. Efobi, Uchenna & Asongu, Simplice & Okafor, Chinelo & Tchamyou, Vanessa & Tanankem, Belmondo, 2016. "Diaspora Remittance Inflow, Financial Development and the Industrialisation of Africa," MPRA Paper 76121, University Library of Munich, Germany.
    11. Fernando Antonio Slaibe Postali, 2016. "Oil windfalls and X-inefficiency: evidence from Brazil," Journal of Economic Studies, Emerald Group Publishing Limited, vol. 43(5), pages 699-718, October.
    12. Leon Zolotoy & Don O’Sullivan & Keke Song, 2021. "The Role of Ethical Standards in the Relationship Between Religious Social Norms and M&A Announcement Returns," Journal of Business Ethics, Springer, vol. 170(4), pages 721-742, May.
    13. Aboura, Sofiane & Chevallier, Julien, 2016. "Spikes and crashes in the oil market," Research in International Business and Finance, Elsevier, vol. 36(C), pages 615-623.
    14. Trojanek, Radoslaw & Huderek-Glapska, Sonia, 2018. "Measuring the noise cost of aviation – The association between the Limited Use Area around Warsaw Chopin Airport and property values," Journal of Air Transport Management, Elsevier, vol. 67(C), pages 103-114.
    15. Paulo M.M. Rodrigues & Rita Fradique Lourenço, 2015. "House prices: bubbles, exuberance or something else? Evidence from euro area countries," Working Papers w201517, Banco de Portugal, Economics and Research Department.
    16. repec:rre:publsh:v:39:y:2009:i:2:p:149-69 is not listed on IDEAS
    17. Muller, Christophe, 2018. "Heterogeneity and nonconstant effect in two-stage quantile regression," Econometrics and Statistics, Elsevier, vol. 8(C), pages 3-12.
    18. Juan Mora & Antonia Febrer, 2005. "Wage Distribution In Spain, 1994-1999: An Application Of A Flexible Estimator Of Conditional Distributions," Working Papers. Serie EC 2005-04, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    19. Xiaoying Liu & Jere R. Behrman & Emily Hannum & Fan Wang & Qingguo Zhao, 2022. "Same environment, stratified impacts? Air pollution, extreme temperatures, and birth weight in south China," Papers 2204.00219, arXiv.org.
    20. Simplice A. Asongu & Uchenna R. Efobi & Ibukun Beecroft, 2021. "Aid in Modulating the Impact of Terrorism on FDI: No Positive Thresholds, No Policy," Forum for Social Economics, Taylor & Francis Journals, vol. 50(4), pages 432-456, October.
    21. Asongu, Simplice A., 2017. "Assessing marginal, threshold, and net effects of financial globalisation on financial development in Africa," Journal of Multinational Financial Management, Elsevier, vol. 40(C), pages 103-114.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:40:y:2024:i:3:p:859-868. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.