IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-51477-5.html
   My bibliography  Save this article

Scalable spatiotemporal prediction with Bayesian neural fields

Author

Listed:
  • Feras Saad

    (Carnegie Mellon University
    Google Research)

  • Jacob Burnim

    (Google Research)

  • Colin Carroll

    (Google Research)

  • Brian Patton

    (Google Research)

  • Urs Köster

    (Google Research)

  • Rif A. Saurous

    (Google Research)

  • Matthew Hoffman

    (Google Research)

Abstract

Spatiotemporal datasets, which consist of spatially-referenced time series, are ubiquitous in diverse applications, such as air pollution monitoring, disease tracking, and cloud-demand forecasting. As the scale of modern datasets increases, there is a growing need for statistical methods that are flexible enough to capture complex spatiotemporal dynamics and scalable enough to handle many observations. This article introduces the Bayesian Neural Field (BayesNF), a domain-general statistical model that infers rich spatiotemporal probability distributions for data-analysis tasks including forecasting, interpolation, and variography. BayesNF integrates a deep neural network architecture for high-capacity function estimation with hierarchical Bayesian inference for robust predictive uncertainty quantification. Evaluations against prominent baselines show that BayesNF delivers improvements on prediction problems from climate and public health data containing tens to hundreds of thousands of measurements. Accompanying the paper is an open-source software package ( https://github.com/google/bayesnf ) that runs on GPU and TPU accelerators through the Jax machine learning platform.

Suggested Citation

  • Feras Saad & Jacob Burnim & Colin Carroll & Brian Patton & Urs Köster & Rif A. Saurous & Matthew Hoffman, 2024. "Scalable spatiotemporal prediction with Bayesian neural fields," Nature Communications, Nature, vol. 15(1), pages 1-17, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-51477-5
    DOI: 10.1038/s41467-024-51477-5
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-51477-5
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-51477-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jung, Jaesung & Broadwater, Robert P., 2014. "Current status and future advances for wind speed and power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 31(C), pages 762-777.
    2. Pebesma, Edzer, 2012. "spacetime: Spatio-Temporal Data in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 51(i07).
    3. Zuoxian Gan & Min Yang & Tao Feng & Harry Timmermans, 2020. "Understanding urban mobility patterns from a spatiotemporal perspective: daily ridership profiles of metro stations," Transportation, Springer, vol. 47(1), pages 315-336, February.
    4. Liu, Yongqi & Qin, Hui & Zhang, Zhendong & Pei, Shaoqian & Jiang, Zhiqiang & Feng, Zhongkai & Zhou, Jianzhong, 2020. "Probabilistic spatiotemporal wind speed forecasting based on a variational Bayesian deep learning model," Applied Energy, Elsevier, vol. 260(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    2. Jafarzadeh Ghoushchi, Saeid & Manjili, Sobhan & Mardani, Abbas & Saraji, Mahyar Kamali, 2021. "An extended new approach for forecasting short-term wind power using modified fuzzy wavelet neural network: A case study in wind power plant," Energy, Elsevier, vol. 223(C).
    3. Niu, Dongxiao & Sun, Lijie & Yu, Min & Wang, Keke, 2022. "Point and interval forecasting of ultra-short-term wind power based on a data-driven method and hybrid deep learning model," Energy, Elsevier, vol. 254(PA).
    4. Zhao, Xinyu & Bai, Mingliang & Yang, Xusheng & Liu, Jinfu & Yu, Daren & Chang, Juntao, 2021. "Short-term probabilistic predictions of wind multi-parameter based on one-dimensional convolutional neural network with attention mechanism and multivariate copula distribution estimation," Energy, Elsevier, vol. 234(C).
    5. Du, Ruoyun & Chen, Hongfei & Yu, Min & Li, Wanying & Niu, Dongxiao & Wang, Keke & Zhang, Zuozhong, 2024. "3DTCN-CBAM-LSTM short-term power multi-step prediction model for offshore wind power based on data space and multi-field cluster spatio-temporal correlation," Applied Energy, Elsevier, vol. 376(PA).
    6. Wang, Yun & Xu, Houhua & Song, Mengmeng & Zhang, Fan & Li, Yifen & Zhou, Shengchao & Zhang, Lingjun, 2023. "A convolutional Transformer-based truncated Gaussian density network with data denoising for wind speed forecasting," Applied Energy, Elsevier, vol. 333(C).
    7. Ma, Long & Huang, Ling & Shi, Huifeng, 2023. "Multi-node wind speed forecasting based on a novel dynamic spatial–temporal graph network," Energy, Elsevier, vol. 285(C).
    8. Yuyang Gao & Chao Qu & Kequan Zhang, 2016. "A Hybrid Method Based on Singular Spectrum Analysis, Firefly Algorithm, and BP Neural Network for Short-Term Wind Speed Forecasting," Energies, MDPI, vol. 9(10), pages 1-28, September.
    9. Rana Muhammad Adnan & Zhongmin Liang & Xiaohui Yuan & Ozgur Kisi & Muhammad Akhlaq & Binquan Li, 2019. "Comparison of LSSVR, M5RT, NF-GP, and NF-SC Models for Predictions of Hourly Wind Speed and Wind Power Based on Cross-Validation," Energies, MDPI, vol. 12(2), pages 1-22, January.
    10. Acikgoz, Hakan & Budak, Umit & Korkmaz, Deniz & Yildiz, Ceyhun, 2021. "WSFNet: An efficient wind speed forecasting model using channel attention-based densely connected convolutional neural network," Energy, Elsevier, vol. 233(C).
    11. Erik Heilmann & Janosch Henze & Heike Wetzel, 2021. "Machine learning in energy forecasts with an application to high frequency electricity consumption data," MAGKS Papers on Economics 202135, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    12. Bakar, Khandoker Shuvo & Sahu, Sujit K., 2015. "spTimer: Spatio-Temporal Bayesian Modeling Using R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 63(i15).
    13. Lixin Li & Xiaolu Zhou & Marc Kalo & Reinhard Piltner, 2016. "Spatiotemporal Interpolation Methods for the Application of Estimating Population Exposure to Fine Particulate Matter in the Contiguous U.S. and a Real-Time Web Application," IJERPH, MDPI, vol. 13(8), pages 1-20, July.
    14. Wang, Xiaodi & Hao, Yan & Yang, Wendong, 2024. "Novel wind power ensemble forecasting system based on mixed-frequency modeling and interpretable base model selection strategy," Energy, Elsevier, vol. 297(C).
    15. Yiqi Chu & Chengcai Li & Yefang Wang & Jing Li & Jian Li, 2016. "A Long-Term Wind Speed Ensemble Forecasting System with Weather Adapted Correction," Energies, MDPI, vol. 9(11), pages 1-20, October.
    16. Santamaría-Bonfil, G. & Reyes-Ballesteros, A. & Gershenson, C., 2016. "Wind speed forecasting for wind farms: A method based on support vector regression," Renewable Energy, Elsevier, vol. 85(C), pages 790-809.
    17. Elisa Frutos-Bernal & Ángel Martín del Rey & Irene Mariñas-Collado & María Teresa Santos-Martín, 2022. "An Analysis of Travel Patterns in Barcelona Metro Using Tucker3 Decomposition," Mathematics, MDPI, vol. 10(7), pages 1-17, March.
    18. Ramirez Camargo, Luis & Gruber, Katharina & Nitsch, Felix, 2019. "Assessing variables of regional reanalysis data sets relevant for modelling small-scale renewable energy systems," Renewable Energy, Elsevier, vol. 133(C), pages 1468-1478.
    19. Lee, Yoonjae & Ha, Byeongmin & Hwangbo, Soonho, 2022. "Generative model-based hybrid forecasting model for renewable electricity supply using long short-term memory networks: A case study of South Korea's energy transition policy," Renewable Energy, Elsevier, vol. 200(C), pages 69-87.
    20. Cheng-Yu Ho & Ke-Sheng Cheng & Chi-Hang Ang, 2023. "Utilizing the Random Forest Method for Short-Term Wind Speed Forecasting in the Coastal Area of Central Taiwan," Energies, MDPI, vol. 16(3), pages 1-18, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-51477-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.