IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v357y2024ics0306261923018020.html
   My bibliography  Save this article

Dependence structure learning and joint probabilistic forecasting of stochastic power grid variables

Author

Listed:
  • Stover, Oliver
  • Nath, Paromita
  • Karve, Pranav
  • Mahadevan, Sankaran
  • Baroud, Hiba

Abstract

Stochastic optimization is a promising approach to support a reliable and cost-efficient transition to a renewable generation-dominated power grid. However, utilization of this approach requires accurate and computationally affordable probabilistic forecasts that rigorously quantify the uncertainty in and the correlation between stochastic grid variables (wind/solar generation and load demand). We investigate and compare two types of probabilistic forecasting model architectures for jointly predicting stochastic variables in a power grid: sequence-to-sequence models and recursive one step ahead prediction models. A long short-term memory (LSTM) neural network model is chosen to represent sequence-to-sequence deep learning models and a periodic vector autoregressive (PVAR) model is chosen to represent the one step ahead recursive models. For each model architecture, we consider three forecasting approaches: predicting each time series variable separately, jointly predicting all time series variables of a given type (e.g., wind generation or load), or jointly predicting all time series variables. We quantify the predictive capability of these forecasting models with respect to accuracy degradation with increasing prediction horizon, ability to characterize uncertainty, and ability to capture cross-variable dependence structure. We train and test the forecasting models using publicly available zonal power supply and demand time series data for the French power grid. We find that different modeling architectures/approaches show superior forecasting capability for different prediction horizons. Our results show that in general, one step-ahead recursive (PVAR) models have high prediction accuracy for short forecast horizons, and sequence-to-sequence (LSTM) models have slower performance degradation for longer forecast horizons.

Suggested Citation

  • Stover, Oliver & Nath, Paromita & Karve, Pranav & Mahadevan, Sankaran & Baroud, Hiba, 2024. "Dependence structure learning and joint probabilistic forecasting of stochastic power grid variables," Applied Energy, Elsevier, vol. 357(C).
  • Handle: RePEc:eee:appene:v:357:y:2024:i:c:s0306261923018020
    DOI: 10.1016/j.apenergy.2023.122438
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923018020
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2023.122438?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bingqing Huang & Haonan Zheng & Xinbo Guo & Yi Yang & Ximing Liu, 2021. "A Novel Model Based on DA-RNN Network and Skip Gated Recurrent Neural Network for Periodic Time Series Forecasting," Sustainability, MDPI, vol. 14(1), pages 1-14, December.
    2. Guo, Zhenhai & Zhao, Jing & Zhang, Wenyu & Wang, Jianzhou, 2011. "A corrected hybrid approach for wind speed prediction in Hexi Corridor of China," Energy, Elsevier, vol. 36(3), pages 1668-1679.
    3. Zhang, Menghan & Yang, Zhifang & Lin, Wei & Yu, Juan & Li, Wenyuan, 2022. "Internalization of reliability unit commitment in day-ahead market: Analysis and interpretation," Applied Energy, Elsevier, vol. 326(C).
    4. Gao, Bixuan & Huang, Xiaoqiao & Shi, Junsheng & Tai, Yonghang & Zhang, Jun, 2020. "Hourly forecasting of solar irradiance based on CEEMDAN and multi-strategy CNN-LSTM neural networks," Renewable Energy, Elsevier, vol. 162(C), pages 1665-1683.
    5. Tianhe Sun & Tieyan Zhang & Yun Teng & Zhe Chen & Jiakun Fang, 2019. "Monthly Electricity Consumption Forecasting Method Based on X12 and STL Decomposition Model in an Integrated Energy System," Mathematical Problems in Engineering, Hindawi, vol. 2019, pages 1-16, October.
    6. Hong, Tao & Pinson, Pierre & Fan, Shu & Zareipour, Hamidreza & Troccoli, Alberto & Hyndman, Rob J., 2016. "Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond," International Journal of Forecasting, Elsevier, vol. 32(3), pages 896-913.
    7. Mashlakov, Aleksei & Kuronen, Toni & Lensu, Lasse & Kaarna, Arto & Honkapuro, Samuli, 2021. "Assessing the performance of deep learning models for multivariate probabilistic energy forecasting," Applied Energy, Elsevier, vol. 285(C).
    8. Heo, Jae & Song, Kwonsik & Han, SangUk & Lee, Dong-Eun, 2021. "Multi-channel convolutional neural network for integration of meteorological and geographical features in solar power forecasting," Applied Energy, Elsevier, vol. 295(C).
    9. Florian Ziel & Kevin Berk, 2019. "Multivariate Forecasting Evaluation: On Sensitive and Strictly Proper Scoring Rules," Papers 1910.07325, arXiv.org.
    10. Philippe Lauret & Mathieu David & Hugo T. C. Pedro, 2017. "Probabilistic Solar Forecasting Using Quantile Regression Models," Energies, MDPI, vol. 10(10), pages 1-17, October.
    11. Eugen Ursu & Pierre Duchesne, 2009. "On modelling and diagnostic checking of vector periodic autoregressive time series models," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(1), pages 70-96, January.
    12. Wei, Danxiang & Wang, Jianzhou & Niu, Xinsong & Li, Zhiwu, 2021. "Wind speed forecasting system based on gated recurrent units and convolutional spiking neural networks," Applied Energy, Elsevier, vol. 292(C).
    13. Nguyen, H.D. & Tran, K.P. & Thomassey, S. & Hamad, M., 2021. "Forecasting and Anomaly Detection approaches using LSTM and LSTM Autoencoder techniques with the applications in supply chain management," International Journal of Information Management, Elsevier, vol. 57(C).
    14. Liu, Yongqi & Qin, Hui & Zhang, Zhendong & Pei, Shaoqian & Jiang, Zhiqiang & Feng, Zhongkai & Zhou, Jianzhong, 2020. "Probabilistic spatiotemporal wind speed forecasting based on a variational Bayesian deep learning model," Applied Energy, Elsevier, vol. 260(C).
    15. Sloughter, J. McLean & Gneiting, Tilmann & Raftery, Adrian E., 2010. "Probabilistic Wind Speed Forecasting Using Ensembles and Bayesian Model Averaging," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 25-35.
    16. Tilmann Gneiting & Larissa Stanberry & Eric Grimit & Leonhard Held & Nicholas Johnson, 2008. "Rejoinder on: Assessing probabilistic forecasts of multivariate quantities, with an application to ensemble predictions of surface winds," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 17(2), pages 256-264, August.
    17. Tilmann Gneiting & Larissa Stanberry & Eric Grimit & Leonhard Held & Nicholas Johnson, 2008. "Assessing probabilistic forecasts of multivariate quantities, with an application to ensemble predictions of surface winds," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 17(2), pages 211-235, August.
    18. Stover, Oliver & Karve, Pranav & Mahadevan, Sankaran, 2023. "Reliability and risk metrics to assess operational adequacy and flexibility of power grids," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    19. Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268, April.
    20. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    21. Daraeepour, Ali & Patino-Echeverri, Dalia & Conejo, Antonio J., 2019. "Economic and environmental implications of different approaches to hedge against wind production uncertainty in two-settlement electricity markets: A PJM case study," Energy Economics, Elsevier, vol. 80(C), pages 336-354.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Malte Knuppel & Fabian Kruger & Marc-Oliver Pohle, 2022. "Score-based calibration testing for multivariate forecast distributions," Papers 2211.16362, arXiv.org, revised Dec 2023.
    3. Gensler, André & Sick, Bernhard & Vogt, Stephan, 2018. "A review of uncertainty representations and metaverification of uncertainty assessment techniques for renewable energies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 96(C), pages 352-379.
    4. Dumas, Jonathan & Wehenkel, Antoine & Lanaspeze, Damien & Cornélusse, Bertrand & Sutera, Antonio, 2022. "A deep generative model for probabilistic energy forecasting in power systems: normalizing flows," Applied Energy, Elsevier, vol. 305(C).
    5. Zhang, Yao & Wang, Jianxue & Wang, Xifan, 2014. "Review on probabilistic forecasting of wind power generation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 32(C), pages 255-270.
    6. Warne, Anders, 2023. "DSGE model forecasting: rational expectations vs. adaptive learning," Working Paper Series 2768, European Central Bank.
    7. Jenny Brynjarsdottir & Jonathan Hobbs & Amy Braverman & Lukas Mandrake, 2018. "Optimal Estimation Versus MCMC for $$\mathrm{{CO}}_{2}$$ CO 2 Retrievals," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 23(2), pages 297-316, June.
    8. Florian Ziel & Kevin Berk, 2019. "Multivariate Forecasting Evaluation: On Sensitive and Strictly Proper Scoring Rules," Papers 1910.07325, arXiv.org.
    9. Braun, Julia & Sabanés Bové, Daniel & Held, Leonhard, 2014. "Choice of generalized linear mixed models using predictive crossvalidation," Computational Statistics & Data Analysis, Elsevier, vol. 75(C), pages 190-202.
    10. Grothe, Oliver & Kächele, Fabian & Krüger, Fabian, 2023. "From point forecasts to multivariate probabilistic forecasts: The Schaake shuffle for day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 120(C).
    11. Thordis L. Thorarinsdottir & Tilmann Gneiting, 2010. "Probabilistic forecasts of wind speed: ensemble model output statistics by using heteroscedastic censored regression," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(2), pages 371-388, April.
    12. Allen, Sam & Koh, Jonathan & Segers, Johan & Ziegel, Johanna, 2024. "Tail calibration of probabilistic forecasts," LIDAM Discussion Papers ISBA 2024018, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    13. van der Meer, Dennis & Wang, Guang Chao & Munkhammar, Joakim, 2021. "An alternative optimal strategy for stochastic model predictive control of a residential battery energy management system with solar photovoltaic," Applied Energy, Elsevier, vol. 283(C).
    14. Oliver Grothe & Fabian Kachele & Fabian Kruger, 2022. "From point forecasts to multivariate probabilistic forecasts: The Schaake shuffle for day-ahead electricity price forecasting," Papers 2204.10154, arXiv.org.
    15. Arrieta-Prieto, Mario & Schell, Kristen R., 2022. "Spatio-temporal probabilistic forecasting of wind power for multiple farms: A copula-based hybrid model," International Journal of Forecasting, Elsevier, vol. 38(1), pages 300-320.
    16. Yang, Dazhi & Wang, Wenting & Gueymard, Christian A. & Hong, Tao & Kleissl, Jan & Huang, Jing & Perez, Marc J. & Perez, Richard & Bright, Jamie M. & Xia, Xiang’ao & van der Meer, Dennis & Peters, Ian , 2022. "A review of solar forecasting, its dependence on atmospheric sciences and implications for grid integration: Towards carbon neutrality," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    17. L. Held & K. Rufibach & F. Balabdaoui, 2010. "A Score Regression Approach to Assess Calibration of Continuous Probabilistic Predictions," Biometrics, The International Biometric Society, vol. 66(4), pages 1295-1305, December.
    18. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    19. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    20. Yang, Dazhi & van der Meer, Dennis, 2021. "Post-processing in solar forecasting: Ten overarching thinking tools," Renewable and Sustainable Energy Reviews, Elsevier, vol. 140(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:357:y:2024:i:c:s0306261923018020. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.