IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v300y2024ics0360544224013173.html
   My bibliography  Save this article

Probabilistic wind power forecasting resilient to missing values: An adaptive quantile regression approach

Author

Listed:
  • Wen, Honglin

Abstract

Probabilistic wind power forecasting approaches have significantly advanced in recent decades. However, forecasters often assume data completeness and overlook the challenge of missing values resulting from sensor failures, network congestion, etc. Traditionally, this issue is addressed during the data preprocessing procedure using methods such as deletion and imputation. Nevertheless, these ad-hoc methods pose challenges to probabilistic wind power forecasting at both parameter estimation and operational forecasting stages. In this paper, we propose a resilient probabilistic forecasting approach that smoothly adapts to missingness patterns without requiring preprocessing or retraining. Specifically, we design an adaptive quantile regression model with parameters capable of adapting to missing patterns, comprising two modules. The first is a feature extraction module where weights are kept static and biases are designed as a function of missingness patterns. The second is a non-crossing quantile neural network module, ensuring monotonicity of quantiles, with higher quantiles derived by adding non-negative amounts to lower quantiles. The proposed approach is applicable to cases under all missingness mechanisms including missing-not-at-random cases. Case studies demonstrate that our proposed approach achieves state-of-the-art results in terms of the continuous ranked probability score, with acceptable computational cost.

Suggested Citation

  • Wen, Honglin, 2024. "Probabilistic wind power forecasting resilient to missing values: An adaptive quantile regression approach," Energy, Elsevier, vol. 300(C).
  • Handle: RePEc:eee:energy:v:300:y:2024:i:c:s0360544224013173
    DOI: 10.1016/j.energy.2024.131544
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224013173
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2024.131544?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yuan, Ran & Wang, Bo & Mao, Zhixin & Watada, Junzo, 2021. "Multi-objective wind power scenario forecasting based on PG-GAN," Energy, Elsevier, vol. 226(C).
    2. Conor Sweeney & Ricardo J. Bessa & Jethro Browell & Pierre Pinson, 2020. "The future of forecasting for renewable energy," Wiley Interdisciplinary Reviews: Energy and Environment, Wiley Blackwell, vol. 9(2), March.
    3. Salinas, David & Flunkert, Valentin & Gasthaus, Jan & Januschowski, Tim, 2020. "DeepAR: Probabilistic forecasting with autoregressive recurrent networks," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1181-1191.
    4. Gallego-Castillo, Cristobal & Bessa, Ricardo & Cavalcante, Laura & Lopez-Garcia, Oscar, 2016. "On-line quantile regression in the RKHS (Reproducing Kernel Hilbert Space) for operational probabilistic forecasting of wind power," Energy, Elsevier, vol. 113(C), pages 355-365.
    5. Draxl, Caroline & Clifton, Andrew & Hodge, Bri-Mathias & McCaa, Jim, 2015. "The Wind Integration National Dataset (WIND) Toolkit," Applied Energy, Elsevier, vol. 151(C), pages 355-366.
    6. Sareen, Karan & Panigrahi, Bijaya Ketan & Shikhola, Tushar & Chawla, Astha, 2023. "A robust De-Noising Autoencoder imputation and VMD algorithm based deep learning technique for short-term wind speed prediction ensuring cyber resilience," Energy, Elsevier, vol. 283(C).
    7. Roger Koenker & Kevin F. Hallock, 2001. "Quantile Regression," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 143-156, Fall.
    8. Sun, Chuan & Chen, Yueyi & Cheng, Cheng, 2021. "Imputation of missing data from offshore wind farms using spatio-temporal correlation and feature correlation," Energy, Elsevier, vol. 229(C).
    9. Landry, Mark & Erlinger, Thomas P. & Patschke, David & Varrichio, Craig, 2016. "Probabilistic gradient boosting machines for GEFCom2014 wind forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1061-1066.
    10. Chen, Yaoran & Cai, Candong & Cao, Leilei & Zhang, Dan & Kuang, Limin & Peng, Yan & Pu, Huayan & Wu, Chuhan & Zhou, Dai & Cao, Yong, 2024. "WindFix: Harnessing the power of self-supervised learning for versatile imputation of offshore wind speed time series," Energy, Elsevier, vol. 287(C).
    11. Lu, Shixiang & Xu, Qifa & Jiang, Cuixia & Liu, Yezheng & Kusiak, Andrew, 2022. "Probabilistic load forecasting with a non-crossing sparse-group Lasso-quantile regression deep neural network," Energy, Elsevier, vol. 242(C).
    12. Wang, Huaizhi & Xue, Wenli & Liu, Yitao & Peng, Jianchun & Jiang, Hui, 2020. "Probabilistic wind power forecasting based on spiking neural network," Energy, Elsevier, vol. 196(C).
    13. Morshedizadeh, Majid & Kordestani, Mojtaba & Carriveau, Rupp & Ting, David S.-K. & Saif, Mehrdad, 2017. "Application of imputation techniques and Adaptive Neuro-Fuzzy Inference System to predict wind turbine power production," Energy, Elsevier, vol. 138(C), pages 394-404.
    14. Sommer, Benedikt & Pinson, Pierre & Messner, Jakob W. & Obst, David, 2021. "Online distributed learning in wind power forecasting," International Journal of Forecasting, Elsevier, vol. 37(1), pages 205-223.
    15. Fan, Huijing & Zhen, Zhao & Liu, Nian & Sun, Yiqian & Chang, Xiqiang & Li, Yu & Wang, Fei & Mi, Zengqiang, 2023. "Fluctuation pattern recognition based ultra-short-term wind power probabilistic forecasting method," Energy, Elsevier, vol. 266(C).
    16. Dong, Weichao & Sun, Hexu & Tan, Jianxin & Li, Zheng & Zhang, Jingxuan & Yang, Huifang, 2022. "Regional wind power probabilistic forecasting based on an improved kernel density estimation, regular vine copulas, and ensemble learning," Energy, Elsevier, vol. 238(PC).
    17. Liu, Jiarui & Fu, Yuchen, 2023. "Renewable energy forecasting: A self-supervised learning-based transformer variant," Energy, Elsevier, vol. 284(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wen, Honglin & Pinson, Pierre & Gu, Jie & Jin, Zhijian, 2024. "Wind energy forecasting with missing values within a fully conditional specification framework," International Journal of Forecasting, Elsevier, vol. 40(1), pages 77-95.
    2. Dumas, Jonathan & Wehenkel, Antoine & Lanaspeze, Damien & Cornélusse, Bertrand & Sutera, Antonio, 2022. "A deep generative model for probabilistic energy forecasting in power systems: normalizing flows," Applied Energy, Elsevier, vol. 305(C).
    3. Fan, Huijing & Zhen, Zhao & Liu, Nian & Sun, Yiqian & Chang, Xiqiang & Li, Yu & Wang, Fei & Mi, Zengqiang, 2023. "Fluctuation pattern recognition based ultra-short-term wind power probabilistic forecasting method," Energy, Elsevier, vol. 266(C).
    4. Spiliotis, Evangelos & Makridakis, Spyros & Kaltsounis, Anastasios & Assimakopoulos, Vassilios, 2021. "Product sales probabilistic forecasting: An empirical evaluation using the M5 competition data," International Journal of Production Economics, Elsevier, vol. 240(C).
    5. Sun, Mucun & Feng, Cong & Zhang, Jie, 2020. "Multi-distribution ensemble probabilistic wind power forecasting," Renewable Energy, Elsevier, vol. 148(C), pages 135-149.
    6. Lu, Shixiang & Xu, Qifa & Jiang, Cuixia & Liu, Yezheng & Kusiak, Andrew, 2022. "Probabilistic load forecasting with a non-crossing sparse-group Lasso-quantile regression deep neural network," Energy, Elsevier, vol. 242(C).
    7. Han, Chanok & Vinel, Alexander, 2022. "Reducing forecasting error by optimally pooling wind energy generation sources through portfolio optimization," Energy, Elsevier, vol. 239(PB).
    8. Li, Yanting & Peng, Xinghao & Zhang, Yu, 2022. "Forecasting methods for wind power scenarios of multiple wind farms based on spatio-temporal dependency structure," Renewable Energy, Elsevier, vol. 201(P1), pages 950-960.
    9. Yun, Eunjeong & Hur, Jin, 2021. "Probabilistic estimation model of power curve to enhance power output forecasting of wind generating resources," Energy, Elsevier, vol. 223(C).
    10. Zhang, Wenjie & Quan, Hao & Srinivasan, Dipti, 2018. "Parallel and reliable probabilistic load forecasting via quantile regression forest and quantile determination," Energy, Elsevier, vol. 160(C), pages 810-819.
    11. Baggio, Roberta & Muzy, Jean-François, 2024. "Improving probabilistic wind speed forecasting using M-Rice distribution and spatial data integration," Applied Energy, Elsevier, vol. 360(C).
    12. Liu, Xin & Yang, Luoxiao & Zhang, Zijun, 2022. "The attention-assisted ordinary differential equation networks for short-term probabilistic wind power predictions," Applied Energy, Elsevier, vol. 324(C).
    13. Liu, Yin & Davanloo Tajbakhsh, Sam & Conejo, Antonio J., 2021. "Spatiotemporal wind forecasting by learning a hierarchically sparse inverse covariance matrix using wind directions," International Journal of Forecasting, Elsevier, vol. 37(2), pages 812-824.
    14. Pierre Pinson & Liyang Han & Jalal Kazempour, 2022. "Regression markets and application to energy forecasting," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(3), pages 533-573, October.
    15. Hu, Jinxing & Li, Hongru, 2022. "A transfer learning-based scenario generation method for stochastic optimal scheduling of microgrid with newly-built wind farm," Renewable Energy, Elsevier, vol. 185(C), pages 1139-1151.
    16. González-Sopeña, J.M. & Pakrashi, V. & Ghosh, B., 2021. "An overview of performance evaluation metrics for short-term statistical wind power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 138(C).
    17. Montero-Manso, Pablo & Hyndman, Rob J., 2021. "Principles and algorithms for forecasting groups of time series: Locality and globality," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1632-1653.
    18. Felix Wick & Ulrich Kerzel & Martin Hahn & Moritz Wolf & Trapti Singhal & Daniel Stemmer & Jakob Ernst & Michael Feindt, 2021. "Demand Forecasting of Individual Probability Density Functions with Machine Learning," SN Operations Research Forum, Springer, vol. 2(3), pages 1-39, September.
    19. Lin, Qingcheng & Cai, Huiling & Liu, Hanwei & Li, Xuefeng & Xiao, Hui, 2024. "A novel ultra-short-term wind power prediction model jointly driven by multiple algorithm optimization and adaptive selection," Energy, Elsevier, vol. 288(C).
    20. Sun, Mucun & Feng, Cong & Chartan, Erol Kevin & Hodge, Bri-Mathias & Zhang, Jie, 2019. "A two-step short-term probabilistic wind forecasting methodology based on predictive distribution optimization," Applied Energy, Elsevier, vol. 238(C), pages 1497-1505.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:300:y:2024:i:c:s0360544224013173. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.