IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v376y2024ipas030626192401451x.html
   My bibliography  Save this article

Physics-informed reinforcement learning for probabilistic wind power forecasting under extreme events

Author

Listed:
  • Liu, Yanli
  • Wang, Junyi
  • Liu, Liqi

Abstract

With wind power penetration increases, accurate and reliable wind power forecasting is becoming gradually critical, and data driven model is a promising solution to implement this task. However, limited by deficient data samples under extreme conditions, scarcity of feature measurements fails to meet the number of training samples required, making the forecasting model exhibits low adaptability. This paper proposes a physics-informed reinforcement learning based method for probabilistic forecasting. Analytical physical expression of wind power output under extreme event is established to construct the error evaluation function for abrupt feature. Deep deterministic policy gradient-based quantile fitting model is then proposed, with abrupt feature embedded as the auxiliary input data for neural network. On this basis, parameter training technique under small data set is proposed to deal with the effect of extreme conditions on correction process of network. It extracts key historical transitions from experience replay pool to establish effective training samples, and model parameters are updated through the small-batch learning strategy to minimize long-term error feedback. Test result on the practical cold wave event of wind farms in China shows effectiveness of the proposed method.

Suggested Citation

  • Liu, Yanli & Wang, Junyi & Liu, Liqi, 2024. "Physics-informed reinforcement learning for probabilistic wind power forecasting under extreme events," Applied Energy, Elsevier, vol. 376(PA).
  • Handle: RePEc:eee:appene:v:376:y:2024:i:pa:s030626192401451x
    DOI: 10.1016/j.apenergy.2024.124068
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S030626192401451X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2024.124068?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jung, Jaesung & Broadwater, Robert P., 2014. "Current status and future advances for wind speed and power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 31(C), pages 762-777.
    2. Maosong Fan & Mengmeng Geng & Kai Yang & Mingjie Zhang & Hao Liu, 2023. "State of Health Estimation of Lithium-Ion Battery Based on Electrochemical Impedance Spectroscopy," Energies, MDPI, vol. 16(8), pages 1-14, April.
    3. Zhang, Shuxin & Liu, Zhitao & Su, Hongye, 2023. "State of health estimation for lithium-ion batteries on few-shot learning," Energy, Elsevier, vol. 268(C).
    4. Meng, Jinhao & You, Yuqiang & Lin, Mingqiang & Wu, Ji & Song, Zhengxiang, 2024. "Multi-scenarios transferable learning framework with few-shot for early lithium-ion battery lifespan trajectory prediction," Energy, Elsevier, vol. 286(C).
    5. Liu, Yanli & Wang, Junyi, 2022. "Transfer learning based multi-layer extreme learning machine for probabilistic wind power forecasting," Applied Energy, Elsevier, vol. 312(C).
    6. Zhang, Jinhua & Yan, Jie & Infield, David & Liu, Yongqian & Lien, Fue-sang, 2019. "Short-term forecasting and uncertainty analysis of wind turbine power based on long short-term memory network and Gaussian mixture model," Applied Energy, Elsevier, vol. 241(C), pages 229-244.
    7. Lahouar, A. & Ben Hadj Slama, J., 2017. "Hour-ahead wind power forecast based on random forests," Renewable Energy, Elsevier, vol. 109(C), pages 529-541.
    8. Wu, Zhuochun & Xia, Xiangjie & Xiao, Liye & Liu, Yilin, 2020. "Combined model with secondary decomposition-model selection and sample selection for multi-step wind power forecasting," Applied Energy, Elsevier, vol. 261(C).
    9. P. Pinson, 2012. "Very-short-term probabilistic forecasting of wind power with generalized logit–normal distributions," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 61(4), pages 555-576, August.
    10. Li, Xining & Ju, Lingling & Geng, Guangchao & Jiang, Quanyuan, 2023. "Data-driven state-of-health estimation for lithium-ion battery based on aging features," Energy, Elsevier, vol. 274(C).
    11. González-Sopeña, J.M. & Pakrashi, V. & Ghosh, B., 2021. "An overview of performance evaluation metrics for short-term statistical wind power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 138(C).
    12. Yang, Ting & Yang, Zhenning & Li, Fei & Wang, Hengyu, 2024. "A short-term wind power forecasting method based on multivariate signal decomposition and variable selection," Applied Energy, Elsevier, vol. 360(C).
    13. Jooyoung Jeon & James W. Taylor, 2012. "Using Conditional Kernel Density Estimation for Wind Power Density Forecasting," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 66-79, March.
    14. Jeong, Jaeik & Kim, Hongseok, 2021. "DeepComp: Deep reinforcement learning based renewable energy error compensable forecasting," Applied Energy, Elsevier, vol. 294(C).
    15. Esen, Hikmet & Inalli, Mustafa & Sengur, Abdulkadir & Esen, Mehmet, 2008. "Modeling a ground-coupled heat pump system by a support vector machine," Renewable Energy, Elsevier, vol. 33(8), pages 1814-1823.
    16. Sun, Mucun & Feng, Cong & Chartan, Erol Kevin & Hodge, Bri-Mathias & Zhang, Jie, 2019. "A two-step short-term probabilistic wind forecasting methodology based on predictive distribution optimization," Applied Energy, Elsevier, vol. 238(C), pages 1497-1505.
    17. Shen, Jiangwei & Ma, Wensai & Shu, Xing & Shen, Shiquan & Chen, Zheng & Liu, Yonggang, 2023. "Accurate state of health estimation for lithium-ion batteries under random charging scenarios," Energy, Elsevier, vol. 279(C).
    18. Zhang, Wenyu & Zhang, Lifang & Wang, Jianzhou & Niu, Xinsong, 2020. "Hybrid system based on a multi-objective optimization and kernel approximation for multi-scale wind speed forecasting," Applied Energy, Elsevier, vol. 277(C).
    19. Wang, Jianzhou & Song, Yiliao & Liu, Feng & Hou, Ru, 2016. "Analysis and application of forecasting models in wind power integration: A review of multi-step-ahead wind speed forecasting models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 60(C), pages 960-981.
    20. Wang, Huai-zhi & Li, Gang-qiang & Wang, Gui-bin & Peng, Jian-chun & Jiang, Hui & Liu, Yi-tao, 2017. "Deep learning based ensemble approach for probabilistic wind power forecasting," Applied Energy, Elsevier, vol. 188(C), pages 56-70.
    21. Meng, Anbo & Chen, Shu & Ou, Zuhong & Xiao, Jianhua & Zhang, Jianfeng & Chen, Shun & Zhang, Zheng & Liang, Ruduo & Zhang, Zhan & Xian, Zikang & Wang, Chenen & Yin, Hao & Yan, Baiping, 2022. "A novel few-shot learning approach for wind power prediction applying secondary evolutionary generative adversarial network," Energy, Elsevier, vol. 261(PA).
    22. Liu, Hui & Yu, Chengqing & Wu, Haiping & Duan, Zhu & Yan, Guangxi, 2020. "A new hybrid ensemble deep reinforcement learning model for wind speed short term forecasting," Energy, Elsevier, vol. 202(C).
    23. Liu, Xinghua & Li, Siqi & Tian, Jiaqiang & Wei, Zhongbao & Wang, Peng, 2023. "Health estimation of lithium-ion batteries with voltage reconstruction and fusion model," Energy, Elsevier, vol. 282(C).
    24. Zhao, Hongqian & Chen, Zheng & Shu, Xing & Shen, Jiangwei & Lei, Zhenzhen & Zhang, Yuanjian, 2023. "State of health estimation for lithium-ion batteries based on hybrid attention and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    25. Wang, Cong & Zhang, Hongli & Ma, Ping, 2020. "Wind power forecasting based on singular spectrum analysis and a new hybrid Laguerre neural network," Applied Energy, Elsevier, vol. 259(C).
    26. Zhou, Xinlei & Lin, Wenye & Kumar, Ritunesh & Cui, Ping & Ma, Zhenjun, 2022. "A data-driven strategy using long short term memory models and reinforcement learning to predict building electricity consumption," Applied Energy, Elsevier, vol. 306(PB).
    27. Jonkers, Jef & Avendano, Diego Nieves & Van Wallendael, Glenn & Van Hoecke, Sofie, 2024. "A novel day-ahead regional and probabilistic wind power forecasting framework using deep CNNs and conformalized regression forests," Applied Energy, Elsevier, vol. 361(C).
    28. Chen, Fuhao & Yan, Jie & Liu, Yongqian & Yan, Yamin & Tjernberg, Lina Bertling, 2024. "A novel meta-learning approach for few-shot short-term wind power forecasting," Applied Energy, Elsevier, vol. 362(C).
    29. Liu, Jinqiang & Wang, Xiaoru & Lu, Yun, 2017. "A novel hybrid methodology for short-term wind power forecasting based on adaptive neuro-fuzzy inference system," Renewable Energy, Elsevier, vol. 103(C), pages 620-629.
    30. Moller, Jan Kloppenborg & Nielsen, Henrik Aalborg & Madsen, Henrik, 2008. "Time-adaptive quantile regression," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1292-1303, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Yanli & Wang, Junyi, 2022. "Transfer learning based multi-layer extreme learning machine for probabilistic wind power forecasting," Applied Energy, Elsevier, vol. 312(C).
    2. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    3. Peng, Simin & Zhu, Junchao & Wu, Tiezhou & Tang, Aihua & Kan, Jiarong & Pecht, Michael, 2024. "SOH early prediction of lithium-ion batteries based on voltage interval selection and features fusion," Energy, Elsevier, vol. 308(C).
    4. Chen, Junxiong & Hu, Yuanjiang & Zhu, Qiao & Rashid, Haroon & Li, Hongkun, 2023. "A novel battery health indicator and PSO-LSSVR for LiFePO4 battery SOH estimation during constant current charging," Energy, Elsevier, vol. 282(C).
    5. Zhang, Hao & Gao, Jingyi & Kang, Le & Zhang, Yi & Wang, Licheng & Wang, Kai, 2023. "State of health estimation of lithium-ion batteries based on modified flower pollination algorithm-temporal convolutional network," Energy, Elsevier, vol. 283(C).
    6. González-Sopeña, J.M. & Pakrashi, V. & Ghosh, B., 2021. "An overview of performance evaluation metrics for short-term statistical wind power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 138(C).
    7. Wang, Yun & Xu, Houhua & Zou, Runmin & Zhang, Lingjun & Zhang, Fan, 2022. "A deep asymmetric Laplace neural network for deterministic and probabilistic wind power forecasting," Renewable Energy, Elsevier, vol. 196(C), pages 497-517.
    8. Zhang, Wencan & He, Hancheng & Li, Taotao & Yuan, Jiangfeng & Xie, Yi & Long, Zhuoru, 2024. "Lithium-ion battery state of health prognostication employing multi-model fusion approach based on image coding of charging voltage and temperature data," Energy, Elsevier, vol. 296(C).
    9. Zhao, Hongqian & Chen, Zheng & Shu, Xing & Xiao, Renxin & Shen, Jiangwei & Liu, Yu & Liu, Yonggang, 2024. "Online surface temperature prediction and abnormal diagnosis of lithium-ion batteries based on hybrid neural network and fault threshold optimization," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    10. Meng, Jinhao & You, Yuqiang & Lin, Mingqiang & Wu, Ji & Song, Zhengxiang, 2024. "Multi-scenarios transferable learning framework with few-shot for early lithium-ion battery lifespan trajectory prediction," Energy, Elsevier, vol. 286(C).
    11. Dong, Xiaochong & Sun, Yingyun & Dong, Lei & Li, Jian & Li, Yan & Di, Lei, 2023. "Transferable wind power probabilistic forecasting based on multi-domain adversarial networks," Energy, Elsevier, vol. 285(C).
    12. Hu, Jiaxiang & Hu, Weihao & Cao, Di & Huang, Yuehui & Chen, Jianjun & Li, Yahe & Chen, Zhe & Blaabjerg, Frede, 2024. "Bayesian averaging-enabled transfer learning method for probabilistic wind power forecasting of newly built wind farms," Applied Energy, Elsevier, vol. 355(C).
    13. Cheng, Runkun & Yang, Di & Liu, Da & Zhang, Guowei, 2024. "A reconstruction-based secondary decomposition-ensemble framework for wind power forecasting," Energy, Elsevier, vol. 308(C).
    14. Zhong, Mingwei & Xu, Cancheng & Xian, Zikang & He, Guanglin & Zhai, Yanpeng & Zhou, Yongwang & Fan, Jingmin, 2024. "DTTM: A deep temporal transfer model for ultra-short-term online wind power forecasting," Energy, Elsevier, vol. 286(C).
    15. Mizutani, Daijiro & Nakazato, Yuto & Ikushima, Rie & Satsukawa, Koki & Kawasaki, Yosuke & Kuwahara, Masao, 2024. "Optimal intervention policy of emergency storage batteries for expressway transportation systems considering deterioration risk during lead time of replacement," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    16. Yao, Jiachi & Han, Te, 2023. "Data-driven lithium-ion batteries capacity estimation based on deep transfer learning using partial segment of charging/discharging data," Energy, Elsevier, vol. 271(C).
    17. Wu, Jian & Meng, Jinhao & Lin, Mingqiang & Wang, Wei & Wu, Ji & Stroe, Daniel-Ioan, 2024. "Lithium-ion battery state of health estimation using a hybrid model with electrochemical impedance spectroscopy," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
    18. Li, Fang & Min, Yongjun & Zhang, Ying & Zhang, Yong & Zuo, Hongfu & Bai, Fang, 2024. "State-of-health estimation method for fast-charging lithium-ion batteries based on stacking ensemble sparse Gaussian process regression," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    19. Yang, Mao & Wang, Da & Xu, Chuanyu & Dai, Bozhi & Ma, Miaomiao & Su, Xin, 2023. "Power transfer characteristics in fluctuation partition algorithm for wind speed and its application to wind power forecasting," Renewable Energy, Elsevier, vol. 211(C), pages 582-594.
    20. Sun, Mucun & Feng, Cong & Zhang, Jie, 2020. "Multi-distribution ensemble probabilistic wind power forecasting," Renewable Energy, Elsevier, vol. 148(C), pages 135-149.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:376:y:2024:i:pa:s030626192401451x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.