IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v306y2024ics0360544224022564.html
   My bibliography  Save this article

Interpretable wind power forecasting combining seasonal-trend representations learning with temporal fusion transformers architecture

Author

Listed:
  • Niu, Zhewen
  • Han, Xiaoqing
  • Zhang, Dongxia
  • Wu, Yuxiang
  • Lan, Songyan

Abstract

Wind power forecasting plays a critical role in the efficient integration of wind energy into power systems. Accurate short-term WPF helps maintain grid stability, optimize power dispatch, and reduce operational costs. However, current deep learning-based WPF architectures rely on mapping spatial–temporal features into a single high-dimensional representation, compromising performance and interpretability. In this work, the interpretable seasonal-trend representation algorithm (ISTR) is proposed to learn a couple of disentangled latent representations that describe seasonal-trend of wind power time series. The ISTR is developed in a self-supervised manner with no need for prior knowledge, providing sufficient interpretable information while avoiding the feature entanglement problem. The ISTR is then integrated into the temporal fusion transformer (TFT) model through seasonal time-point embedding to perform accurate multi-horizon WPF with interpretable meanings. In the case study, ISTR-TFT outperforms the current state-of-the-art methods by achieving an 8.9% improvement in mean absolute percentage error (MAPE) compared to DeepAR and a 15.7% improvement in pinball score. The proposed ISTR-TFT also shows enhanced robustness to noise and missing data scenarios. The interpretability results generated by ISTR-TFT reveal the importance of various input features and the learned temporal patterns, offering valuable insights for decision-making in power system operations.

Suggested Citation

  • Niu, Zhewen & Han, Xiaoqing & Zhang, Dongxia & Wu, Yuxiang & Lan, Songyan, 2024. "Interpretable wind power forecasting combining seasonal-trend representations learning with temporal fusion transformers architecture," Energy, Elsevier, vol. 306(C).
    • Handle: RePEc:eee:energy:v:306:y:2024:i:c:s0360544224022564
    DOI: 10.1016/j.energy.2024.132482
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224022564
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2024.132482?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wang, H.Z. & Wang, G.B. & Li, G.Q. & Peng, J.C. & Liu, Y.T., 2016. "Deep belief network based deterministic and probabilistic wind speed forecasting approach," Applied Energy, Elsevier, vol. 182(C), pages 80-93.
    2. Du, Pei & Yang, Dongchuan & Li, Yanzhao & Wang, Jianzhou, 2024. "An innovative interpretable combined learning model for wind speed forecasting," Applied Energy, Elsevier, vol. 358(C).
    3. He, Feifei & Zhou, Jianzhong & Feng, Zhong-kai & Liu, Guangbiao & Yang, Yuqi, 2019. "A hybrid short-term load forecasting model based on variational mode decomposition and long short-term memory networks considering relevant factors with Bayesian optimization algorithm," Applied Energy, Elsevier, vol. 237(C), pages 103-116.
    4. Lu Peng & Sheng‐Xiang Lv & Lin Wang, 2024. "Explainable machine learning techniques based on attention gate recurrent unit and local interpretable model‐agnostic explanations for multivariate wind speed forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(6), pages 2064-2087, September.
    5. Salinas, David & Flunkert, Valentin & Gasthaus, Jan & Januschowski, Tim, 2020. "DeepAR: Probabilistic forecasting with autoregressive recurrent networks," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1181-1191.
    6. Geng, Xiulin & Xu, Lingyu & He, Xiaoyu & Yu, Jie, 2021. "Graph optimization neural network with spatio-temporal correlation learning for multi-node offshore wind speed forecasting," Renewable Energy, Elsevier, vol. 180(C), pages 1014-1025.
    7. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    8. Wang, Fei & Chen, Peng & Zhen, Zhao & Yin, Rui & Cao, Chunmei & Zhang, Yagang & Duić, Neven, 2022. "Dynamic spatio-temporal correlation and hierarchical directed graph structure based ultra-short-term wind farm cluster power forecasting method," Applied Energy, Elsevier, vol. 323(C).
    9. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    10. Niu, Zhewen & Yu, Zeyuan & Tang, Wenhu & Wu, Qinghua & Reformat, Marek, 2020. "Wind power forecasting using attention-based gated recurrent unit network," Energy, Elsevier, vol. 196(C).
    11. Bentsen, Lars Ødegaard & Warakagoda, Narada Dilp & Stenbro, Roy & Engelstad, Paal, 2023. "Spatio-temporal wind speed forecasting using graph networks and novel Transformer architectures," Applied Energy, Elsevier, vol. 333(C).
    12. Wu, Binrong & Yu, Sihao & Peng, Lu & Wang, Lin, 2024. "Interpretable wind speed forecasting with meteorological feature exploring and two-stage decomposition," Energy, Elsevier, vol. 294(C).
    13. Jiang, Ping & Liu, Zhenkun & Abedin, Mohammad Zoynul & Wang, Jianzhou & Yang, Wendong & Dong, Qingli, 2024. "Profit-driven weighted classifier with interpretable ability for customer churn prediction," Omega, Elsevier, vol. 125(C).
    14. Zhenkun Liu & Ping Jiang & Koen W. de Bock & Jianzhou Wang & Lifang Zhang & Xinsong Niu, 2024. "Extreme gradient boosting trees with efficient Bayesian optimization for profit-driven customer churn prediction," Post-Print hal-04273578, HAL.
    15. Lim, Bryan & Arık, Sercan Ö. & Loeff, Nicolas & Pfister, Tomas, 2021. "Temporal Fusion Transformers for interpretable multi-horizon time series forecasting," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1748-1764.
    16. Wu, Binrong & Wang, Lin & Zeng, Yu-Rong, 2022. "Interpretable wind speed prediction with multivariate time series and temporal fusion transformers," Energy, Elsevier, vol. 252(C).
    17. Liu, Zhenkun & Jiang, Ping & De Bock, Koen W. & Wang, Jianzhou & Zhang, Lifang & Niu, Xinsong, 2024. "Extreme gradient boosting trees with efficient Bayesian optimization for profit-driven customer churn prediction," Technological Forecasting and Social Change, Elsevier, vol. 198(C).
    18. Zheng, Peijun & Zhou, Heng & Liu, Jiang & Nakanishi, Yosuke, 2023. "Interpretable building energy consumption forecasting using spectral clustering algorithm and temporal fusion transformers architecture," Applied Energy, Elsevier, vol. 349(C).
    19. Wu, Binrong & Wang, Lin, 2024. "Two-stage decomposition and temporal fusion transformers for interpretable wind speed forecasting," Energy, Elsevier, vol. 288(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wu, Binrong & Yu, Sihao & Peng, Lu & Wang, Lin, 2024. "Interpretable wind speed forecasting with meteorological feature exploring and two-stage decomposition," Energy, Elsevier, vol. 294(C).
    2. Bentsen, Lars Ødegaard & Warakagoda, Narada Dilp & Stenbro, Roy & Engelstad, Paal, 2023. "Spatio-temporal wind speed forecasting using graph networks and novel Transformer architectures," Applied Energy, Elsevier, vol. 333(C).
    3. Du, Pei & Yang, Dongchuan & Li, Yanzhao & Wang, Jianzhou, 2024. "An innovative interpretable combined learning model for wind speed forecasting," Applied Energy, Elsevier, vol. 358(C).
    4. Zhu, Nanyang & Wang, Ying & Yuan, Kun & Yan, Jiahao & Li, Yaping & Zhang, Kaifeng, 2024. "GGNet: A novel graph structure for power forecasting in renewable power plants considering temporal lead-lag correlations," Applied Energy, Elsevier, vol. 364(C).
    5. Wang, Lei & Wang, Xinyu & Zhao, Zhongchao, 2024. "Mid-term electricity demand forecasting using improved multi-mode reconstruction and particle swarm-enhanced support vector regression," Energy, Elsevier, vol. 304(C).
    6. Nascimento, Erick Giovani Sperandio & de Melo, Talison A.C. & Moreira, Davidson M., 2023. "A transformer-based deep neural network with wavelet transform for forecasting wind speed and wind energy," Energy, Elsevier, vol. 278(C).
    7. Liu, Zhenkun & Zhang, Ying & Abedin, Mohammad Zoynul & Wang, Jianzhou & Yang, Hufang & Gao, Yuyang & Chen, Yinghao, 2024. "Profit-driven fusion framework based on bagging and boosting classifiers for potential purchaser prediction," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    8. Yang, Ting & Yang, Zhenning & Li, Fei & Wang, Hengyu, 2024. "A short-term wind power forecasting method based on multivariate signal decomposition and variable selection," Applied Energy, Elsevier, vol. 360(C).
    9. Shengcai Zhang & Changsheng Zhu & Xiuting Guo, 2024. "Wind-Speed Multi-Step Forecasting Based on Variational Mode Decomposition, Temporal Convolutional Network, and Transformer Model," Energies, MDPI, vol. 17(9), pages 1-22, April.
    10. Feng, Yi & Yin, Yunqiang & Wang, Dujuan & Ignatius, Joshua & Cheng, T.C.E. & Marra, Marianna & Guo, Yihan, 2024. "Enhancing e-commerce customer churn management with a profit- and AUC-focused prescriptive analytics approach," Journal of Business Research, Elsevier, vol. 184(C).
    11. Sun, Xiaoying & Liu, Haizhong, 2024. "Multivariate short-term wind speed prediction based on PSO-VMD-SE-ICEEMDAN two-stage decomposition and Att-S2S," Energy, Elsevier, vol. 305(C).
    12. Zheng, Peijun & Zhou, Heng & Liu, Jiang & Nakanishi, Yosuke, 2023. "Interpretable building energy consumption forecasting using spectral clustering algorithm and temporal fusion transformers architecture," Applied Energy, Elsevier, vol. 349(C).
    13. Liu, Chenyu & Zhang, Xuemin & Mei, Shengwei & Zhou, Qingyu & Fan, Hang, 2023. "Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction," Applied Energy, Elsevier, vol. 336(C).
    14. Lin Wang & Wuyue An & Feng‐Ting Li, 2024. "Text‐based corn futures price forecasting using improved neural basis expansion network," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(6), pages 2042-2063, September.
    15. Shengxiang Lv & Lin Wang & Sirui Wang, 2023. "A Hybrid Neural Network Model for Short-Term Wind Speed Forecasting," Energies, MDPI, vol. 16(4), pages 1-18, February.
    16. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    17. Dong, Hanjiang & Zhu, Jizhong & Li, Shenglin & Wu, Wanli & Zhu, Haohao & Fan, Junwei, 2023. "Short-term residential household reactive power forecasting considering active power demand via deep Transformer sequence-to-sequence networks," Applied Energy, Elsevier, vol. 329(C).
    18. Pesantez, Jorge E. & Li, Binbin & Lee, Christopher & Zhao, Zhizhen & Butala, Mark & Stillwell, Ashlynn S., 2023. "A Comparison Study of Predictive Models for Electricity Demand in a Diverse Urban Environment," Energy, Elsevier, vol. 283(C).
    19. Wuyue An & Lin Wang & Dongfeng Zhang, 2023. "Comprehensive commodity price forecasting framework using text mining methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1865-1888, November.
    20. He Yin & Hai Lan & Ying-Yi Hong & Zhuangwei Wang & Peng Cheng & Dan Li & Dong Guo, 2023. "A Comprehensive Review of Shipboard Power Systems with New Energy Sources," Energies, MDPI, vol. 16(5), pages 1-44, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:306:y:2024:i:c:s0360544224022564. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.