IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v238y2022ipbs0360544221020569.html
   My bibliography  Save this article

A novel loss function of deep learning in wind speed forecasting

Author

Listed:
  • Chen, Xi
  • Yu, Ruyi
  • Ullah, Sajid
  • Wu, Dianming
  • Li, Zhiqiang
  • Li, Qingli
  • Qi, Honggang
  • Liu, Jihui
  • Liu, Min
  • Zhang, Yundong

Abstract

Wind speed forecasting is an essential task in improving the efficiency of the energy supply. Currently, deep learning models have become extremely popular, where the traditional mean squared error (MSE) loss function is often employed. Unfortunately, the MSE loss function cannot accurately measure the nonlinearity of wind speed data, and new loss functions have seldom been developed for wind speed forecasting. In addition, the MSE loss function is sensitive to outliers, degrading the stability. To address these problems, we propose a kernel MSE loss function to evaluate the ubiquitous nonlinearity of deep learning errors in the reproducing kernel Hilbert space. The new loss function utilizes the kernel skills in the loss function of deep learning methods for the first time. The first and second derivatives of the new loss function guarantee the robustness against outliers. The experimental results with three fundamental deep learning methods on three public datasets validate that the new loss function is efficient and superior in most cases, and its resultant error can be 95% smaller than MSE in multiple step prediction. The results imply that developing a loss function with kernel skills is a new way to get better results.

Suggested Citation

  • Chen, Xi & Yu, Ruyi & Ullah, Sajid & Wu, Dianming & Li, Zhiqiang & Li, Qingli & Qi, Honggang & Liu, Jihui & Liu, Min & Zhang, Yundong, 2022. "A novel loss function of deep learning in wind speed forecasting," Energy, Elsevier, vol. 238(PB).
  • Handle: RePEc:eee:energy:v:238:y:2022:i:pb:s0360544221020569
    DOI: 10.1016/j.energy.2021.121808
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544221020569
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2021.121808?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Li, Yanfei & Shi, Huipeng & Han, Fengze & Duan, Zhu & Liu, Hui, 2019. "Smart wind speed forecasting approach using various boosting algorithms, big multi-step forecasting strategy," Renewable Energy, Elsevier, vol. 135(C), pages 540-553.
    2. Yin, Xiuxing & Zhao, Xiaowei & Lin, Jin & Karcanias, Aris, 2020. "Reliability aware multi-objective predictive control for wind farm based on machine learning and heuristic optimizations," Energy, Elsevier, vol. 202(C).
    3. Lilin Cheng & Haixiang Zang & Tao Ding & Rong Sun & Miaomiao Wang & Zhinong Wei & Guoqiang Sun, 2018. "Ensemble Recurrent Neural Network Based Probabilistic Wind Speed Forecasting Approach," Energies, MDPI, vol. 11(8), pages 1-23, July.
    4. Sewdien, V.N. & Preece, R. & Torres, J.L. Rueda & Rakhshani, E. & van der Meijden, M., 2020. "Assessment of critical parameters for artificial neural networks based short-term wind generation forecasting," Renewable Energy, Elsevier, vol. 161(C), pages 878-892.
    5. Karasu, Seçkin & Altan, Aytaç & Bekiros, Stelios & Ahmad, Wasim, 2020. "A new forecasting model with wrapper-based feature selection approach using multi-objective optimization technique for chaotic crude oil time series," Energy, Elsevier, vol. 212(C).
    6. Liu, Zhenkun & Jiang, Ping & Zhang, Lifang & Niu, Xinsong, 2020. "A combined forecasting model for time series: Application to short-term wind speed forecasting," Applied Energy, Elsevier, vol. 259(C).
    7. Liu, Hui & Yu, Chengqing & Wu, Haiping & Duan, Zhu & Yan, Guangxi, 2020. "A new hybrid ensemble deep reinforcement learning model for wind speed short term forecasting," Energy, Elsevier, vol. 202(C).
    8. Zhang, Wenyu & Zhang, Lifang & Wang, Jianzhou & Niu, Xinsong, 2020. "Hybrid system based on a multi-objective optimization and kernel approximation for multi-scale wind speed forecasting," Applied Energy, Elsevier, vol. 277(C).
    9. Zhang, Chi & Wei, Haikun & Zhao, Junsheng & Liu, Tianhong & Zhu, Tingting & Zhang, Kanjian, 2016. "Short-term wind speed forecasting using empirical mode decomposition and feature selection," Renewable Energy, Elsevier, vol. 96(PA), pages 727-737.
    10. Fadare, D.A., 2010. "The application of artificial neural networks to mapping of wind speed profile for energy application in Nigeria," Applied Energy, Elsevier, vol. 87(3), pages 934-942, March.
    11. Wang, Huai-zhi & Li, Gang-qiang & Wang, Gui-bin & Peng, Jian-chun & Jiang, Hui & Liu, Yi-tao, 2017. "Deep learning based ensemble approach for probabilistic wind power forecasting," Applied Energy, Elsevier, vol. 188(C), pages 56-70.
    12. Ziel, Florian & Croonenbroeck, Carsten & Ambach, Daniel, 2016. "Forecasting wind power – Modeling periodic and non-linear effects under conditional heteroscedasticity," Applied Energy, Elsevier, vol. 177(C), pages 285-297.
    13. Li, Chen & Zhu, Zhijie & Yang, Hufang & Li, Ranran, 2019. "An innovative hybrid system for wind speed forecasting based on fuzzy preprocessing scheme and multi-objective optimization," Energy, Elsevier, vol. 174(C), pages 1219-1237.
    14. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    15. Chang, G.W. & Lu, H.J. & Chang, Y.R. & Lee, Y.D., 2017. "An improved neural network-based approach for short-term wind speed and power forecast," Renewable Energy, Elsevier, vol. 105(C), pages 301-311.
    16. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.
    17. Hu, Qinghua & Zhang, Rujia & Zhou, Yucan, 2016. "Transfer learning for short-term wind speed prediction with deep neural networks," Renewable Energy, Elsevier, vol. 85(C), pages 83-95.
    18. Liu, Da & Wang, Jilong & Wang, Hui, 2015. "Short-term wind speed forecasting based on spectral clustering and optimised echo state networks," Renewable Energy, Elsevier, vol. 78(C), pages 599-608.
    19. Hong, Ying-Yi & Satriani, Thursy Rienda Aulia, 2020. "Day-ahead spatiotemporal wind speed forecasting using robust design-based deep learning neural network," Energy, Elsevier, vol. 209(C).
    20. Wang, Shouxiang & Zhang, Na & Wu, Lei & Wang, Yamin, 2016. "Wind speed forecasting based on the hybrid ensemble empirical mode decomposition and GA-BP neural network method," Renewable Energy, Elsevier, vol. 94(C), pages 629-636.
    21. Altan, Aytaç & Karasu, Seçkin & Bekiros, Stelios, 2019. "Digital currency forecasting with chaotic meta-heuristic bio-inspired signal processing techniques," Chaos, Solitons & Fractals, Elsevier, vol. 126(C), pages 325-336.
    22. Altan, Aytaç & Karasu, Seçkin, 2020. "Recognition of COVID-19 disease from X-ray images by hybrid model consisting of 2D curvelet transform, chaotic salp swarm algorithm and deep learning technique," Chaos, Solitons & Fractals, Elsevier, vol. 140(C).
    23. Jiang, Ping & Wang, Biao & Li, Hongmin & Lu, Haiyan, 2019. "Modeling for chaotic time series based on linear and nonlinear framework: Application to wind speed forecasting," Energy, Elsevier, vol. 173(C), pages 468-482.
    24. Liu, Hui & Tian, Hong-qi & Li, Yan-fei, 2012. "Comparison of two new ARIMA-ANN and ARIMA-Kalman hybrid methods for wind speed prediction," Applied Energy, Elsevier, vol. 98(C), pages 415-424.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Li, Min & Yang, Yi & He, Zhaoshuang & Guo, Xinbo & Zhang, Ruisheng & Huang, Bingqing, 2023. "A wind speed forecasting model based on multi-objective algorithm and interpretability learning," Energy, Elsevier, vol. 269(C).
    2. Junjie Liu & Lang Liu, 2024. "Point and Interval Forecasting of Coal Price Adopting a Novel Decomposition Integration Model," Energies, MDPI, vol. 17(16), pages 1-17, August.
    3. Yi Xiao & Minghu Xie & Yi Hu & Ming Yi, 2023. "Effective multi‐step ahead container throughput forecasting under the complex context," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1823-1843, November.
    4. Wang, Yun & Song, Mengmeng & Yang, Dazhi, 2024. "Local-global feature-based spatio-temporal wind speed forecasting with a sparse and dynamic graph," Energy, Elsevier, vol. 289(C).
    5. Zhang, Guowei & Zhang, Yi & Wang, Hui & Liu, Da & Cheng, Runkun & Yang, Di, 2024. "Short-term wind speed forecasting based on adaptive secondary decomposition and robust temporal convolutional network," Energy, Elsevier, vol. 288(C).
    6. Yang, Xiaolin & Zhang, Kefei & Ni, Chao & Cao, Hua & Thé, Jesse & Xie, Guangyuan & Tan, Zhongchao & Yu, Hesheng, 2022. "Ash determination of coal flotation concentrate by analyzing froth image using a novel hybrid model based on deep learning algorithms and attention mechanism," Energy, Elsevier, vol. 260(C).
    7. Zhang, Xinru & Hou, Lei & Liu, Jiaquan & Yang, Kai & Chai, Chong & Li, Yanhao & He, Sichen, 2022. "Energy consumption prediction for crude oil pipelines based on integrating mechanism analysis and data mining," Energy, Elsevier, vol. 254(PB).
    8. Zhang, Chu & Ji, Chunlei & Hua, Lei & Ma, Huixin & Nazir, Muhammad Shahzad & Peng, Tian, 2022. "Evolutionary quantile regression gated recurrent unit network based on variational mode decomposition, improved whale optimization algorithm for probabilistic short-term wind speed prediction," Renewable Energy, Elsevier, vol. 197(C), pages 668-682.
    9. Wang, Xuguang & Li, Xiao & Su, Jie, 2023. "Distribution drift-adaptive short-term wind speed forecasting," Energy, Elsevier, vol. 273(C).
    10. Pan Wu & Jinlong Li & Yuzhuang Pian & Xiaochen Li & Zilin Huang & Lunhui Xu & Guilin Li & Ruonan Li, 2022. "How Determinants Affect Transfer Ridership between Metro and Bus Systems: A Multivariate Generalized Poisson Regression Analysis Method," Sustainability, MDPI, vol. 14(15), pages 1-31, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    2. Shang, Zhihao & He, Zhaoshuang & Chen, Yao & Chen, Yanhua & Xu, MingLiang, 2022. "Short-term wind speed forecasting system based on multivariate time series and multi-objective optimization," Energy, Elsevier, vol. 238(PC).
    3. Liu, Hui & Chen, Chao, 2019. "Data processing strategies in wind energy forecasting models and applications: A comprehensive review," Applied Energy, Elsevier, vol. 249(C), pages 392-408.
    4. Liang, Tao & Zhao, Qing & Lv, Qingzhao & Sun, Hexu, 2021. "A novel wind speed prediction strategy based on Bi-LSTM, MOOFADA and transfer learning for centralized control centers," Energy, Elsevier, vol. 230(C).
    5. Li, Ke & Shen, Ruifang & Wang, Zhenguo & Yan, Bowen & Yang, Qingshan & Zhou, Xuhong, 2023. "An efficient wind speed prediction method based on a deep neural network without future information leakage," Energy, Elsevier, vol. 267(C).
    6. Lu, Peng & Ye, Lin & Tang, Yong & Zhao, Yongning & Zhong, Wuzhi & Qu, Ying & Zhai, Bingxu, 2021. "Ultra-short-term combined prediction approach based on kernel function switch mechanism," Renewable Energy, Elsevier, vol. 164(C), pages 842-866.
    7. Huang, Xiaojia & Wang, Chen & Zhang, Shenghui, 2024. "Research and application of a Model selection forecasting system for wind speed and theoretical power generation in wind farms based on classification and wind conversion," Energy, Elsevier, vol. 293(C).
    8. Li, Wenzhe & Jia, Xiaodong & Li, Xiang & Wang, Yinglu & Lee, Jay, 2021. "A Markov model for short term wind speed prediction by integrating the wind acceleration information," Renewable Energy, Elsevier, vol. 164(C), pages 242-253.
    9. Qian, Zheng & Pei, Yan & Zareipour, Hamidreza & Chen, Niya, 2019. "A review and discussion of decomposition-based hybrid models for wind energy forecasting applications," Applied Energy, Elsevier, vol. 235(C), pages 939-953.
    10. Marugán, Alberto Pliego & Márquez, Fausto Pedro García & Perez, Jesus María Pinar & Ruiz-Hernández, Diego, 2018. "A survey of artificial neural network in wind energy systems," Applied Energy, Elsevier, vol. 228(C), pages 1822-1836.
    11. Vladimir Simankov & Pavel Buchatskiy & Semen Teploukhov & Stefan Onishchenko & Anatoliy Kazak & Petr Chetyrbok, 2023. "Review of Estimating and Predicting Models of the Wind Energy Amount," Energies, MDPI, vol. 16(16), pages 1-24, August.
    12. Zhang, Jinliang & Wei, Yiming & Tan, Zhongfu, 2020. "An adaptive hybrid model for short term wind speed forecasting," Energy, Elsevier, vol. 190(C).
    13. Acikgoz, Hakan & Budak, Umit & Korkmaz, Deniz & Yildiz, Ceyhun, 2021. "WSFNet: An efficient wind speed forecasting model using channel attention-based densely connected convolutional neural network," Energy, Elsevier, vol. 233(C).
    14. Dongxiao Niu & Yi Liang & Wei-Chiang Hong, 2017. "Wind Speed Forecasting Based on EMD and GRNN Optimized by FOA," Energies, MDPI, vol. 10(12), pages 1-18, December.
    15. Wang, Kejun & Qi, Xiaoxia & Liu, Hongda & Song, Jiakang, 2018. "Deep belief network based k-means cluster approach for short-term wind power forecasting," Energy, Elsevier, vol. 165(PA), pages 840-852.
    16. Chen, Xue-Jun & Zhao, Jing & Jia, Xiao-Zhong & Li, Zhong-Long, 2021. "Multi-step wind speed forecast based on sample clustering and an optimized hybrid system," Renewable Energy, Elsevier, vol. 165(P1), pages 595-611.
    17. Sun, Mucun & Feng, Cong & Zhang, Jie, 2020. "Multi-distribution ensemble probabilistic wind power forecasting," Renewable Energy, Elsevier, vol. 148(C), pages 135-149.
    18. Liu, Shuihan & Xie, Gang & Wang, Zhengzhong & Wang, Shouyang, 2024. "A secondary decomposition-ensemble framework for interval carbon price forecasting," Applied Energy, Elsevier, vol. 359(C).
    19. Kashkynbayev, Ardak & Cao, Jinde & Suragan, Durvudkhan, 2021. "Global Lagrange stability analysis of retarded SICNNs," Chaos, Solitons & Fractals, Elsevier, vol. 145(C).
    20. Duan, Jikai & Zuo, Hongchao & Bai, Yulong & Duan, Jizheng & Chang, Mingheng & Chen, Bolong, 2021. "Short-term wind speed forecasting using recurrent neural networks with error correction," Energy, Elsevier, vol. 217(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:238:y:2022:i:pb:s0360544221020569. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.